TY - JOUR
T1 - Transcript mapping for handwritten Chinese documents by integrating character recognition model and geometric context
AU - Yin, Fei
AU - Wang, Qiu Feng
AU - Liu, Cheng Lin
N1 - Funding Information:
The authors would like to thank Tonghua Su for authorizing us to use the HIT-MW database. This work was supported by the National Natural Science Foundation of China (NSFC) under Grants 61175021 and 60933010 .
PY - 2013/10
Y1 - 2013/10
N2 - Creating document image datasets with ground-truths of regions, text lines and characters is a prerequisite for document analysis research. However, ground-truthing large datasets is not only laborious and time consuming but also prone to errors due to the difficulty of character segmentation and the large variability of character shape, size and position. This paper describes an effective recognition-based annotation approach for ground-truthing handwritten Chinese documents. Under the Bayesian framework, the alignment of text line images with text transcript, which is the crucial step of annotation, is formulated as an optimization problem by incorporating geometric context of characters and character recognition model. We evaluated the alignment performance on a Chinese handwriting database CASIA-HWDB, which contains nearly four million character samples of 7356 classes and 5091 pages of unconstrained handwritten texts. The experimental results demonstrate the superiority of recognition-based text line alignment and the benefit of integrating geometric context. On a test set of 1015 handwritten pages (10,449 text lines), the proposed approach achieved character level alignment accuracy 92.32% when involving under-segmentation errors and 99.04% when excluding under-segmentation errors. The tool based on the proposed approach has been practically used for labeling handwritten Chinese documents.
AB - Creating document image datasets with ground-truths of regions, text lines and characters is a prerequisite for document analysis research. However, ground-truthing large datasets is not only laborious and time consuming but also prone to errors due to the difficulty of character segmentation and the large variability of character shape, size and position. This paper describes an effective recognition-based annotation approach for ground-truthing handwritten Chinese documents. Under the Bayesian framework, the alignment of text line images with text transcript, which is the crucial step of annotation, is formulated as an optimization problem by incorporating geometric context of characters and character recognition model. We evaluated the alignment performance on a Chinese handwriting database CASIA-HWDB, which contains nearly four million character samples of 7356 classes and 5091 pages of unconstrained handwritten texts. The experimental results demonstrate the superiority of recognition-based text line alignment and the benefit of integrating geometric context. On a test set of 1015 handwritten pages (10,449 text lines), the proposed approach achieved character level alignment accuracy 92.32% when involving under-segmentation errors and 99.04% when excluding under-segmentation errors. The tool based on the proposed approach has been practically used for labeling handwritten Chinese documents.
KW - Confidence transformation (CT)
KW - Dynamic time warping (DTW)
KW - Geometric context
KW - Minimum classification error (MCE)
KW - Transcript mapping
UR - http://www.scopus.com/inward/record.url?scp=84878012493&partnerID=8YFLogxK
U2 - 10.1016/j.patcog.2013.03.013
DO - 10.1016/j.patcog.2013.03.013
M3 - Article
AN - SCOPUS:84878012493
SN - 0031-3203
VL - 46
SP - 2807
EP - 2818
JO - Pattern Recognition
JF - Pattern Recognition
IS - 10
ER -