Skip to yearly menu bar Skip to main content


Poster

Joint Line Segmentation and Transcription for End-to-End Handwritten Paragraph Recognition

Theodore Bluche

Area 5+6+7+8 #124

Keywords: [ Deep Learning or Neural Networks ] [ (Application) Computer Vision ] [ (Application) Object and Pattern Recognition ] [ (Other) Applications ] [ (Application) Signal and Speech Processing ] [ (Application) Natural Language and Text Processing ]


Abstract:

Offline handwriting recognition systems require cropped text line images for both training and recognition. On the one hand, the annotation of position and transcript at line level is costly to obtain. On the other hand, automatic line segmentation algorithms are prone to errors, compromising the subsequent recognition. In this paper, we propose a modification of the popular and efficient Multi-Dimensional Long Short-Term Memory Recurrent Neural Networks (MDLSTM-RNNs) to enable end-to-end processing of handwritten paragraphs. More particularly, we replace the collapse layer transforming the two-dimensional representation into a sequence of predictions by a recurrent version which can select one line at a time. In the proposed model, a neural network performs a kind of implicit line segmentation by computing attention weights on the image representation. The experiments on paragraphs of Rimes and IAM databases yield results that are competitive with those of networks trained at line level, and constitute a significant step towards end-to-end transcription of full documents.

Live content is unavailable. Log in and register to view live content