Towards Handwritten Mathematical Expression Recognition

Ahmad-Montaser Awal, Harold Mouchère, Christian Viard-Gaudin
2009 2009 10th International Conference on Document Analysis and Recognition  
In this paper, we propose a new framework for online handwritten mathematical expression recognition. The proposed architecture aims at handling mathematical expression recognition as a simultaneous optimization of symbol segmentation, symbol recognition, and 2D structure recognition under the restriction of a mathematical expression grammar. To achieve this goal, we consider a hypothesis generation mechanism supporting a 2D grouping of elementary strokes, a cost function defining the global
more » ... elihood of a solution, and a dynamic programming scheme giving at the end the best global solution according to a 2D grammar and a classifier. As a classifier, a neural network architecture is used; it is trained within the overall architecture allowing rejecting incorrect segmented patterns. The proposed system is trained with a set of synthetic online handwritten mathematical expressions. When tested on a set of real complex expressions, the system achieves promising results at both symbol and expression interpretation levels. 10th International Conference on Document Analysis and Recognition 978-0-7695-3725-2/09 $25.00
doi:10.1109/icdar.2009.71 dblp:conf/icdar/AwalMV09 fatcat:5dc2ybtfwbh7xnfvn6o3kwtxzy