Handwriting symbol recognition accuracy using speech input

Details Handwriting symbol recognition accuracy using speech input Handwriting symbol recognition accuracy using speech input

2008-02-26

2011-12-13

Dulaney, Kathleen Y (Department: 2624)

Image analysis

Pattern recognition

On-line recognition of handwritten characters

C382S228000, C382S229000, C715S708000, C704S255000, C345S156000

Reexamination Certificate

active

08077975

ABSTRACT:
Described is a bimodal data input technology by which handwriting recognition results are combined with speech recognition results to improve overall recognition accuracy. Handwriting data and speech data corresponding to mathematical symbols are received and processed (including being recognized) into respective graphs. A fusion mechanism uses the speech graph to enhance the handwriting graph, e.g., to better distinguish between similar handwritten symbols that are often misrecognized. The graphs include nodes representing symbols, and arcs between the nodes representing probability scores. When arcs in the first and second graphs are determined to match one another, such as aligned in time and associated with corresponding symbols, the probability score in the second graph for that arc is used to adjust the matching probability score in the first graph. Normalization and smoothing may be performed to correspond the graphs to one another and to control the influence of one graph on the other.

REFERENCES:
patent: 6285785 (2001-09-01), Bellegarda et al.
patent: 2004/0015342 (2004-01-01), Garst
patent: 2004/0054701 (2004-03-01), Garst
patent: 2005/0128181 (2005-06-01), Wang et al.
patent: 2006/0062467 (2006-03-01), Zou et al.
patent: 2006/0127872 (2006-06-01), Marggraff
patent: 2006/0290656 (2006-12-01), Soong et al.
patent: 2007/0046645 (2007-03-01), Hirota et al.
patent: 2007/0154116 (2007-07-01), Shieh
Guy; et al., “Math Speak & Write, a Computer Program to Read and Hear Mathematical Input”, Electrical Engineering and Computer Sciences Department, Univ. of Calif, Berkeley, Date: Aug. 2004, pp. 1-9.
Anthony; et al., “Evaluation of Multimodal Input for Entering Mathematical Equations on the Computer”, Human Computer Interaction Institute, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, pp. 1-4.
Fateman, “Handwriting + Speech for Computer Entry of Mathematics—Work in Progress”, Computer Science Division, University of California, Berkeley CA, pp. 1-13.
Anthony; et al., “Evaluation of Multimodal Input for Entering Mathematical Equations on the Computer”, Human Computer Interaction Institute, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, pp. 1-4. 2005.
Fateman, “Handwriting + Speech for Computer Entry of Mathematics-Work in Progress”, Computer Science Division, University of California, Berkeley CA, pp. 1-13. 2004.
Shi, Y. et al.; “A Unified Framework for Symbol Segmentation and Recognition of Handwritten Mathematical Expressions,” ICDAR, vol. II, 2007; pp. 854-858.

Affiliated with

Also associated with

Rating

Handwriting symbol recognition accuracy using speech input does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Handwriting symbol recognition accuracy using speech input, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Handwriting symbol recognition accuracy using speech input will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4268867