Image analysis – Pattern recognition – On-line recognition of handwritten characters
Reexamination Certificate
2000-08-22
2004-10-05
Mariam, Daniel (Department: 2621)
Image analysis
Pattern recognition
On-line recognition of handwritten characters
C382S229000
Reexamination Certificate
active
06801660
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates generally to computer devices, and more particularly computer devices arranged to receive handwritten input.
BACKGROUND OF THE INVENTION
Contemporary computing devices allow users to enter handwritten words (e.g., in cursive handwriting and/or printed handwritten characters) and symbols (e.g., a character in Far East languages). The words and symbols can be used as is, e.g., to function as readable notes and so forth, or can be converted to text for more conventional computer uses. To convert to text, for example, as a user writes strokes representing words or other symbols onto a touch-sensitive computer screen or the like, a handwriting recognizer (e.g., trained with millions of samples, employing a dictionary, context and other rules) is able to convert the handwriting data into dictionary words or symbols. In this manner, users are able to enter textual data without necessarily needing a keyboard.
Contemporary handwriting recognizers are not one hundred percent accurate in recognizing words. Because of this, one type of recognizer returns a list of alternates, ranked according to probability by the recognizer. Via a user interface, systems may provide a list of these alternates, from which the user can select a different word instead of the word the recognizer initially guessed as the one that the user most likely intended.
However, words in a word processing system are often edited, including moving around the words, having letters therein deleted, inserted, replaced with others, and so forth. Also, selected words may be toggled between handwritten data that the user entered and a recognized (e.g., text) state. An efficient, robust and flexible mechanism for maintaining the alternates in association with the word that does not lose the alternates as words are edited or undergo state changes is needed.
SUMMARY OF THE INVENTION
Briefly, the present invention provides a mechanism that maintains an association between alternates for a given ink word, regardless of the handwritten or text state of the word, and regardless of the position of the word as it may be edited in a document.
In one implementation, handwritten data is maintained in an ink word data structure. Once the word is recognized and an alternate is selected for it, (converted to text), the first character of the word remains as an ink word (in a text buffer) pointing to the data structure, with a Show Recognized flag (tsShowRecognized) set in the data structure indicating that the word is now recognized as text. In this state, the first character is displayed to the user as a recognized text letter instead of as the handwritten word. The other characters that make up the recognized word are inserted as text into the text buffer. Any alternates returned by the recognizer are thus stored (directly or indirectly via a pointer) with the ink word data structure displayed as this first character of a recognized word, which also maintains the ink data, e.g., the stroke information entered by a user or the like. Then, if the user edits the word, e.g., moves it, the alternates and also the ink data move with the word. In one implementation, the alternates and stroke data are lost if the user deletes the first character of the recognized word. In an alternative implementation, this data effectively can be moved to another, remaining character in the word.
Other alternatives include maintaining an invisible text element or token that points to the original ink word and remains associated with the full text of the word, e.g., the token (before, within or after the word) moves with the word. In another alternative, the recognized word can have the first character placed in the text buffer along with the other recognized characters, with the pointer to the ink word data remaining in the text buffer in association with the recognized word, but the ink word data structure having a flag set therein indicating that it should be considered hidden. Another alternative mechanism maintains the entire recognized text word in an ink word data structure. In this alternative, the word processing/editing software is modified to edit the words within the ink word data structure. Yet another possible alternative includes maintaining a separate data structure comprising a table or the like that associates the location of characters in a text buffer with a separately maintained list of alternates. Note that one problem with these alternatives is that existing word/ink processing code may need to be modified.
Other advantages will become apparent from the following detailed description when taken in conjunction with the drawings, in which:
REFERENCES:
patent: 5594640 (1997-01-01), Capps et al.
patent: 5615285 (1997-03-01), Beernink
patent: 5675665 (1997-10-01), Lyon
patent: 5682439 (1997-10-01), Beernink et al.
patent: 5710916 (1998-01-01), Barbaraet et al.
patent: 5764799 (1998-06-01), Hong et al.
patent: 5812697 (1998-09-01), Sakai et al.
patent: 5828991 (1998-10-01), Skiena et al.
patent: 5855000 (1998-12-01), Waibel et al.
patent: 5857099 (1999-01-01), Mitchell et al.
patent: 5953451 (1999-09-01), Syeda-Mahmood
patent: 5960447 (1999-09-01), Holt et al.
patent: 5995664 (1999-11-01), Shimomura
patent: 6005973 (1999-12-01), Seybold et al.
patent: 6014460 (2000-01-01), Fukushima et al.
patent: 6041141 (2000-03-01), Yamamoto et al.
patent: 6111985 (2000-08-01), Hullender et al.
patent: 6473517 (2002-10-01), Tyan et al.
patent: 6493464 (2002-12-01), Hawkins et al.
patent: 2002/0013795 (2002-01-01), Dresevie et al.
patent: 2002/0049796 (2002-04-01), Dresevie et al.
patent: 07110845 (1995-04-01), None
Senda et al. “Document Image Retrieval System Using Character Candidates Generated by Character Recognition Process.” Proc. Of the 2ndInt. Conf. on Document Analysis and Recognition, Oct. 20, 1993, pp. 541-546.
Carrano. Data Abstraction and Problem Solving with C++; Walls and Mirrors. The Benjamin/Cummings Publishing Company, Inc,. 1995, pp. 150-163, 175-176, 179-180.
Morita et al. “A Fast and Compact Data Structure of Storing Multi-Attribute Relations Among Words.” IEEE In Conf. on Systems, Man and Cybernetics, vol. 3, Oct. 11, 1998, pp. 2791-2796.
Arica et al. “A New Scheme for Off-Line Handwritten Connected Digit Recognition.” Proc. KES '98, 2ndInt. Conf. on Knowledge-Based Intelligent Electronics Systems, vol. 2, Apr. 21, 1998, pp. 329-335.
Jung et al. Machine Printed Character Segementation Method Using Side Profiles. Proc. SMC '99, IEE Int. Conf. on Systems, Man, and Cybernetics, vol. 6, Oct. 12, 1999, pp. 863-867.
Liang et al. “Efficient Algorithms for Segmentation and Recognition of Printed Characters in Document Processing.” IEEE Pacific Rim Conf. on Communications, Computers and Signal Processing, vol. 1, May 19, 1993, pp.240-243.
Lee et al. “A New Methodology for Gray-Scale Character Segmentation and Recognition.” Proc. Of the 3rdInt. Conf. on Document Analysis and Recognition, vol. 1, Aug. 14, 1995, pp. 524-527.
Ariki et al., “Segmentation and Recognition of Handwritten Characters Using Subspace Method.” Proc. Of the 3rdInt. Conf. on Document Analysis and Recognition, vol. 1, Aug. 14, 1995, pp 120-123.
Zhao et al. “New Method for Segmenting Unconstrained Handwritten Numeral String.” Proc. Of the 4thInt. Conf. on Document Analysis and Recognition, vol. 2, Aug. 18, 1997, pp. 524-527.
Altman Dan W.
Lui Charlton E.
Williamson Peter H.
Law Offices of Albert S. Michalik PLLC
Mariam Daniel
Microsoft Corporation
LandOfFree
Method and system for maintaining alternates in association... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and system for maintaining alternates in association..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for maintaining alternates in association... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3314382