Image analysis – Pattern recognition – Context analysis or word recognition
Patent
1994-06-06
1997-11-11
Boudreau, Leo
Image analysis
Pattern recognition
Context analysis or word recognition
382187, 382230, G06K 972, G06K 900
Patent
active
056872542
ABSTRACT:
A method and system provide for searching and matching gesture-based data such as handwriting without performing a recognition process on the handwritten gesture data to convert it to a standard computer-coded form. Target data collected as sample data points of spatial coordinates over time are concatenated into a single target gesture sequence of sample data points. The sample data points comprising the gesture-based data structure to be searched (the corpus) are grouped into corpus gesture sequences for matching against the target gesture sequence. Matching may be done by any suitable method, and a novel signal comparison technique based on dynamic time warping concepts is illustrated. The result of the matching is a list of the locations of the matching corpus gesture sequences in the corpus, which in turn may be used for further processing, such as the display of an image of the matching corpus gestures for a system user. The ability to determine the existence and location of a gesture in the corpus that matches a target gesture is the basis for performing a variety of additional functions, such as a "find and replace" function and the ability to use gestures as keywords to index a gesture-based data structure without performing recognition on either the keyword gestures or the gesture-based data structure. The technique is suitable for inclusion in any system that accepts gesture-based data, such as a personal digital assistant (PDA) or other pen-based computing device.
REFERENCES:
patent: Re31200 (1983-04-01), Sukonick et al.
patent: 4718103 (1988-01-01), Shojima et al.
patent: 4731857 (1988-03-01), Tappert
patent: 5062143 (1991-10-01), Schmitt
patent: 5161245 (1992-11-01), Fenwick
patent: 5235651 (1993-08-01), Nafarieh
patent: 5267332 (1993-11-01), Walch et al.
patent: 5321770 (1994-06-01), Huttenlocher et al.
patent: 5329405 (1994-07-01), Hou et al.
patent: 5333209 (1994-07-01), Sinden et al.
patent: 5392363 (1995-02-01), Fujisaki
patent: 5438630 (1995-08-01), Chen et al.
patent: 5463696 (1995-10-01), Beernink et al.
patent: 5528701 (1996-06-01), Aref
James S. Lipscomb, "A Trainable Gesture Recognizer", Pattern Recognition, vol. 24, No. 9, pp. 895-9075, 1991.
Poon, A., Weber, K., Cass, T. "Scribbler: A Tool for Searching Digital Ink," Proceedings of the ACM Conference on Human Factors in Computing Systems, Denver, CO, May 1995 (page numbers unknown); published as a short paper; also available at http://www.acm.org/sigchi/chi95/Electronic/documnts/shortppr/adp.sub.13 bdy.htm.
Lopresti, D. and Tomkins, A., "On the Searchability of Electronic Ink", IWFHR--IV, (The Fourth International Workshop on Frontiers in Handwriting Recognition), Dec. 7-9, 1994, Taipei, Taiwan, Republic of China, pp. 156-165.
Aref, W. and Barbara, D., "The Handwritten Trie: Indexing Electronic Ink", publication source unknown, dated Oct. 28, 1994, pp. 1-25.
D. Lopresti and A. Tompkins, "On the Searchability of Electronic Inc.", Matsushita Information Technology Laboratory Technical Report 114-94, Aug. 19, 1994, available at ftp://mitl.research.panasonic.com/pub/tr/.
D. P. Lopresti and A. Tomkins, Approximate Matching of Hand-Drawn Pictograms. In Proceeding of the Third International Workshop on Frontiers in Handwriting Recognition, May 1993.
D. P. Lopresti and A. Tomkins, Pictographic Naming. In Proceedings of INTER-CHI93, Sep. 1993.
Daniel Barbara, Method to Index Electronic Handwritten Documents, Technical Report MITL-TR-77-93, Matsushita Information Technology Laboratory, Princeton, NJ, Nov. 1993.
D. P. Lopresti and A. Tomkins, "Pictographic Naming," Technical Report No. MITL-TR-21-92, Matsushita Information Technology Laboratory, Princeton, N.J., Aug. 1992.
D. P. Lopresti and A. Tomkins, "A Comparison of Techniques for Graphical Database Queries," Technical Report No. MITL-TR-45-93, Matsushita Information Technology Laboratory, Princeton, N.J., Jan., 1993.
D. P. Lopresti and A. Tomkins, "Applications of Hidden Markov Models to Pen-Based Computing", Technical Report No. MITL-TR-32-92, Matsushita Information Technology Laboratory, Princeton, N.J., Nov., 1992.
J. M. Kurtzberg and C. C. Tappert, "Symbol Recognition System By Elastic Matching," IBM Technical Disclosure Bulletin, vol. 24, No. 6, pp. 2897-2902 Dec. 1992.
The aha|.TM. InkWriter.TM. Handbook, user's manual accompanying software product known as aha|.TM. InkWriter.TM. published by aha|.TM. software corporation, Mountain View, California, Jun. 1993, pp. 1-57.
J. Kruskal and M. Liberman, "The Symmetric Time Warping Problem: From Continuous to Discrete,", Chapter 4 in Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison, D. Sankoff and J. Kruskal, eds., Addison-Wesley Publishing Co., May 1983, at p. 125.
C. Myers, L. Rabiner, and A. Rosenberg, "Performance Tradeoffs in Dynamic Time Warping Algorithms and Isolated Word Recognition," in IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-28, No. 6, Dec., 1980, at pp. 623-634.
H. Sakoe and S. Chiba, "Dynamic Programming Algorithm Optimization for Spoken Word Recognition", in IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-26, No. 1, Feb., 1978, at pp. 43-49.
D. Kurlander and Eric Bier, "Graphical Search and Replace", in SIGGRAPH '88 on Computer Graphics, vol. 22, No. 4, Aug., 1988, at pp. 113-120.
G. M. Miller, "On Line Recognition of Hand Generated Symbols", Fall Joint Computer Conference, 1969, at pp. 399-412.
N. M. Herbst and C. N. Liu, "Automatic Signature Verification", Computer Analysis and Perception, vol. I, Visual Signals, at pp. 83-105, (date of publication unknown).
J. M. Kurtzberg, "Feature Analysis for Symbol Recognition by Elastic Matching", IBM J Res Develop, vol. 31, No. 1, Jan., 1987, at pp. 91-95.
D. J. Burr, "A Technique for Comparing Curves", IEEE PRIP '79 Proceedings, Aug., 1979, at pp. 271-277.
R.W. Christiansen and C. K. Rushforth, "Detecting and Locating Key Words in Continuous Speech Using Linear Predictive Coding", in IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-25, No. 5, Oct., 1977, at pp. 361-367.
D. Rubine, "Specyfing Gestures by Example", in SIGGRAPH '91 on Computer Graphics, vol. 25, No. 4, Jul., 1991, at pp. 329-337.
C.C. Tappert, "Speed, Accuracy, Flexibility Trade Offs in On-Line Character Recognition", in an IBM Research Report, RC 13228 (#59158), Oct., 1987 at pp. 1-20.
Oppenheim and Schafer, "Discrete-Time Signal Processing", Prentice-Hall, 1989, Chapter 2, at pp. 8-67.
Huttenlocher, et al., "Comparing Images Using the Hausdorff Distance", in IEEE Transactions on Pattern Analysis and machine Intelligence, vol. 15, No. 9, Sep., 1993, at pp. 850-863.
Yasuhara, M. and M. Oka, "Signature Verification Experiment Based on Nonlinear Time Alignment: A Feasibility Study", in IEEE Transactions on Systems, Man and Cybernetics, Mar. 1977, pp. 212-216.
Cass Todd A.
Poon Alex D.
Weber Karon Anne
Bares Judith C.
Boudreau Leo
Davis Monica S.
Xerox Corporation
LandOfFree
Searching and Matching unrecognized handwriting does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Searching and Matching unrecognized handwriting, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Searching and Matching unrecognized handwriting will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1235295