Spatial recognition and grouping of text and graphics

Details Spatial recognition and grouping of text and graphics Spatial recognition and grouping of text and graphics

2004-08-26

2010-06-01

Mehta, Bhavesh M (Department: 2624)

Image analysis

Pattern recognition

C382S186000, C382S187000

Reexamination Certificate

active

07729538

ABSTRACT:
The present invention leverages spatial relationships to provide a systematic means to recognize text and/or graphics. This allows augmentation of a sketched shape with its symbolic meaning, enabling numerous features including smart editing, beautification, and interactive simulation of visual languages. The spatial recognition method obtains a search-based optimization over a large space of possible groupings from simultaneously grouped and recognized sketched shapes. The optimization utilizes a classifier that assigns a class label to a collection of strokes. The overall grouping optimization assumes the properties of the classifier so that if the classifier is scale and rotation invariant the optimization will be as well. Instances of the present invention employ a variant of AdaBoost to facilitate in recognizing/classifying symbols. Instances of the present invention employ dynamic programming and/or A-star search to perform optimization. The present invention applies to both hand-sketched shapes and printed handwritten text, and even heterogeneous mixtures of the two.

REFERENCES:
patent: 3701095 (1972-10-01), Yamaguchi et al.
patent: 4955066 (1990-09-01), Notenboom
patent: 5109433 (1992-04-01), Notenboom
patent: 5181255 (1993-01-01), Bloomberg
patent: 5237628 (1993-08-01), Levitan
patent: 5297216 (1994-03-01), Sklarew
patent: 5465353 (1995-11-01), Hull et al.
patent: 5499294 (1996-03-01), Friedman
patent: 5526444 (1996-06-01), Kopec et al.
patent: 5542006 (1996-07-01), Shustorovich et al.
patent: 5594809 (1997-01-01), Kopec et al.
patent: 5699244 (1997-12-01), Clark et al.
patent: 5812698 (1998-09-01), Platt et al.
patent: 5832474 (1998-11-01), Lopresti et al.
patent: 5867597 (1999-02-01), Peairs et al.
patent: 5999653 (1999-12-01), Rucklidge et al.
patent: 6137908 (2000-10-01), Rhee
patent: 6233353 (2001-05-01), Danisewicz
patent: 6279014 (2001-08-01), Schilit et al.
patent: 6356922 (2002-03-01), Schilit et al.
patent: 6393395 (2002-05-01), Guha et al.
patent: 6397212 (2002-05-01), Biffar
patent: 6470094 (2002-10-01), Lienhart et al.
patent: 6487301 (2002-11-01), Zhao
patent: 6523134 (2003-02-01), Korenshtein
patent: 6546385 (2003-04-01), Mao et al.
patent: 6580806 (2003-06-01), Sato
patent: 6587217 (2003-07-01), Lahey et al.
patent: 6594393 (2003-07-01), Minka et al.
patent: 6658623 (2003-12-01), Schilit et al.
patent: 6687876 (2004-02-01), Schilit et al.
patent: 6869023 (2005-03-01), Hawes
patent: 6928548 (2005-08-01), Hale et al.
patent: 6938203 (2005-08-01), Dimarco et al.
patent: 7010751 (2006-03-01), Shneiderman
patent: 7024054 (2006-04-01), Cahill et al.
patent: 7062497 (2006-06-01), Hamburg et al.
patent: 7111230 (2006-09-01), Euchner et al.
patent: 7120299 (2006-10-01), Keskar et al.
patent: 7327883 (2008-02-01), Polonowski
patent: 7373291 (2008-05-01), Garst
patent: 2002/0032698 (2002-03-01), Cox
patent: 2002/0078088 (2002-06-01), Kuruoglu et al.
patent: 2002/0116379 (2002-08-01), Lee et al.
patent: 2003/0076537 (2003-04-01), Brown
patent: 2003/0123733 (2003-07-01), Keskar et al.
patent: 2003/0152293 (2003-08-01), Bresler et al.
patent: 2004/0003261 (2004-01-01), Hayashi
patent: 2004/0015697 (2004-01-01), de Queiroz
patent: 2004/0078757 (2004-04-01), Golovchinsky et al.
patent: 2004/0090439 (2004-05-01), Dillner
patent: 2004/0107348 (2004-06-01), Iwamura
patent: 2004/0189667 (2004-09-01), Beda et al.
patent: 2004/0205542 (2004-10-01), Bargeron et al.
patent: 2004/0205545 (2004-10-01), Bargeron et al.
patent: 2004/0252888 (2004-12-01), Bargeron et al.
patent: 2005/0138541 (2005-06-01), Euchner et al.
patent: 2005/0165747 (2005-07-01), Bargeron et al.
patent: 2006/0045337 (2006-03-01), Shilman et al.
patent: 2006/0050969 (2006-03-01), Shilman et al.
“Neural Learning using AdaBoost,” Yi Murphey, Zhiltang Chen, Hong Guo.
S. Marinai, et al., “Recognizing Freeform Digital Ink Annotations” Proceedings of the 6th International Workshop on Document Analysis Systems, 2004, vol. 2163, pp. 322-331.
G. Golovchinsky, et al., “Moving Markup: Repositioning Freeform Annotation” UIST 02. Proceedings of the 15th Annual ACM Symposium on user Interface Software and Technology, 2002, vol. conf. 15, pp. 21-29.
European Search Report dated Dec. 29, 2006, mailed for European Patent Application Serial No. 05 108 068.7, 2 Pages.
Michael Shilman, et al., Spatial Recognition And Grouping Of Text And Graphics, Eurographics Workshop On Sketch-Based Interfaces And Modeling, 2004.
Michael Shilman, et al., Recognition And Grouping Of Handwritten Text In Diagrams And Equations, IWFHR 2004, Sep. 2004, Toyko, Japan.
U.S. Appl. No. 11/095,393, Bargeron, et al.
U.S. Appl. No. 11/165,070, David Bargeron.
U.S. Appl. No. 11/171,064, David Bargeron.
European Search Report dated Feb. 1, 2006 for European Patent Application No. EP05000750. 7 pages.
J.J. Hull. “Document Image Matching and Retrieval with Multiple Distortion-Invariant Descriptors”. Document Analysis Systems, World Scientific Publishing Co. 1995. pp. 379-396, Retrieved from the intemet: http://rii.richoh.com/{hull/pubs/hull—das94.pdf>. Retrieved on Dec. 6, 2005.
J.J. Hull, et al. “Document Image Matching Techniques”. Symposium on Document Image Understanding Technology, Apr. 30, 1997, pp. 31-35.
Wang Shin-Ywan, et al. “Block selection: a method for segmenting a page image of various editing styles.” Document Analysis and Recognition, 1995. Proceedings of the Third International Conference on Montreal, Quebec, Canada. Aug. 14-16, 1995. pp. 128-133. Los Alamitos, CA, USA, IEEE Computer Soc., US, vol. 1.
V. Eglin, et al. “Document page similarity based on layout visual saliency: application to query by example and document classification”. Document Analysis and Recognition, 2003. Proceedings of the 7th International Conference. Aug. 3-6, 2003. Piscataway, NJ. IEEE, Aug. 3, 2003, pp. 1208-1212.
C.L. Tan, et al. “Text extraction using pyramid.” Pattern Recognition, Jan. 1998, pp. 63-72, vol. 1, No. 1, Elsevier, Kidlington, GB.
H. Peng, et al. “Document image template matching based on component block list”. Pattern Recognition Letters, Jul. 2001, pp. 1033-1042, vol. 22, No. 9, North-Holland Publ. Amsterdam, NL.
D. Doermann. “The Index and Retrieval of Document Images: A Survey”. Computer Vision and Image Understanding, Jun. 1998, pp. 287-298, vol. 70, No. 3, Academic Press, San Diego, CA, US.
D. Doermann, et al. “The detection of duplicates in document image databases.” Proceedings of the 4th International Conference on Document Analysis and Recognition. Ulm, Germany, Aug. 18-20, 1997, pp. 314-318, Proceedings of the ICDAR, Los Alamitos, IEEE Comp. Soc. US, vol. II.
S. Mitaim, et al. “Neutral fuzzy agents that learn a user's preference map”. Digital Libraries, 199. ADL '97. Proceedings, IEEE International Forum on Research and Technology Advances in Washington, D.C. , US May 7-9, 1997, Los Alamitos, IEEE Comp. Soc. US, May 7, 1997, pp. 25-35.
B. Erol, et al. “Institute of Electrical and Electronics Engineers: Linking presentation documents using image analysis”. Conference Record of the 37th Asilomar Conference on Signals, Systems, & Computers. Pacific Grove, CA, US, Nov. 9-12, 2003. p. 97-101. Asilomar Conference on Signals, Systems and Computers, New York, NY, IEEE, vol. 1 of 2.
Benolin Jose, et al. “Vector Based Image Matching for Indexing in Case Based Reasoning Systems”. 4th German Workshop on Case-based Reasoning-System Development and Evaluation, 1996, pp. 1#7.
R. Hauck. Partial European Search Report. Apr. 15, 2005. 2 pages. Munich, Germany.
Tung-Shou Chen, et al., “A New Search Engine for Chinese Document Image Retrieval Based on Chinese Character Segmentation Features”. International Journal of Computer Processing of Oriental Languages, 2002, pp. 417-431. vol. 14, No. 4.
Jonathan J. Hull, et al., “Document Image Similarity and Equivalence Detection”. ICDAR'97, 1997, pp. 308-312, vol. 1, Ulm, Germany

Affiliated with

Also associated with

Rating

Spatial recognition and grouping of text and graphics does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Spatial recognition and grouping of text and graphics, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Spatial recognition and grouping of text and graphics will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4218908