Image analysis – Image transformation or preprocessing – Image storage or retrieval
Reexamination Certificate
1998-12-31
2003-07-15
Lee, Thomas D. (Department: 2724)
Image analysis
Image transformation or preprocessing
Image storage or retrieval
C382S232000, C235S494000, C235S487000
Reexamination Certificate
active
06594406
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention relates to user interfaces for computer systems and, more particularly, to image capture user interfaces for such computer systems.
Conventional user interfaces allow users to selectively initiate computer system operations. A computer coordinates an electronic display and a user input device, such as a keyboard. Command line interfaces, for example, require users to type in commands directing the computer to perform a particular operation. Graphical user interfaces relieve users of the burden of typing commands by allowing a graphical selection of computer system entities and computer system operations. For example, when the user uses a mouse to select a file icon on a screen, the computer accesses the file associated with the icon. Graphical user interfaces are particularly advantageous because they are intuitive and therefore easy to use.
Heretofore, conventional graphical user interfaces were configured to permit electronic (X, Y) addressing of graphic elements displayed on a computer I/O device, such as a screen of a computer monitor. The address space accessible at any given time is constrained by the display space. Larger address spaces can be implemented within the constraints of the display, but this requires the user to navigate sequentially through the larger space within the dimensions of the display.
A conventional graphical user interface is also constrained by the requirement that a computer system must coordinate electrical signals from user input devices with the user interface graphics on the display. This limits flexibility because the computer must produce the user interface on the display, and coordinate input received from the input devices.
What is needed, then, is a computer interface that is not constrained by the typical dimensions of an electronic display, and does not require electronic coordination between the display device and the user input device.
SUMMARY OF THE INVENTION
Apparatus and methods consistent with the principles of the invention provide a user interface that utilizes multi-level image capture and context identification. An apparatus consistent with the invention, for use with a user interface having sensory indicia and embedded data code, and an image capture device for selecting a portion of the user interface and sending image information corresponding to the portion, comprises an image processor for decoding first image information into a first image capture code, a resolver for mapping the first image capture code into a first selection code, and a syntax processor for analyzing the first selection code with a second selection code.
A method consistent with the invention, for use with a user interface having sensory indicia and embedded data code, and an image capture device for selecting a portion of the user interface and sending image information corresponding to the portion, comprises decoding first image information into a first image capture code, mapping the first image capture code into a first selection code and analyzing the first selection code with a second selection code.
A graphical user interface consistent with the principles of the invention, for use with a user interface system including a device for capturing a portion of the graphical user interface in response to selection of sensory indicia, and a computer system responsive to embedded code in the portion for performing an operation related to the sensory indicia and a first selection code, comprises sensory indicia, and embedded data codes having a predetermined spatial relationship to the sensory indicia. Other embodiments may also provide methods and apparatus consistent with the invention that are implemented in systems having an image capture device and a computer for processing embedded code.
Human sensory information, such as textual, graphical or mixed textual and graphical representations of the computer system entities and operations may be selected using this user interface. The sensory information is spatially registered in superimposed or juxtaposed relationship with respective spatial addresses in the embedded data address space. These spatial addresses, in turn, are registered in a lookup table or similar mechanism with computer recognizable descriptions of the respective computer system operations or entities.
REFERENCES:
patent: 5315098 (1994-05-01), Tow
patent: 5337361 (1994-08-01), Wang et al.
patent: 5388203 (1995-02-01), Kaneko
patent: 5416312 (1995-05-01), Lamoure
patent: 5761686 (1998-06-01), Bloomberg
patent: 5937110 (1999-08-01), Petrie et al.
patent: 10-187911 (1998-07-01), None
patent: WO 98/35336 (1998-08-01), None
Card, S. K., “The Human, The Computer, The Task, and Their Interaction—Analytic Models and Use-Centered Design,” Mind Matters: A Tribute to Allen Newell, Edited by D. Steier and T. Mitchell, Lawrence Erlbaum Associates, Publishers, 1996, pp. 259-312.
Rekimoto, J., “Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments,” 10thAnnual Symposium on User Interface Software and Technology, UIST 97 Banff, Alberta, Canada, Oct. 14-17, 1997, pp. 31-39.
Rekimoto, J., “A Multiple Device Approach for Supporting Whiteboard-based Interactions,” CHI 98 Los Angeles, CA, Apr. 18-23, 1998, pp. 344-351.
Arai, T., et al., “PaperLink: A Technique for Hyperlinking from Real Paper to Electronic Content,” CHI 97 Electronic Publications: Papers, Mar. 22-27, 1997, pp. 1-13.
Hecht, D., “Embedded Data Glyph Technology for Hardcopy Digital Documents,” SPIE-The International Society for Optical Engineering, vol. 2171, San Jose, CA, Feb. 7-10, 1994, pp. 341-352.
Stifelman, L., “Augmenting Real-World Objects: A Paper-Based Audio Notebook,” In the Proceedings of CHI '96 Conference Companion, ACM, pp. 199-200.
Johnson, W., et al., “Bridging the Paper and Electronic Worlds: The Paper User Interface,” In Proceedings of INTERCHI.ACM, Apr. 1993; Xerox Palo Alto Research Center, Palo Alto, CA, 7 pages.
Wellner, P., “Digital Desk,” Communications of the ACM, Jul. 1993, vol. 36, No. 7, pp. 87-96.
Dymetman, M. and Copperman, M., “Intelligent Paper,” 7thInternational Conference on Electronic Publishing, Mar. 30-Apr. 3, 1998, pp. 392-466.
The Anoto Pen—Technical Description (2 pages) as printed from the Internet, May 16, 2000.
The Anoto Pen—Technical Pattern (2 pages) as printed from the Internet, May 16, 2000.
The Anoto Pen—The Pen (2 pages) as printed from the Internet, May 16, 2000.
The Anoto Pen—The Infrastructure (2 pages) as printed from the Internet, May 16, 2000.
The Anoto Pen—White Paper (4 pages) as printed from the Internet, May 16, 2000.
“Anoto Technology Takes Pen and Paper into the Digital Age” as printed from the Internet, May 16, 2000.
Lee Thomas D.
Xerox Corporation
LandOfFree
Multi-level selection methods and apparatus using context... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Multi-level selection methods and apparatus using context..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Multi-level selection methods and apparatus using context... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3045074