Computer graphics processing and selective visual display system – Display peripheral interface input device
Reexamination Certificate
1998-06-24
2003-06-03
Shankar, Vijay (Department: 2678)
Computer graphics processing and selective visual display system
Display peripheral interface input device
C345S157000, C345S158000, C345S215000, C702S150000
Reexamination Certificate
active
06573883
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to data input to devices and, more particularly, to finger-free operation of electronic devices.
BACKGROUND OF THE INVENTION
Advances in electronics technology are leading to ever-smaller device designs with an ever-increasing variety of applications. Many “computing” devices, including handheld computers, Personal Digital Assistants (“PDA”), pagers and cellular phones, are now small enough to be easily carried or even wom.
Highly miniaturized computing devices, such as handheld computers and PDAs, have significant operational limitations as a consequence of their small size. In particular, the computer-human interface is highly constrained: the small size greatly restricts possible methods for data input. Traditional desktop computer-human interfaces, those that rely on keyboards and pointing devices, translate poorly to very small devices. Typically, PDAs lack a keyboard. Some handheld computer designs attempt to mimic desktop computer designs, however, only a miniature keyboard can be included.
In response to this problem, these computing devices generally provide for data input through a stylus and/or a limited number of buttons. Other miniature portable devices, such as pagers and cellular phones, typically rely on buttons for command input.
Because of the ease and familiarity of the graphical user interface (“GUI”) typically employed in the display of data in modern computers, for some applications it is desirable to maintain some features of a GUI in a miniature, computing device. The typical GUI relies on the computer user's input of a few command types, submitted via a pointing device and button clicks, to generate a response in the GUI. For example, pointing at a scroll bar and clicking can cause scrolling through a document or list; items in the list or in a graphical display can be selected by again pointing and clicking; and an item, such as an Internet address or a program, can be activated by pointing and double-clicking. As noted, however, command submission to the GUI in a miniature device cannot be accomplished with a “mouse” point and click approach.
Newer approaches to the computer-human command submission interface have the goal of improving the interface for computers of all sizes. One approach is to employ tilt and/or translation sensors to achieve an alternate means of data input. In “Inertial Proprioceptive Devices: Self-Motion-Sensing Toys and Tools” by C. Verplaetse, IBM Systems Journal, Vol. 35, pg. 639 (1996), the author describes devices that are able to sense and react to their own position and orientation through use of embedded inertial motion sensors. The author further describes commercially available accelerometers and gyroscopes for use as inertial motion sensors in portable computing devices.
An implementation of the position and orientation sensing approach to data input is described in “Design of Spatially Aware Graspable Displays”, by David Small and Hiroshi Ishii, CHI 97, pg. 367. The authors describe a large handheld or table positioned device that can be used to read a “newspaper” or other written document. Tilting of the device, in an intuitive manner, provides input commands for scrolling up or down, and left or right through the document: the graphical display responds to the angular orientation of the device. Translating the device closer to or further from the body of the user controls zooming of the document, in effect, scrolling in a third dimension. A button provides a “clutch” to lock and unlock the response of the display to user commands.
A much smaller prototype handheld device that also makes use of tilt for data input is described in “Tilting Operations for Small Screen Interfaces (Tech Note)” by Jun Rekimoto, UIST '96, pg. 167 (1996). This device employs a combination of: 1) tilting for input of scrolling commands to move through text or an image; and 2) button pushing for input of activating commands for navigation through the display of text or to view a portion of an image in greater detail.
The above described prototype data input methods still have the problem of requiring use of fingers for some types of command input, typically via buttons or a stylus. What is desired is a method for completely finger-free data input.
SUMMARY OF THE INVENTION
A method is provided for controlling a handheld computing device through the use of gesture commands. A gesture command corresponds to a pattern of movement of the handheld device that is measured as a function of time F(t), where t
s
is a start time and tf is a finish time such that the interval of time is t
f
minus t
s
. The gesture command further corresponds to angular orientations of the handheld device.
The method comprises the steps of: measuring movement of the device over an interval of time with a motion sensor mounted to the device, the measuring producing a signal; analyzing the signal measured over the interval of time to determine a gesture command that corresponds to the movement of the device; and processing the gesture command to control the handheld computing device. To enable use of different gesture commands, the method includes a comparison of the signal to a catalog of gesture commands to determine a particular gesture command.
A great range of gesture commands is possible given the use of different axes and angular directions of rotation for a variety of different patterns of movement. Use of gesture commands can be combined with use of position commands to further extend the range of commands available for control of a computing device. In this manner, a computing device can be controlled without the use of buttons for command input.
REFERENCES:
patent: 4988981 (1991-01-01), Zimmerman et al.
patent: 5047952 (1991-09-01), Kramer et al.
patent: 5305181 (1994-04-01), Schultz
patent: 5316017 (1994-05-01), Edwards et al.
patent: 5416730 (1995-05-01), Lookofsky
patent: 5453758 (1995-09-01), Sato
patent: 5454043 (1995-09-01), Freeman
patent: 5587577 (1996-12-01), Schultz
patent: 5602566 (1997-02-01), Motosyuku et al.
patent: 5757360 (1998-05-01), Nitta et al.
patent: 5813406 (1998-09-01), Kramer et al.
patent: 5844824 (1998-12-01), Newman et al.
patent: 5880411 (1999-03-01), Gillespsie et al.
patent: 5900863 (1999-05-01), Numazaki
patent: 5990865 (1999-11-01), Gard
patent: 6127990 (2000-10-01), Zwern
patent: 6347290 (2002-02-01), Bartlett
Rekimoto; “Tilting Operations for Small Screen Interfaces” Sony Computer Science Laboratory Inc.; pp. 167-168; 1996.
Small et al.; “Graspable Interface Design” MIT Media Laboratory; pp. 1-8.
Rekimoto et al. “The World through the Computer: Computer Augmented Interaction with Real World Environments”, http://www.csl.sony.co.jp/person/{rekimoto,nagao}.html, pp 29-36 pulled Nov. 14-17, 1995.
C. Verplaetse, “Inertial proprioceptive devices; Self-motion-sensing toys and tools” IBM Systems Journal, vol. 35, NOS3&4, pp 639-650, 1996.
Hewlett -Packard Development Company, L.P.
Pennie & Edmonds LLP
Shankar Vijay
LandOfFree
Method and apparatus for controlling a computing device with... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for controlling a computing device with..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for controlling a computing device with... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3094509