Image analysis – Color image processing – Pattern recognition or classification using color
Reexamination Certificate
1996-12-31
2001-06-05
Patel, Jay (Department: 2623)
Image analysis
Color image processing
Pattern recognition or classification using color
C345S215000
Reexamination Certificate
active
06243491
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to control of a video system through tracking of a visual pattern. More particularly, the invention relates to methods and apparatus implementing a variety of multicolored props which can be easily tracked by a color recognition system, and whose movements are translatable into control inputs to control the operation of apparatus such as a video game or other video controlled device.
BACKGROUND OF THE INVENTION
A variety of computer and video systems exist today, which employ input devices, such as props. The props are held and manipulated by the user, and carry a color or pattern which is easily tracked by a color recognition system, and whose motion is easily followed by the color recognition system. The motion of the prop is translated into control inputs for a video or computer device. For example, in a video game or virtual reality system, a prop can be wielded by the user, and the motions of the prop can be used to direct motions of a character displayed on a screen. In contrast to wired props, which are expensive and which limit the user's movement, passive props can allow the user to move anywhere within the field of view of a camera which is part of the video system. Also, in contrast to wired, radio frequency (“RF”) or infrared (“IR”) control devices, which are relatively expensive, and which contain a certain amount of electronic circuitry, passive props can be inexpensive to produce, simply being made of plastic or paper with a design printed on the prop. Also, in contrast to the traditional wired joystick, which is a nuisance to attach and remove from the video system or computer, the passive prop is freely interchangeable. The user need merely cast one prop aside and take up another in order to make the change. Also, because of the simplicity and ease of manufacture of the prop, props can be manufactured and offered very inexpensively, enabling the user to afford a whole collection of props.
Various difficulties exist in the present use of passive props. For example, not every prop offers all desirable degrees of freedom. It may be desirable, for example, to allow a prop to be used to control a cursor on a television screen. In such a prop, five degrees of freedom would be desirable. Movement of the prop in the x, y and z directions can control gross movements of the cursor, and adjusting the pitch and yaw of the prop can be used to control fine movements of the cursor.
One difficulty with the use of passive props is the difficulty with disambiguation that occurs in some prop designs. Tracking of a passive prop may be performed through conic solutions. The design of many props results in two similar or identical conic solutions. It is difficult to disambiguate these solutions to accurately track the motion of the prop. A further difficulty is that presently existing props do not provide a sufficient range of control options. Thus, there exists a need in the art for improved passive prop designs which suffer from minimal ambiguity, which provide a convenient and precise method for controlling a cursor, and which provide an increased range of control.
SUMMARY OF THE INVENTION
One embodiment of the present invention is a sphere of a known color and size with a large dot of another color upon it. The x and y position and movement are established from the outline of the spherical surface. The z position and movement are established from the apparent area of the spherical surface. Since the actual size of the sphere is known, it is a simple matter to compare the apparent size of the sphere with the actual size to establish the z position. The pitch and yaw of the sphere are determined from the dot relative to the position of the sphere.
Another embodiment of the present invention is used to increase the ability to disambiguate the potential conic solutions. In this embodiment, the prop consists of a square within a circle. The square is moved off the plane of the circle. This can be done by placing a larger circle and a smaller square parallel to one another along a cylinder. The general shape of the prop can be that of a bowl, or of an inverted bowl, depending on the particular design choice made. A small offset can significantly help address the problem of disambiguation.
Another advantageous prop design in accordance with the present invention is a push-button design. In addition to controlling a video or computer device through the motion of the prop, a push-button would permit the user an additional degree of control by adding an additional binary choice. The addition of a push-button feature can make a passive prop usable in the same way as a computer mouse, for example. The user could use the prop to move a cursor or pointer over a radio button and use the push-button to activate the radio button. Multiple buttons of course could be employed.
To this end, in a further additional embodiment of the present invention, a prop has a pattern that faces the camera of a video system. The user holds a handle or other structure on the back side of the prop. The prop has a hole in the center. The hole is occluded by a non-recognized background color or by a swatch of the surrounding color. The color of the center point is changed when a button is pressed by the user. This color change is recognized by the prop detection of the video system.
A more complete understanding of the present invention, as well as further features and advantages of the invention, will be apparent from the following Detailed Description and the accompanying drawings.
REFERENCES:
patent: 3879876 (1975-04-01), Morgan
patent: 4428252 (1984-01-01), Manini
patent: 4491325 (1985-01-01), Bersheim
patent: 4893182 (1990-01-01), Gautraud et al.
patent: 4982438 (1991-01-01), Usami et al.
patent: 4991223 (1991-02-01), Bradley
patent: 5189711 (1993-02-01), Weiss et al.
patent: 5227985 (1993-07-01), DeMenthon
patent: 5416513 (1995-05-01), Morisaki
patent: 5565891 (1996-10-01), Armstrong
patent: 5629990 (1997-05-01), Tsuji et al.
patent: 5703356 (1997-12-01), Bidiville et al.
patent: 5887073 (1999-03-01), Fazzari et al.
patent: 5889550 (1999-03-01), Reynolds
patent: 5912700 (1999-06-01), Honey et al.
patent: 5960098 (1999-09-01), Tao
patent: 6005959 (1999-12-01), Mohan et al.
Freedman Barry H.
Lucent Technologies - Inc.
Patel Jay
LandOfFree
Methods and apparatus for controlling a video system with... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods and apparatus for controlling a video system with..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods and apparatus for controlling a video system with... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2464593