Image analysis – Applications – Motion or velocity measuring
Reexamination Certificate
1999-08-27
2003-11-11
Patel, Jayanti K. (Department: 2625)
Image analysis
Applications
Motion or velocity measuring
C348S700000, C382S199000, C382S236000
Reexamination Certificate
active
06647131
ABSTRACT:
TECHNICAL FIELD OF THE INVENTION
The present invention relates generally to machine-human interface and in particular the present invention relates to motion detection.
BACKGROUND OF THE INVENTION
An increasing interest in the recognition of human motion and action using computer vision has appeared, with much emphasis on real-time computability. In particular, tracking/surveillance systems, human computer interfaces, and entertainment domains have a heightened interest in understanding and recognizing human movements. For example, monitoring applications may provide a signal only when a person is seen moving in a particular area (perhaps within a dangerous or secure area). Interface systems may be desired which understand gestures as a means of input or control, and entertainment applications may want to analyze the actions of the person to better aid in the immersion or reactivity of the experience.
In prior work, a real-time computer vision representation of human movement known as a Motion History Image (MHI) was presented. The MHI is a compact template representation of movement originally based on the layering of successive image motions. The recognition method presented for these motion templates used a global statistical moment feature vector constructed from image intensities, resulting in a token-based (label-based) matching scheme. Though this recognition method showed promising results using a large database of human movements, no method has yet been proposed to compute the raw motion information directly from the template without the necessity of labeling the entire motion pattern. Raw motion information may be favored for situations when a precisely labeled action is not possible or required. For example, a system may be designed to respond to leftward motion, but may not care if it was a person, hand, or car moving.
For the reasons stated above, and for other reasons stated below which will become apparent to those skilled in the art upon reading and understanding the present specification, there is a need in the art for a computer system for the representation and recognition of motion gestures.
SUMMARY OF THE INVENTION
In one embodiment, a method of detecting motion is provided which comprises obtaining a plurality of images of an object over a predetermined period of time, generating a motion region image of the object from the plurality of images, calculating normal gradients of the motion region image, removing erroneous normal gradients to provide a normal flow image, and identifying movement based on the normal flow image.
In another embodiment, a method of detecting motion is provided which comprises obtaining a plurality of images of an object using a camera. The plurality of images are obtained over a predetermined period of time. The method further comprises generating a motion region image of the object from the plurality of images by isolating the object in the plurality of images from a background, generating a difference image using the plurality of images, wherein the difference image isolates a portion of the object which has changed location during the plurality of images, and setting all pixels of the difference image to an equal value. Normal gradients of the motion region image are calculated, erroneous normal gradients are removed to provide a normal flow image, and movement is identified based on the normal flow image.
REFERENCES:
patent: 4172632 (1979-10-01), Holmes, Jr.
patent: 4937878 (1990-06-01), Lo et al.
patent: 5148477 (1992-09-01), Neely et al.
patent: 5287437 (1994-02-01), Deering
patent: 5327161 (1994-07-01), Logan et al.
patent: 5341142 (1994-08-01), Reis et al.
patent: 5343390 (1994-08-01), Doi et al.
patent: 5394202 (1995-02-01), Deering
patent: 5446834 (1995-08-01), Deering
patent: 5570177 (1996-10-01), Parker et al.
patent: 5751836 (1998-05-01), Wildes et al.
patent: 5790208 (1998-08-01), Kwak et al.
patent: 5798787 (1998-08-01), Yamaguchi et al.
patent: 5801704 (1998-09-01), Oohara et al.
patent: 5802220 (1998-09-01), Black et al.
patent: 5805165 (1998-09-01), Thorne, III et al.
patent: 5805733 (1998-09-01), Wang et al.
patent: 5847755 (1998-12-01), Wixson et al.
patent: 5875040 (1999-02-01), Matraszek et al.
patent: 5878165 (1999-03-01), Ono
patent: 5923776 (1999-07-01), Kamgar-Parsi
patent: 5926568 (1999-07-01), Chaney et al.
patent: 5930379 (1999-07-01), Rehg et al.
patent: 5933523 (1999-08-01), Drisko et al.
patent: 5936610 (1999-08-01), Endo
patent: 5988645 (1999-11-01), Downing
patent: 6009210 (1999-12-01), Kang
patent: 6028960 (2000-02-01), Graf et al.
patent: 6070003 (2000-05-01), Gove et al.
patent: 6097839 (2000-08-01), Liu
patent: 6111517 (2000-08-01), Atick et al.
patent: 6127990 (2000-10-01), Zwern
patent: 6130707 (2000-10-01), Koller et al.
patent: 6192078 (2001-02-01), Komiya et al.
patent: 6211882 (2001-04-01), Pearce et al.
patent: 6269172 (2001-07-01), Rehg et al.
patent: 6317139 (2001-11-01), Williams
patent: 6330523 (2001-12-01), Kacyra et al.
patent: 6400831 (2002-06-01), Lee et al.
patent: 6437820 (2002-08-01), Josefsson
U.S. patent application Ser. No. 09/204,010, filed Dec. 1, 1998, Computer Vision Control Variable Transformation.
U.S. patent application Ser. No. 09/204,007, filed Dec. 1, 1998, Synthesizing Computer Input Events.
U.S. patent application Ser. No. 09/235,139, filed Jan. 22, 1999, Interface Using Pattern Recognition and Tracking.
U.S. patent application Ser. No. 09/079,917, filed May 15, 1998, Method and Apparatus for Tracking an Object Using a Continuously Adapting Mean Shift.
U.S. patent application Ser. No. 09/470,115, filed Dec. 22, 1999, Motion Detection Using Normal Optical Flow.
“Workshop on Perceptual User Interfaces”, The Banff Rocky Mountain Resort, Banff, Alberta, Canada http://research.microsoft.com/PUIWorkshop97/, 1 p., (Oct. 20-21, 1997).
Bradski, G.R., “Computer Vision Face Tracking For Use in a Perceptual User Interface”,Intel Technology Journal Q2, 1-15 p., (1998).
Bradski, G.R., et al., “Computer Vision Modules for Game Interfaces and in Virtual Holography”,Workshop on Perceptual User Interfaces, Banff, Alberta, Canada, pp. 10-13, (Oct. 19-21, 1997).
Cheng, Y., “Mean Shift, Mode Seeking, and Clustering”,IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8), pp. 790-799, (Aug. 1995).
Comaniciu, D., et al., “Robust Analysis of Feature Spaces: Color Image Segmentation”,Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 750-755, (Jun. 17-19, 1997).
Cutler, L.D., et al., “Two-Handed Direct Manipulation on the Responsive Workbench”,Symposium on Interactive 3D Graphics, pp. 107-114 (1997).
Cutler, R., et al., “View-based Interpretation of Real-time Optical Flow for Gesture Recognition”,Proceedings of the International Conference on Automatic Face and Gesture Recognition, pp. 416-421, (1998).
Davis, J.W., et al., “The Representation and Recognition of Human Movement Using Temporal Templates”,Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 928-934, (Jun. 17-19, 1997).
Freeman, W., et al., “Computer Vision for Interactive Computer Graphics”,IEEE Computer Graphics and Applications, pp. 42-53, (May/Jun. 1998).
Freeman, W.T., et al., “Computer Vision for Computer Games”,Proceddings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, VT, pp. 100-105, (Oct. 14-16, 1996).
Fukunaga, K.,Introduction to Statistical Pattern Recognition, 2nd Edition, Academic Press, Inc., Harcourt Brace Jovanovich, Publishers, pp. 1-591, (1990).
Funt, B.V., et al., “Color Constant Color Indexing”,IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(5), pp. 522-529, (May 1995).
Nagao, K., “Recognizing 3D Objects Using Photometric Invariant”,Proceedings of the Fifth International Conference on Computer Vision, Massachusetts Institute of Technology, Cambridge, Massachusetts, pp. 480-487, (Jun. 20-23, 1995).
Parker, J.R.,Algorithms for Image Processing and Computer Vision, John Wiley & Sons,
Intel Corporation
Patel Jayanti K.
Schwegman Lundberg Woessner & Kluth P.A.
LandOfFree
Motion detection using normal optical flow does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Motion detection using normal optical flow, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Motion detection using normal optical flow will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3177032