Television – Object tracking
Patent
1998-01-23
1999-12-21
Le, Vu
Television
Object tracking
348 15, 382103, H04N 5225
Patent
active
06005610&
ABSTRACT:
A method for integrated audio-visual localizing and tracking of at least one object. The method includes the steps of capturing and transmitting an image of a video scene using a camera at an instant of time, identifying an object contained in the image having a preselected visual feature, and estimating a location of the object by determining an angular orientation relative to the image plane of the camera of an imaginary line extending from an optical center of the camera to a point on the image plane of the camera representing a portion of the object. The method further includes the steps of converting acoustic waves from an audio source into audio signals using at least two microphones at substantially the same time, identifying the audio source by determining a locus of points representing an estimate of the location of the audio source on the basis of the audio signals. An improved estimate of the location of the object is computed by determining the location of a region of intersection between the imaginary line and the locus.
REFERENCES:
patent: 3906431 (1975-09-01), Clearwaters et al.
patent: 4067015 (1978-01-01), Mogavero et al.
patent: 4857912 (1989-08-01), Everett, Jr. et al.
patent: 5231609 (1993-07-01), Gaer
patent: 5521634 (1996-05-01), McGray
patent: 5737011 (1998-04-01), Lukacs
patent: 5844599 (1998-12-01), Hildin
Tsai, "An Efficinet and Accurate Camera Calibration Technique for 3D Machine Vision", IEEE, pp. 364-374, May 1986.
Kellerman, "A Self-Steering Digital Microphone Array", Acoustic Research Department, AT&T Bell Laboratories, IEEE, pp. 3581-3584, Jul. 1991.
Flanagan et al, "Computer-steered Microphone Arrays for Sound Transduction in Large Room", J. Acoust. Soc. Am., vol. 78, No. 5, pp. 1508-1518, Nov. 1985.
Brandstein et al, "A Closed-Form Method for Finding Source Locations From Microphone-Array Time-Delay Estimates", IEEE, pp. 3019-3022, May 1995.
J. Acoust. Soc. Am., vol. 100, No. 4, Pt. 2, 3rd Joint Meeting: Acoustical Societies of America and Japan, p. 2697, Oct. 1996.
Omologo et al, "Acoustic Event Localization Using a Crosspower-Spectrum Phase Based Technique", IEEE, pp. 11-273 to 11-276, 1994.
Oliver et al, "LAFTER: Lips and Face Real Time Tracker", MIT Media Laboratory, IEEE, pp. 123-129, 1997.
Jebara et al, "Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces", MIT Media Laboratory, IEEE, pp. 144-150, 1997.
Schiele et al, "Gaze Tracking Based on Face-Color", International Workshop on Automatic Face and Gesture Recognition, Carnegie Mellon University, pp. 344-349, 1995.
Akio Shio and Jack Sklansky, "Segmentation of People in Motion", NTT Human Interface Laboratories and Department of Electrical Engineering, University of California, Irvine.
Segen et al, "A Camera-Based System for Tracking People in Real Time", Bell Laboratories, Proc. of ICPR, pp. 63-67, 1996.
J.K. Aggarwal and Q. Cai, "Human motion analysis: A review," in IEEE Nonrigid and Articulated Motion Workshop, pp. 90-102, 1997.
D.R.Fischell and C.R. Coker, "A Speech Direction Finder," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processings,pp. 19.8.1-19.8.4, 1984.
D. Hog, "Model based vision: A program to see a walking person," Image and Vision Computing, 1(1):5-20, 1983.
A. Jacquin and A. Eleftheriadis, "Automatic location tracking of faces and facial features in video sequences" in Proceedings of the International Workshop on Automatic Face and Gesture Recognition, pp. 142-147, 1995.
S. Pingali and J. Segen, "Performance evaluation of people tracking systems," in Third IEEE Workshop on Applications of Computer Vision, 1996.
K. Rohr, "Towards model recognition of human movements in image sequences" Computer Vision Graphics and Image Processing:Image Understanding, 59(1):94-115, Jan. 1994.
J. Segen and S. Pingali, "A camera based system for tracking people in real time," in IAPR International Conference on Pattern Recognition, 1996.
S.M. Smith and J.M. Brady, "Assest-2: Real-Time motion segmentation and shape tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8):814-820, 1995.
Le Vu
Lucent Technologies - Inc.
LandOfFree
Audio-visual object localization and tracking system and method does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Audio-visual object localization and tracking system and method , we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Audio-visual object localization and tracking system and method will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-510049