Automatic video system using multiple cameras

Television – Camera – system and detail – Unitary image formed by compiling sub-areas of same scene

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C348S159000, C348S211110

Reexamination Certificate

active

07015954

ABSTRACT:
A camera array captures plural component images which are combined into a single scene from which “panning” and “zooming” within the scene are performed. In one embodiment, each camera of the array is a fixed digital camera. The images from each camera are warped and blended such that the combined image is seamless with respect to each of the component images. Warping of the digital images is performed via pre-calculated non-dynamic equations that are calculated based on a registration of the camera array. The process of registering each camera in the arrays is performed either manually, by selecting corresponding points or sets of points in two or more images, or automatically, by presenting a source object (laser light source, for example) into a scene being captured by the camera array and registering positions of the source object as it appears in each of the images. The warping equations are calculated based on the registration data and each scene captured by the camera array is warped and combined using the same equations determined therefrom. A scene captured by the camera array is zoomed, or selectively steered to an area of interest. This zooming- or steering, being done in the digital domain is performed nearly instantaneously when compared to cameras with mechanical zoom and steering functions.

REFERENCES:
patent: 4393394 (1983-07-01), McCoy
patent: 4395093 (1983-07-01), Rosendahl
patent: 4484801 (1984-11-01), Cox
patent: 4558462 (1985-12-01), Horiba
patent: 4583117 (1986-04-01), Lipton
patent: 4707735 (1987-11-01), Busby
patent: 4745479 (1988-05-01), Waehner
patent: 4772942 (1988-09-01), Tuck
patent: 4819064 (1989-04-01), Diner
patent: 4862388 (1989-08-01), Bunker
patent: 4868682 (1989-09-01), Shimizu et al.
patent: 4947260 (1990-08-01), Reed
patent: 4974073 (1990-11-01), Inova
patent: 4985762 (1991-01-01), Smith
patent: 5023720 (1991-06-01), Jardins
patent: 5023725 (1991-06-01), McCutchen
patent: 5040055 (1991-08-01), Smith
patent: 5068650 (1991-11-01), Fernandez
patent: 5083389 (1992-01-01), Alperin
patent: 5115266 (1992-05-01), Troje
patent: 5130794 (1992-07-01), Ritchey
patent: 5140647 (1992-08-01), Ise
patent: 5142357 (1992-08-01), Lipton
patent: 5153716 (1992-10-01), Smith
patent: 5170182 (1992-12-01), Olson et al.
patent: 5175616 (1992-12-01), Milgram
patent: 5185667 (1993-02-01), Zimmerman
patent: 5187571 (1993-02-01), Braun et al.
patent: 5231673 (1993-07-01), Elenga
patent: 5258837 (1993-11-01), Gormley
patent: 5291334 (1994-03-01), Wirth
patent: 5302964 (1994-04-01), Lewins
patent: 5369450 (1994-11-01), Haseltine
patent: 5424773 (1995-06-01), Saito
patent: 5444478 (1995-08-01), Lelong
patent: 5465128 (1995-11-01), Wah Lo
patent: 5465163 (1995-11-01), Yoshihara
patent: 5469274 (1995-11-01), Iwasaki
patent: 5499110 (1996-03-01), Hosogai
patent: 5502309 (1996-03-01), Davis
patent: 5508734 (1996-04-01), Baker
patent: 5510830 (1996-04-01), Ohia
patent: 5539483 (1996-07-01), Nalwa
patent: 5548409 (1996-08-01), Ohta
patent: 5563650 (1996-10-01), Poelstra
patent: 5602584 (1997-02-01), Mitsutake
patent: 5608543 (1997-03-01), Tamagaki
patent: 5611033 (1997-03-01), Pitteloud
patent: 5619255 (1997-04-01), Booth
patent: 5625462 (1997-04-01), Ohta
patent: 5646679 (1997-07-01), Yano
patent: 5649032 (1997-07-01), Burt et al.
patent: 5650814 (1997-07-01), Florent
patent: 5657073 (1997-08-01), Henley
patent: 5657402 (1997-08-01), Bender
patent: 5666459 (1997-09-01), Ohta
patent: 5668595 (1997-09-01), Katayama
patent: 5680150 (1997-10-01), Shimizu
patent: 5682198 (1997-10-01), Katayama
patent: 5689611 (1997-11-01), Ohta
patent: 5691765 (1997-11-01), Schieltz
patent: 5699108 (1997-12-01), Katayama
patent: 5703604 (1997-12-01), McCutchen
patent: 5721585 (1998-02-01), Keast
patent: 5745305 (1998-04-01), Nalwa
patent: 5760826 (1998-06-01), Nayar
patent: 5768443 (1998-06-01), Michael et al.
patent: 5790181 (1998-08-01), Chahl
patent: 5812704 (1998-09-01), Pearson
patent: 5838837 (1998-11-01), Hirosawa
patent: 5841589 (1998-11-01), Davis
patent: 5848197 (1998-12-01), Ebihara
patent: 5870135 (1999-02-01), Glatt
patent: 5903303 (1999-05-01), Fukushima
patent: 5920376 (1999-07-01), Bruckstein
patent: 5920657 (1999-07-01), Bender
patent: 5940641 (1999-08-01), McIntyre
patent: 5956418 (1999-09-01), Aiger et al.
patent: 5966177 (1999-10-01), Harding
patent: 5973726 (1999-10-01), Iijima
patent: 5978143 (1999-11-01), Spruck
patent: 5982452 (1999-11-01), Gregson
patent: 5982941 (1999-11-01), Loveridge
patent: 5982951 (1999-11-01), Katayama
patent: 5987164 (1999-11-01), Szeliski
patent: 5990934 (1999-11-01), Nalwa
patent: 5990941 (1999-11-01), Jackson
patent: 6002430 (1999-12-01), McCall
patent: 6005987 (1999-12-01), Nakamura
patent: 6009190 (1999-12-01), Szeliski
patent: 6011558 (2000-01-01), Hsieh
patent: 6028719 (2000-02-01), Beckstead
patent: 6040852 (2000-03-01), Stuettler
patent: 6043837 (2000-03-01), Driscoll
patent: 6044181 (2000-03-01), Szeliski et al.
patent: 6064760 (2000-05-01), Brown
patent: 6078701 (2000-06-01), Hsu et al.
patent: 6097430 (2000-08-01), Komiya
patent: 6097854 (2000-08-01), Szeliski
patent: 6111702 (2000-08-01), Nalwa
patent: 6115176 (2000-09-01), Nalwa
patent: 6118474 (2000-09-01), Nayar
patent: 6128416 (2000-10-01), Oura
patent: 6144501 (2000-11-01), Nalwa
patent: 6148118 (2000-11-01), Murakami
patent: 6173087 (2001-01-01), Kumar et al.
patent: 6175454 (2001-01-01), Hoogland
patent: 6188800 (2001-02-01), Okitsu
patent: 6195204 (2001-02-01), Nalwa
patent: 6211911 (2001-04-01), Komiya
patent: 6215914 (2001-04-01), Nakamura
patent: 6452628 (2002-09-01), Kato
patent: 6526095 (2003-02-01), Nakaya et al.
De Silva, L.D., K. Aizawa and M. Hatori, “Use of Steerable Viewing Window (SVW) to Improve the Visual Sensation in Face to Face Teleconferencing,” inProc. ICASSP-94, vol. 6, pp. 421-424, May 1994.
Elko, Gary and Anh-Tho Nguyen Pong, “A Steerable amd Variable First-Order Differential Microphone Array,” inProc. ICASSP 97.
Huang, Q., et al., “Content Based Active Video Data Acquisition Via Automated Cameramen,”Proc. ICIP, Jan. 1998.
IPLX, the Interactive Pictures Corporation, www.ipix.com.
Majumder, Aditi, et al., “Immersive Teleconferencing: A New Algorithm to Generate Seamless Panoramic Video Imagery,” in Proc. ACM Multimedia, Oct. 1999.
Mann, S. and R.W. Picard, “Video Orbits of the Projective Group: A New Perspective on Image Mosaicing,” MIT Media Lab, Technical Report 338.
Shum, H.Y. and R. Szeliski, “Panoramic Image Mosaicing,” Technical Report MSR-TR-97-23, Microsoft Research, Sep. 1997. (www.research.microsoft.com/scripts/pubdb/trpub.asp).
Swaminathan, Rahul and Shree K. Nayar, “Non-Metric Calibration of Wide-Angle Lenses and Polycameras,” in Proc. CVPR, 1999, IEEE.
Taniguchi, Y., A. Akutsu and Y. Tonomura, “PanoramaExcerpts: Extracting and Packing Panoramas for Video Browsing,” inProc. ACM Multimedia 97,Seattle, WA, pp. 427-436, 1997.
Teodosio, L. and W. Bender, “Salient Video Stills: Content and Context Preserved,” inProc. ACM Multimedia 93,Anaheim, CA, pp. 39-46, 1993.
Wang, C. and M. Brandstein, “A Hybrid Real-Time Face Tracking System” inProc. ICASSP '98.
Wolberg, G., “Digital Image Warping,”IEEE Computer Society Press, 1992.
Wren, C., A. Azarbayejani, T. Darrell and A. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” inIEEE Transactions on Pattern Analysis and Machine Intelligence,Jul. 1997, vol. 19, No. 7, pp. 780-785.
Bennett, F. and Hopper, A., “Developments in Networked Multimedia,” May 1995.
Chen, S. and Williams, L., “View Interpolation for Image Synthesis,” Apple Computer, Inc. 7 pages. There is no publication date.
Mann, S., “Compositing Multiple Pictures of the Same Scene,”Proc. 46thAnnual Imaging Science and Technology Conference, Cambridge, Massachusetts, May 1993.
“OmniSight™ Solutions for Natural Meetings™: Technical Specifications for Typical System.”
Operating Instru

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Automatic video system using multiple cameras does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Automatic video system using multiple cameras, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Automatic video system using multiple cameras will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-3532640

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.