Television – Camera – system and detail – Unitary image formed by compiling sub-areas of same scene
Reexamination Certificate
2000-04-10
2004-08-17
Christensen, Andrew (Department: 2615)
Television
Camera, system and detail
Unitary image formed by compiling sub-areas of same scene
C348S207990, C348S039000, C348S143000, C382S294000, C345S629000
Reexamination Certificate
active
06778211
ABSTRACT:
TECHNICAL FIELD OF THE INVENTION
The present invention generally relates to processing effects for wide-angle images. More particularly, the present invention relates to special effects processing that provides image portion replacement for wide-angle video images, shifted image portion replacement for wide-angle video images and other special effects for wide-angle video.
BACKGROUND OF THE INVENTION
A goal of imaging technology is to make the observer feel as though he or she is part of an image. U.S Pat. Nos. 5,990,941 and 6,002,430, currently assigned to the assignee of the present application, describe wide-angle image viewing systems and methods. The patents provide full freedom viewing inside of a complete spherical image composed of one or two combined hemispheric images. As a result, there are no bounds on the user's freedom to view in any direction.
U.S. Pat. No. 6,002,430 patent discusses techniques for capturing first and second images, each having a field-of-view of 180 degrees or greater. In one embodiment two cameras are placed in a “back-to-back” arrangement having lenses with a 180 degree or greater field of view (e.g., fisheye lenses). An imaging element or elements capture the images from each lens. The captured images are seamed together to form a single spherical image. Also, U.S. Pat. No. 6,002,430 patent includes a viewing engine that provides a real-time interactive image window that can be directed anywhere in the spherical image. Preferably, a personal computer system runs perspective correction algorithms to create the image window. Other wide-angle viewing systems are known, but known systems generally do not provide special effects for wide-angle video images.
Reber et al., in U.S. Pat. No. 5,706,421, discloses placing an animated character in a wide-angle image. An animated character generator superimposes the animated character onto a perspective corrected image in a spherical wide-angle image. However, the animated character is over-laid on the spherical image, and the Reber et al. does not disclose performing special effects on non-perspective corrected images in wide-angle video images.
Special effects can be used to enhance the quality of video images and a need exists for providing special effects for wide-angle video images.
SUMMARY OF THE INVENTION
An aspect of the present invention is to provide an apparatus and methods that provides special effects for wide-angle video images.
In accordance with the principles of the present invention, a method is provided for capturing wide-angle video that includes a plurality of sequential frames, each frame having at least one wide-angle image, and replacing a portion of at least one of each wide-angle image in at least one of the frames with a replacement image. The step of replacing a portion of at least one of each wide-angle image includes replacing the portion with a portion of a wide-angle image in a second frame captured subsequently to the frame having the replaced portion. The portion of the image in the second frame may have the same shape as the replaced portion and represents an unobstructed view of the surrounding environment. Alternatively, the step of replacing a portion of at least one of each wide-angle image includes replacing the portion with a planar image that is warped to the same curvature of the replaced portion and has the same shape as the replaced portion.
In accordance with the principles of the present invention, an apparatus is provided that includes a wide-angle video image capture device that captures wide-angle video in a plurality of sequential frames, each frame having at least one wide-angle image, and preprocessing circuitry that receives digital wide-angle video images of the at least one wide-angle image in each frame and replaces a selected portion of at least one of each wide-angle image in at least one of said frames with a replacement image. The replacement image includes a selected portion of a wide-angle image in a second frame captured subsequently from the frame having a replaced portion. The selected portion of the replacement image has substantially the same shape as the replaced portion and represents an unobstructed view of the surrounding environment. Alternatively, the replacement image is a planar image warped to the same curvature and having the same shape as the replaced portion.
In accordance with the principles of the present invention, a method and apparatus is provided for performing image-intensity scaling. A wide-angle video image is divided into a plurality of areas. An adaptive threshold, associated with the average image intensity of pixels in each area, is calculated for each area. The intensity of a pixel in at least one of said areas is compared to the adaptive threshold for the area. The pixel intensity is adjusted, when the intensity is not equal to the adaptive threshold.
In accordance with the principles of the present invention, a method and apparatus is provided for detecting and removing flare. Preprocessing circuitry compares the change in intensity of pixels in each row of at least one wide-angle image in each frame to two threshold values to detect flare, and adds pixels in each frame to remove the detected flare.
REFERENCES:
patent: 4549208 (1985-10-01), Kamejima et al.
patent: 4656506 (1987-04-01), Ritchey
patent: 4670648 (1987-06-01), Hall et al.
patent: 4868682 (1989-09-01), Shimizu et al.
patent: 5023725 (1991-06-01), McCutchen
patent: 5130794 (1992-07-01), Ritchey
patent: 5155638 (1992-10-01), Aikawa et al.
patent: 5155683 (1992-10-01), Rahim
patent: 5185667 (1993-02-01), Zimmermann
patent: 5262856 (1993-11-01), Lippman et al.
patent: 5359363 (1994-10-01), Kuban et al.
patent: 5481257 (1996-01-01), Brubaker et al.
patent: 5495576 (1996-02-01), Ritchey
patent: 5497960 (1996-03-01), Previnaire
patent: 5555019 (1996-09-01), Dole
patent: 5579026 (1996-11-01), Tabata
patent: 5596319 (1997-01-01), Spry
patent: 5625489 (1997-04-01), Glenn
patent: 5657073 (1997-08-01), Henley
patent: 5691765 (1997-11-01), Schieltz et al.
patent: 5703604 (1997-12-01), McCutchen
patent: 5706421 (1998-01-01), Reber et al.
patent: 5850471 (1998-12-01), Brett
patent: 5877801 (1999-03-01), Martin et al.
patent: 5894589 (1999-04-01), Reber et al.
patent: 5940126 (1999-08-01), Kimura
patent: 5988818 (1999-11-01), Fujimori et al.
patent: 5990941 (1999-11-01), Jackson et al.
patent: 6002430 (1999-12-01), McCall et al.
patent: 6005611 (1999-12-01), Gullichsen et al.
patent: 6020931 (2000-02-01), Bilbrey et al.
patent: 6147797 (2000-11-01), Lee
patent: 6211913 (2001-04-01), Hansen et al.
patent: 6278461 (2001-08-01), Ellenby et al.
patent: 6315667 (2001-11-01), Steinhart
patent: 6333826 (2001-12-01), Charles
patent: 9108593.4 (1991-11-01), None
patent: 0522204 (1993-01-01), None
patent: 0607050 (1994-07-01), None
patent: 2 661 061 (1990-04-01), None
patent: 2661061 (1991-10-01), None
patent: 2289820 (1995-05-01), None
patent: WO89/03076 (1989-04-01), None
patent: WO94/16406 (1994-07-01), None
patent: WO96/13962 (1996-05-01), None
patent: WO97/01241 (1997-01-01), None
patent: WO 97/01241 (1997-01-01), None
patent: WO98/38590 (1998-09-01), None
patent: WO00/60853 (2000-10-01), None
patent: WO00/60857 (2000-10-01), None
patent: WO00/60869 (2000-10-01), None
patent: WO00/60870 (2000-10-01), None
Tan et al., A Robust Sequential Approach For The Detection of Defective Pixels in An Image Sensor□□□□Mar. 15, 1999; IEEE; Acoustics, Speech, and Signal Processing, 1999. Proceedings., 1999 IEEE□□International Conference on; vol. 4; pp. 2239-2242.*
Office Action dated Mar. 13, 2002 for U.S. application Ser. No. 09/546,331.
Office Action dated Nov. 19, 2002 for U.S. application Ser. No. 09/546,331.
Office Action dated Jun. 19, 2003 for U.S. application Ser. No. 09/546,183.
Gourley Christopher Shannon
Zimmermann Steven Dwain
Frost Brown Todd LLC
IPIX Corp.
Tran Nhan
LandOfFree
Method and apparatus for providing virtual processing... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for providing virtual processing..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for providing virtual processing... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3359838