Image analysis – Applications
Reexamination Certificate
2008-05-15
2011-12-06
Johns, Andrew W. (Department: 2624)
Image analysis
Applications
C382S154000, C345S419000, C345S630000
Reexamination Certificate
active
08073190
ABSTRACT:
3d textured objects are provided for virtual viewpoint animations. In one aspect, an image of an event is obtained from a camera and an object in the image is automatically detected. For example, the event may be a sports event and the object may be a stationary object which is detected based on a known location, color and shape. A 3d model of the object is combined with a textured 3d model of the event to depict a virtual viewpoint which differs from a viewpoint of the camera. The textured 3d model of the event has texture applied from an image of the event, while the 3d model of the object does not have such texture applied, in one approach. In another aspect, an object in the image such as a participant in a sporting event is represented in the virtual viewpoint by a textured 3d kinematics model.
REFERENCES:
patent: 3069654 (1962-12-01), Hough
patent: 4956706 (1990-09-01), Ohba
patent: 5850352 (1998-12-01), Moezzi et al.
patent: 5912700 (1999-06-01), Honey et al.
patent: 6124862 (2000-09-01), Boyken et al.
patent: 6133946 (2000-10-01), Cavallaro et al.
patent: 6380933 (2002-04-01), Sharir et al.
patent: 6671390 (2003-12-01), Barbour et al.
patent: 6795567 (2004-09-01), Cham et al.
patent: 7099494 (2006-08-01), Park et al.
patent: 7194110 (2007-03-01), Qian
patent: 7230653 (2007-06-01), Overton et al.
patent: 7283901 (2007-10-01), Luo et al.
patent: 7289648 (2007-10-01), Liu
patent: 2002/0158873 (2002-10-01), Williamson
patent: 2005/0018045 (2005-01-01), Thomas et al.
patent: 2006/0028476 (2006-02-01), Sobel
patent: 2007/0052712 (2007-03-01), Saito et al.
patent: 2007/0104351 (2007-05-01), Yang et al.
patent: 2008/0049123 (2008-02-01), Gloudemans et al.
patent: 2009/0128577 (2009-05-01), Gloudemans et al.
patent: 2009/0128667 (2009-05-01), Gloudemans et al.
N. Ahmed et al., “Automatic Generation of Personalized Human Avatars from Multi-view Video,” Proceedings of the ACM symposium on Virtual reality software and technology, 2005, p. 257-260, Monterey, California.
G. Bradski et al., “Learning-Based Computer Vision with Intel's Open Source Computer Vision Library,” Intel Corporation Journal, vol. 09, Issue 02, Published May 19, 2005, pp. 119-130.
Hoiem et al., “Automatic Photo Pop-up,” ACM SIGGRAPH 2005, Int. Conf. on Computer Graphics and Interactive Techniques, 2005.
A. Criminisi, “Single-View Metrology: Algorithms and Applications,” DAGM—Symposium 2002, The German Association for Pattern Recognition, pp. 224-239, 2002, Zurich, Switzerland.
C. Frueh et al., “Automated Texture Mapping of 3D City Models With Oblique Aerial Imagery,” Proc. 2nd Int. Symp. on 3D Data Processing, Visualization and Transmission, 3DPVT 2004, Sep. 2004, pp. 396-403.
O. Grau et al., “Use of 3-D Techniques for Virtual Production,” BBC Research & Development White Paper WHP 033, Jul. 2002.
D. Hoiem et al., “Geometric Context From a Single Image,” 10th IEEE Int. Conf. on Computer Vision, Oct. 2005.
IBC2006 Innovation Awards, “The Piero Sports Graphics Project,” BBC Research and Development and Red Bee Media, printed from http://www.ibc.org/cgi-bin/displaypage.cgi?pageref=2053 on Jun. 13, 2007.
C.S. Lee et al., “Carrying Object Detection Using Pose Preserving Dynamic Shape Models,” Conf. on Articulated Motion and Deformable Objects (AMDO) 2006, pp. 315-325.
C. Malerczyk et al., “3D Reconstruction of Sports Events for Digital TV,” Journal of WSCG (Winter School on Computer Graphics), vol. 11, No. 1, Feb. 3-7, 2003, Plzen, Czech Republic.
Press Release, Orad Hi-Tec Systems Ltd., “Orad unveils 3DReplay, its revolutionary HD/SD soccer analysis system at NAB 2007,” printed from http://www.orad.co.il/en/page.asp?id=188 on Jun. 13, 2007.
F. Remondino et al., “Human Motion Reconstruction and Animation from Video Sequences,” 17th Int. Conf. on Computer Animation and Social Agents (CASA2004), pp. 347-354. Computer Graphics Society (CGS), Geneva, Switzerland, Jul. 7-9, 2004.
RedBee Design Systems, “Virtual Graphics and Sport Analysis (Piero),” printed from http://www.redbeemedia.com/designsystems
ew—product.shtmls, Nov. 8, 2007.
BBC Research, “Projects: Piero,” printed from http://www.bbc.co.uk/rd/projects/virtual/piero/index.shtml on Jun. 13, 2007.
A. Soh, et al., “Texture Mapping of 3D Human Face for Virtual Reality Environments,” Int. J. of Information Technology vol. 8, No. 2, Sep. 2002.
M. Uriol, “Video-Based Avatar Reconstruction and Motion Capture,” University of California, Irvine, Dissertation, 2005.
W.S. Lee et al., “Generating Animatable 3D Virtual Humans From Photographs,” Proc. Eurographics 2000, vol. 19, No. 3, pp. 1-10, Aug. 2000.
Zheng et al., “Interactive Human Motion Acquisition from Video Sequences,” Proc. Computer Graphics Int., Geneva, Switzerland, Jun. 2000.
T. Bebie et al., “SoccerMan—Reconstructing Soccer Games from Video Sequences,” Proceedings of the 1998 Int. Conf. on Image Processing, vol. 1, pp. 898-902, Oct. 1998.
“Peiro, Putting a new perspective on sport,” printed from http://www.redbeemedia.com/piero/index.shtml on Jun. 13, 2007.
“Single view modeling,” Univ. of Washington, printed from http://grail.cs.washington.edu/projects/svm/ on Jun. 13, 2007.
R. Tsai, “A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses”, IEEE Journal of Robotics and Automation, vol. RA-3, No. 4, Aug. 1987, pp. 323-344.
E. Trucco et al., “Introductory techniques for 3-D computer vision,” chapter 6, Prentice Hall, 1998.
T. Bebie et al., “A Video-Based 3D-Reconstruction of Soccer Games,” Computer Graphics Forum 19(3), p. 391-400 (2000).
U.S. Appl. No. 12/121,665, filed May 15, 2008, titled “User Interface For Accessing Virtual Viewpoint Animations,”.
U.S. Appl. No. 12/121,660, filed May 15, 2008, titled “Image Repair Interface for Providing Virtual Viewpoints,”.
U.S. Appl. No. 12/121,696, filed May 15, 2008, titled “Virtual Viewpoint Animation,”.
U.S. Appl. No. 12/121,699, filed May 15, 2008, titled “Fading Techniques For Virtual Viewpoint Animations,”.
U.S. Appl. No. 12/121,701, filed May 15, 2008, titled “Updating Background Texture for Virtual Viewpoint Animations,”.
U.S. Appl. No. 12/121,650, filed May 15, 2008, titled “Line Removal and Object Detection in an Image,”.
Yoshinari Kameda, Free Viewpoint Browsing of Live Soccer Games, IEEE International Conference on Multimedia and Expo (ICME 2004), Jun. 27, 2004, pp. 747-750, vol. 1.
Kongwah Wan, Real-Time Goal-Mouth Detection in MPEG Soccer Video, Proceedings of the Eleventh ACM International Conference on Multimedia, Nov. 2, 2003, pp. 311-314, Berkley, CA, USA.
Qing Tang, Classification of Frames from Broadcasted Soccer Video and Applications, Advances in Multimedia Information Processing—PCM, Oct. 29, 2004, pp. 281-288, Springer-Verlag Berlin Heidelberg.
Jinjun Wang, Event Detection Based on Non-Broadcast Sports Video, International Conference on Image Processing (ICIP 2004), Oct. 24, 2004, pp. 1637-1640, Singapore.
International Search Report dated Mar. 25, 2009 in PCT Application No. PCT/US2008/083427.
Written Opinion of the International Searching Authority dated Mar. 25, 2009 in PCT Application No. PCT/US2008/083427.
Notification of International Preliminary Report on Patentability and the Written Opinion of the International Searching Authority dated May 27, 2010 in PCT Application No. PCT/US2008/083427.
Gloudemans James R.
Hsiao Walter
Goradia Shefali
Johns Andrew W.
Sportvision, Inc.
Vierra Magen Marcus & DeNiro LLP
LandOfFree
3D textured objects for virtual viewpoint animations does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with 3D textured objects for virtual viewpoint animations, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and 3D textured objects for virtual viewpoint animations will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4293686