Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2008-01-29
2008-01-29
Wong, Allen (Department: 2621)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C375S240000, C375S240010, C375S240120
Reexamination Certificate
active
07324594
ABSTRACT:
A system encodes videos acquired of a moving object in a scene by multiple fixed cameras. Camera calibration data of each camera are first determined. The camera calibration data of each camera are associated with the corresponding video. A segmentation mask for each frame of each video is determined. The segmentation mask identifies only foreground pixels in the frame associated with the object. A shape encoder then encodes the segmentation masks, a position encoder encodes a position of each pixel, and a color encoder encodes a color of each pixel. The encoded data can be combined into a single bitstream and transferred to a decoder. At the decoder, the bitstream is decoded to an output video having an arbitrary user selected viewpoint. A dynamic 3D point model defines a geometry of the moving object. Splat sizes and surface normals used during the rendering can be explicitly determined by the encoder, or explicitly by the decoder.
REFERENCES:
patent: 6483874 (2002-11-01), Panusopone et al.
patent: 6614936 (2003-09-01), Wu et al.
patent: 7203693 (2007-04-01), Carlbom et al.
Rusinkiewicz, “Qsplat: A multiresolution point rendering system for large meshes”, In SIGGRAPH 2000 Conference Proceedings, ACM Siggraph Annual Conference Series, pp. 343-352, 2000.
M. Botsch, et al., “Efficient high quality rendering of point sampled geometry,” In Proceedings of the 13th Eurographics Workshop on Rendering, pp. 53-64, 2002.
H. Briceno, et al., “Geometry videos,” In Proceedings of ACM Symposium on Computer Animation 2003, Jul. 2003.
A. K. Katsaggelos,et al., “Mpeg-4 and ratedistortion-based shape-coding techniques,” Proceedings of the IEEE, 86(6):1126-1154, Jun. 1998.
H. Lee, et al., “Progressive encoding of complex isosurfaces,” In Proceedings of SIGGRAPH 03, pp. 471-475. ACM Siggraph, Jul. 2003.
MPEG-3DAV, “Description of exploration experiments in 3DAV,” ISO/IEC JTC1/SC29/WG11 N5700, Jul. 2003.
W. B. Pennebaker, et al., “An overview of the basic principles of the qcoder adaptive binary arithmetic coder,” IBM Journal of Research and Development, 32(6):717-726, 1988.
S. Rusinkiewicz et al., “QSplat: A multiresolution point rendering system for large meshes,” In SIGGRAPH 2000 Conference Proceedings, ACM Siggraph Annual Conference Series, pp. 343-352, 2000.
S. Rusinkiewicz et al., “Streaming QSplat: A viewer for networked visualization of large, dense models,” In Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 63-68. ACM, 2001.
A. Said et al., “A new fast and efficient image codec based on set partitioning in hierarchical trees,” IEEE Transactions on Circuits and Systems for Video Technology, 6:243-250, Jun. 1996.
J. M. Shapiro, “Embedded image coding using zerotrees of wavelet coefficients,” IEEE Transactions on Signal Processing, 41:3445-3462, Dec. 1993.
S. Vedula, et al., “Spatio-temporal view interpolation,” In Proceedings of the 13th ACM Eurographics Workshop on Rendering, Jun. 2002.
S. Wuermlin, et al., “3D video fragments: Dynamic point samples for real-time free-view-point video,” Computers & Graphics, Special Issue on Coding, Compression and Streaming Techniques for 3D and Multimedia Data, 28(1), 2004.
Goldlucke, B., et al. “Joint 3D Reconstruction and Background Separation in Multiple Views Using Graph Cuts,” Proceedings 2003 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 683-688, Jun. 2003.
Gross Markus
Lamboray Edouard
Pfister Hanspeter
Waschbüsch Michael
Würmlin Stephan
Brinkman Dirk
Mitsubishi Electric Research Laboratories Inc.
Mueller Clifton D
Vinokur Gene V.
Wong Allen
LandOfFree
Method for encoding and decoding free viewpoint videos does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for encoding and decoding free viewpoint videos, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for encoding and decoding free viewpoint videos will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2809608