Encoding with visual masking

Details Encoding with visual masking Encoding with visual masking

2011-08-23

2011-08-23

Wong, Allen (Department: 2482)

Pulse or digital communications

Bandwidth reduction or expansion

Television or motion video signal

C375S240020

Reexamination Certificate

active

08005139

ABSTRACT:
Some embodiments of the invention encode a sequence of video images based on “visual masking” attributes of the video images and/or portions of the video images. Visual masking of an image or a portion of the image is an indication of how much coding artifacts can be tolerated in the image or image portion. To express the visual masking attribute of an image or an image portion, some embodiments compute a visual masking strength that quantifies the brightness energy of the image or the image portion. In some embodiments, the brightness energy is measured as a function of the average luma or pixel energy of the image or image portion.

REFERENCES:
patent: 5337049 (1994-08-01), Shimoda
patent: 5416604 (1995-05-01), Park
patent: 5473384 (1995-12-01), Jayant et al.
patent: 5691770 (1997-11-01), Keesman
patent: 5790695 (1998-08-01), Suwa
patent: 6101276 (2000-08-01), Adiletta et al.
patent: 6111991 (2000-08-01), Ribas-Corbera et al.
patent: 6148107 (2000-11-01), Ducloux et al.
patent: 6192075 (2001-02-01), Jeng et al.
patent: 6229925 (2001-05-01), Alexandre et al.
patent: 6278735 (2001-08-01), Mohsenian
patent: 6414992 (2002-07-01), Sriram et al.
patent: 6650707 (2003-11-01), Youn et al.
patent: 6760482 (2004-07-01), Taubman
patent: 6826228 (2004-11-01), Hui
patent: 6925119 (2005-08-01), Bartolucci et al.
patent: 7042943 (2006-05-01), Haskell et al.
patent: 7079581 (2006-07-01), Noh et al.
patent: 7095784 (2006-08-01), Chang et al.
patent: 2001/0014121 (2001-08-01), Kaye et al.
patent: 2003/0202580 (2003-10-01), Noh et al.
patent: 2005/0169370 (2005-08-01), Lee
patent: 2006/0013298 (2006-01-01), Tong et al.
patent: 2006/0245492 (2006-11-01), Pun et al.
patent: 1176562 (1998-03-01), None
patent: 0910212 (1999-04-01), None
patent: 0305941 (2001-08-01), None
patent: 2003-0082818 (2003-10-01), None
patent: 545066 (2003-08-01), None
patent: PCT/US2005/022616 (2005-06-01), None
patent: WO 2006/004605 (2006-01-01), None
International Search Report, Mar. 20, 2006, Apple Computer, Inc.
Written Opinion of International Searching Authority, Mar. 20, 2006, Apple Computer, Inc.
International Preliminary Report on Patentability, Dec. 28, 2006, Apple Computer, Inc.
Atul Pun and R. Aravind, “Motion-compensated video coding with adaptive perceptual quantization,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 1, No. 4, pp. 351-361, Dec. 1991.
J. Lee and B.W. Dickinson, “Scene-adaptive motion interpolation structures based on temporal masking in human visual perception,” in Proc. SPIE Conference on Visual Comm. and Image Processing, Cambridge, Month N/A 1993, pp. 499-510.
N. Jayant, J. Johnston, and R. Safranek, “Signal compression based on models of human perception,” Proceedings fo IEEE, vol. 81, pp. 1385-1422, Oct. 1993.
Antonio Ortega, R. Ramchandran, and M. Vetterli, “Optimal trellis-based buffered compression and fast approximation,” IEEE Trans. on Image Processing, vol. 3, pp. 26-40, Jan. 1994.
Jungwoo Lee and Bradley W. Dickinson, “Temporally adaptive motion interpolation exploiting temporal masking in visual perception,” IEEE Trans. on Image Processing, vol. 3, No. 5, pp. 513-526, Sep. 1994.
Mark R. Pickering and John F. Arnold, “A perceptually efficient VBR rate control algorithm,” IEEE Trans. on Image Processing, vol. 3, No. 5, pp. 527-532, Sep. 1994.
Chun-Hsien Chou and Y.-C Li, “A perceptually tuned subband image coder based on the measure of Just-Noticeable-Distortion profile,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 5, No. 6, pp. 467-476, Dec. 1995.
Wei Ding and B. Liu, “Rate control of MPEG video coding and recoding by Rate-Quantization modeling,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 6, No. 1, pp. 12-20, Feb. 1996.
Soon Hie Tan, Khee K. Pang, and K.N. Ngan, “Classified perceptual coding with adaptive quantization,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 6, No. 4, pp. 375-388, Aug. 1996.
Hirohisa Jozawa, K. Kamikura, A. Sagata, H. Kotera, and H. Watanabe, “Two-stage motion compensation using adaptive global MC and local affine MC,” IEEE Trans. on Circuits and Systems for Video Tech., vol. 7, No. 1, pp. 75-82, Feb. 1997.
Wei Ding, “Joint encoder and channel rate control of VBR video over ATM networks,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, No. 2, pp. 266-278, Apr. 1997.
Kuo-Chin Fan and K.-S. Kan, “An active scene analysis-based approach for pseudoconstant bit-rate video coding,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 8, No. 2, pp. 159-170, Apr. 1998.
Antonio Ortega and R. Ramchandran, “Rate-Distortion methods for image and video compression,” IEEE Signal Processing Magazine, vol. 15, No. 6, pp. 23-50, Nov. 1998.
Anthony Vetro, H. Sun, and Y. Wang, “MPEG-4 rate control for multiple video objects,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 1, pp. 186-199, Feb. 1999.
Jordin Ribas-Corbera and S. Lei, “Rate control in DCT video coding for low-delay communications,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 1, pp. 172-185, Feb. 1999.
Yi-Jen Chiu and Toby Berger, “A software-only videocodec using pixelwise conditional differential replenishment and perceptual enhancements,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 3, pp. 438-450, Apr. 1999.
Austin Y. Lan, A.G. Nguyen, and J-N Hwang, “Scene-context-dependent reference-frame placement for MPEG video coding,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 3, pp. 478-489, Apr. 1999.
L. Wang and A. Vincent, “Bit allocation and constraints for joint coding of multiple video programs,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 6, Sep. 1999.
Jose I. Ronda, F. Jaureguizar, and N. Garcia, “Rate control and bit allocation for MPEG-4,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 8, pp. 1243-1258, Dec. 1999.
Frederic Dufaux and J. Konrad, “Efficient, robust and fast global motion estimation for video coding,” IEEE Trans. on Image Processing, vol. 9, No. 3, pp. 497-501, Mar. 2000.
Hung-Ju Lee, T. Chiang, and Y.-Q. Zhang, “Scalable rate control for MPEG-4 video,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, No. 6, pp. 878-894, Sep. 2000.
K.T. Tan and Mohammed Ghanbari, “A multi-metric objective picture-quality measurement model for MPEG video,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, No. 7, pp. 1208-1213, Oct. 2000.
Lila Boroczky, A.Y. Ngai, and E.F. Westermann, “Joint rate-control with look-ahead for multi-program video coding,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, No. 7, pp. 1159-1163, Oct. 2000.
I-Ming Pao and Ming-Ting Sun, “Encoding stored video for streaming applications,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 11, No. 2, pp. 199-209, Feb. 2001.
H. Song and C-C. Jay Kuo, “Rate control for low-bit-rate video via variable-encoding frame rates,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 11, No. 4, Apr. 2001.
Y. Yu, J. Zhou, Y. Wang, and C.W. Chen, “A novel two-pass VBR algorithm for fixed-size storage application,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 11, No. 3, Mar. 2001.
Supavadee Aramvith, I.-M. Pao, and M.-T. Sun, “A rate-control for video transport over wireless channels,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 11, No. 5, pp. 569-580, May 2001.
Yan Yang and S.S. Hemami, “Rate control for VBR video over ATM: Simplification and implementation,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 11, No. 9, pp. 1045-1058, Sep. 2001.
Zhihai He and S.K. Mitra, “Optimum

Affiliated with

Also associated with

Rating

Encoding with visual masking does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Encoding with visual masking, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Encoding with visual masking will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2659714