Sound-synchronized video system

Details Sound-synchronized video system Sound-synchronized video system

1994-06-21

1997-03-04

Hafiz, Tariq R.

395 24, 395 279, G10L 506, G10L 900

Patent

active

056088396

ABSTRACT:
A stream of unsynchronized audio signal, representing speech and video signal of a speaker, is processed by decoding the signal, memorizing a plurality of visemes corresponding to phonemes in the audio signal, fetching from the plurality visemes corresponding to phonemes in the audio signal, and imparting a synchronism to the video signal and audio signal by applying the fetched visemes to the unsynchronized video signal of the stream in synchronism with corresponding phonemes in the audio signal of the stream. According to an embodiment, the fetching step includes fetching visemes of the lip movement. The system is suitable for use in a videophone.

REFERENCES:
patent: 4104625 (1978-08-01), Bristow et al.
patent: 4305131 (1981-12-01), Best
patent: 4757541 (1988-07-01), Beadles
patent: 4841575 (1989-06-01), Welsh
patent: 5327521 (1994-07-01), Savic et al.
"An Intelligent Facial Image Coding Driven by Speech and Phoneme" by Shigeo Morishima et al., published in Multidimensional Signal Processing, Audio and Electroacoustics, vol. 3, on May 23, 1989, Institute of Electrical and Electronic Engineers, pp. 1795-1798.
"Face Animation Scenario Making System for Model Based Image Synthesis" by Shigeo Morishima et al., dated 17 Mar. 1993, the 1993 Picture Coding Symposium Proceedings in the Swiss Federal Institute of Technology, Lausanne, Switzerland.
Wolff et al, "Sensory Fusion: integrating visual and auditory information for recognizing speech;" ICASSP-94, p. 465-8 vol. 1, 19-22 Apr. 1994.

Affiliated with

Also associated with

Rating

Sound-synchronized video system does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Sound-synchronized video system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sound-synchronized video system will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2153672