Data processing: generic control systems or specific application – Specific application – apparatus or process – Digital audio data processing system
Reexamination Certificate
1998-12-18
2004-07-13
Lee, Ping (Department: 2744)
Data processing: generic control systems or specific application
Specific application, apparatus or process
Digital audio data processing system
C370S505000
Reexamination Certificate
active
06763274
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to communication of digital audio data. More particularly, the present invention relates to modification of digital audio playback to compensate for timing differences.
BACKGROUND OF THE INVENTION
Technology currently exists that allows two or more computers to exchange real time audio and video data over a network. This technology can be used, for example, to provide video conferencing between two or more locations connected by the Internet. However, because participants in the conference use different computer systems, the sampling rates for audio input and output may differ.
For example, two computer systems having sampling rates labeled “8 kHz” may have slightly different actual sampling rates. Assuming that a first computer has an actual audio input sampling rate of 8.1 kHz and a second computer has an actual audio output rate of 7.9 kHz, the computer system outputting the audio data is falling behind the input computer system at a rate of 200 samples per second. The result can be unnatural gaps in audio output or loss of audio data. Over an extended period of time, audio output may fall behind video output such that the video output has little relation to the audio output.
Another shortcoming of real time network audio is known as “jitter.” As network routing paths or packet traffic volume change, as is common with the Internet, a short interruption may be experienced as a result of the time difference required to traverse a first route as compared to a second route. The resulting jitter can be annoying or distracting to a listener of the digital audio received over the network.
What is needed is an audio compensation scheme that compensates for audio timing differences between input and output.
SUMMARY OF THE INVENTION
A method and apparatus for digital audio compensation is described. A timing relationship between an audio input and an audio output is determined. A period of silence within an audio segment is identified and the length of the period of silence is adjusted based, at least in part, on the timing relationship between the audio input and the audio output.
In one embodiment, the timing relationship is determined based on a difference between time stamps for a first data packet and a second data packet, and a period of time required to play the first data packet. In one embodiment, audio samples from the period of silence are removed or replicated to shorten or lengthen, respectively, the period of silence to compensate for differences between the audio input and the audio output. Modification of the period of silence can be used to compensate for both differences between input and output rates and for jitter caused by network routing.
REFERENCES:
patent: 5526362 (1996-06-01), Thompson et al.
patent: 5768263 (1998-06-01), Tischler et al.
patent: 5825771 (1998-10-01), Cohen et al.
patent: 6088412 (2000-07-01), Ott
patent: 6449291 (2002-09-01), Burns et al.
“Automatic Segmentation, Classification, and Clustering of Broadcast News Audio,” Matthew A. Siegler, et al., ECE Department-Speech Group, Carnegie Mellon University 1997, 7 pgs.
“Digital cellular telecommunications system; Voice Activity Detection (VAD) (GSM 06.32),” European Telecommunication Standard Institute, European Telecommunication Standard Third Edition, Oct. 1996, 40 pgs.
“Internet Stream Protocol Version 2 (ST2) Protocol Specification—Version ST2+,” L Delgrossi, et al., Internet Engineering Task Force, Network Working Group; Request for Comments 1819, Aug. 1995, 98 pgs.
“RTP: A Transport Protocol for Real-Time Applications,” H. Schulzrinne, et al., Internet Engineering Task Force Network Working Group; Request for Comments 1889, Jan. 1996, 65 pgs.
“RTP Protocol for Audio and Video Conferences with Minimal Control,” H. Schulzrinne, et al., Internet Engineering Task Force, Network Working Group; Request for Comments 1890, Jan. 1996, 16 pgs.
“User Datagram Protocol,” J. Postel, et al., IETF RFC 768, Aug. 28, 1980, 3 pgs.
Lee Ping
PlaceWare, Incorporated
LandOfFree
Digital audio compensation does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Digital audio compensation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Digital audio compensation will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3250651