Television – Two-way video and voice communication – Conferencing
Reexamination Certificate
2002-12-20
2004-11-02
Ramakrishnaiah, Melur (Department: 2643)
Television
Two-way video and voice communication
Conferencing
C348S014070, C348S014110
Reexamination Certificate
active
06812956
ABSTRACT:
TECHNICAL FIELD
The invention relates to teleconferencing. More particularly, the invention relates to a method and apparatus for selecting signals in a teleconference.
DESCRIPTION OF THE PRIOR ART
The primary goal of teleconferencing systems is to provide, at a remote teleconference site, a high fidelity representation of the persons present and of events occurring at a local teleconference site. A teleconferencing system that represents the local conferencing site with sufficient fidelity enables effective communication and collaboration among the participants despite their physical separation.
In practice, it is difficult to capture the persons and events at a local conferencing site effectively using a single video feed from a single video camera and a single audio feed from a single microphone. This is especially true in conferences with more than one local conferencing participant. While employing a single camera with a wide-angle view of a local conferencing site may successfully capture more than one participant within the camera field of view, such views create a sense of distance that is neither comfortable nor engaging for the remote participant.
Several prior art video conferencing systems, including the Viewstation MP, manufactured by Polycom, Inc. of Pleasanton, Calif., have attempted to mitigate this shortcoming with a motion control video camera. The camera automatically tracks a single video conferencing participant or pans and tilts to capture multiple participants, successively, within the field of view. While this approach does provide a closer view of individual participants, the moving view captured by a panning and tilting camera as it transitions from one participant to another is disconcerting when viewed by the remote participant.
To avoid the panning and tilting motion provided by motion control cameras, several prior art conferencing systems, including the CT-4A Automatic Mixer, manufactured by Jefferson Audio Systems of Louisville, Ky., have incorporated video feeds from multiple video cameras, and audio feeds from multiple microphones. In addition, many systems allow for the transmission of video and audio feeds from sources such as laptop computers, document cameras, and video cassette recorders.
Because a teleconferencing system must operate within the limited bandwidth connecting a local and remote location, it is in practice not possible to transmit all of the audio and video signals to the remote location. Moreover, the amount of visual and aural information the remote participant can comfortably process is itself limited. It is therefore desirable to determine, among the many video and audio feeds available at the local conferencing site, which feed or feeds to transmit to the remote location.
Several prior art approaches, including U.S. Pat. No. 6,025,870 to Hardy have suggested that the selection of the video and audio signals may be performed in a manner that simulates the shift in attention of an observer physically present at the local site. For example, the selected video signal may be obtained from a video camera offering a prominent view of the current speaker, and the selected audio signal may be obtained from a microphone offering the clearest rendering of the current dialogue. Providing video and audio signals to the remote participant in this manner provides a more natural interaction with the local teleconferencing site.
In some instances, selection of signals in this manner requires a human operator. This approach is distracting if carried out by a meeting participant, or costly, if carried out by a hired director. A few systems, however, attempt to perform the signal selection in an automated manner. T. Inoue, K. Okada, and Y. Matsushita, Learning from TV Programs: Application of TV Presentation to a Videoconferencing System and Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 147-154, Pittsburgh, Pa. (Nov. 14-17, 1995) propose an automated system emulating the direction techniques used in the television industry.
U.S. Pat. No. 6,025,870 to Hardy describes a system for automatically capturing the changing focus of a video conference. The system “includes a video switch for selecting focus video information, a physical video input node coupled to provide physical video information to the video switch, a graphics processing module coupled to provide graphical video information to the video switch, and a remote source interface coupled to provide remote video information to the video switch. The videoconference system further includes an audio processing module for processing audio information. A record controller is coupled to the video switch, the graphics processing module and the audio processing module. The record controller is coupled to receive event information from the audio processing module and the graphics processing module. The record controller automatically determines a focus video source from the physical video input, the graphics processing module and the remote source interface responsive to receiving the event information. The record controller controls the video switch to couple the focus video source to a video switch output responsive to determining the focus video source.”
While the systems disclosed by Inoue et al. and Hardy do provide improvement over more traditional systems, several deficiencies remain. In particular the Inoue system merely considers a relative probability of transitions from a current signal to a subsequent signal based on the classes of the current signal and available signals, where the signal classes are defined by the subject matter represented by the video signal. The system has, if any, a very limited sense of the current state and context of the video conference. The system is therefore unable to select meaningfully an appropriate signal based on the specific progression of events in a particular video conference, and instead transitions from one signal to another along standardized sequences.
The system disclosed by Hardy does incorporate an understanding of the current state of the conference, as indicated by the events received by the record controller. However, the ability of the system to respond to the changing state of the conference is limited to specific responses to specific events. Most notably, the system is unable to develop a continually refined assessment of the state and context of the conference. Instead, the system merely waits for a recognized event and then responds accordingly.
Moreover, neither system suggests that the selection of signals could be based on a history of the conference state, or a prediction of future conference states. Further, neither prior art system attempts to develop a quantitative estimate of the suitability of selection for each of the potentially selected signals. In these regards, the systems are more rule-based than model-based.
Finally, the prior art systems do not suggest a signal selection method that changes throughout the course of a conference to remain consistent with the changing dynamics of a typical business meeting.
What is needed is a system that continually monitors a teleconference to develop an understanding of the state and context of the conference. Based on this understanding, the system should consider and evaluate each candidate configuration of output signals, preferably quantitatively, and select from among the candidate output configurations a most desirable output configuration. In this manner, the system should develop a model of the conference, preferably incorporating a sense of continuity in the progression of selected output configurations. Further, the model is preferably varied throughout the course of the conference to allow for the changing dynamics of a typical business meeting.
Furthermore, the system, when operated at a local video conferencing site, should be compatible with any existing teleconferencing equipment present at the remote site.
Finally, the system should have interfaces that are simple and intuitive, allowing use by those with little or no computer
Duttweiler Mark E.
Ferren Bran
Hillis W. Daniel
Howe Russel
Applied Minds, Inc.
Glenn Michael A.
Glenn Patent Group
Ramakrishnaiah Melur
LandOfFree
Method and apparatus for selection of signals in a... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for selection of signals in a..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for selection of signals in a... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3359734