Computer graphics processing and selective visual display system – Display peripheral interface input device
Reexamination Certificate
1998-10-02
2002-05-14
Wu, Xiao (Department: 2774)
Computer graphics processing and selective visual display system
Display peripheral interface input device
C345S001200, C345S009000
Reexamination Certificate
active
06388654
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates generally to the field of processing images, and more particularly, to the field of remote conferencing applications.
INCORPORATION BY REFERENCE
This application incorporates by reference the “Interactive Projected Video Image Display System” disclosed under U.S. Pat. No. 5,528,263 (Platzker et al.) as if set forth at length herein.
Definitions
Background Image A computer-generated template, often from another active application (such as Microsoft® PowerPoint®
1
), incorporated into the Computer Display Image.
1
Microsoft and PowerPoint are registered trademarks of Microsoft Corporation.
A Committed Image A composite of the Background Image and all Writing Images to be saved into some suitable medium, such as storage component, transmission channel, or to a compatible software application.
Computer Display Image The display presented by a computer for human viewing on a device such as a monitor or Projection Surface employing technologies such as VGA, SVGA, XGA and others.
Image Sensor An optical device such as a video camera, digital camera or other imaging technology capable of viewing a Writing Surface with Local Markings.
Local Markings Markings (“Local Writings” and/or “Local Erasures”) made on the Writing Surface of the site of reference.
Local Updates Stream of data packets containing compressed representations of changes made to Local Markings.
Markings Writings and annotations (collectively, “Writings”) and/or deletions (“Erasures”) made by a human presenter on a Writing Surface.
Projection Surface A surface upon which the Computer Display Image created by a computer-controlled projection may appear; in the present invention, this will substantially overlap the Writing Surface.
Projections Visual information that appears in the Viewed Image as a result of projecting the Computer Display Image onto the Writing Surface (distinguished from Markings and Viewed Image Interference); in the context of the present invention Projections are relevant insomuch as they appear similar to physical Markings or otherwise complicate the task of detecting and processing Markings.
Remote Markings Markings (“Remote Writings” and/or “Remote Erasures”) made on the Writing Surfaces of non-local sites.
Remote Updates Stream of data packets containing compressed representations of changes made to Remote Markings.
Stored Viewed Image The most recent Viewed Image modified to exclude Viewed Image Interference and retained for purposes of detecting changes to Local Markings in a comparison with a Viewed Image.
Stored Writing Image The most recent Writing Image retained for purposes of encoding Local Updates in a comparison with an updated Writing Image.
Viewed Image The image acquired (or “seen”) by the Image Sensor and made available as digital information to computational resources (software/hardware).
Viewed Image Interference Physical objects that are interposed between the Image Sensor and the Writing Surface and therefore appear in the Viewed Image, for example, a writer's arm or body (distinguished from Markings and Projections).
Warping A transformation performed on an image based on a mapping between two geometrical coordinate spaces; in the present invention Viewed Images (or portions thereof) are transformed in this manner to a predefined display coordinate space and projected images (or portions thereof) are transformed to the coordinate space of the Viewed Images (using both Warping and optional “scaling” to overcome differences in pixel-resolution); the geometric mapping is obtained through a process of calibration.
Writing Images Internal representations of the Local Markings or Remote Markings at any point in time, one Writing Image per participating transmitting site.
Writing Surface Any surface suitable for human writing, such as a whiteboard, paper flip-chart or sheets of paper; in the present invention, this will also be the Projection Surface, if employed.
BACKGROUND OF THE INVENTION
Business, academic and other professional meetings are held to impart information to, and solicit ideas from, the attendees. The convener of a meeting usually seeks participation from the attendees, and it is an effective use of expensive meeting time to capture and record the key thoughts and ideas of the presenters and participants for future reference. It is particularly effective to record and display key points, numbers, etc., dynamically as these are forthcoming from participants at a meeting or seminar. An issue is how to record and display this information most effectively with minimal distraction. The transcription by hand of information written on a vertical board is known to every school child.
Such data are ephemeral, however, and must eventually be erased. Traditionally, each participant takes his or her own notes, each copying essentially the same material. Paradoxically, valuable information may be missed by one or several or many of participants because of the diversion of their attention to note-taking, and there may be errors in the transcription.
One approach to solving this problem is disclosed in the U.S. Pat. No. 5,528,263 previously incorporated hereinabove by reference, the “Interactive Projected Video Image Display System.” In this patent beginning at column
6
, line
60
a function is described to enable a computer to capture updated images. This system has been commercialized as Digital Flipchart™ (“DFC”). The system disclosed in the Platzker et al. patent and the one commercialized by Tegrity can be used at only one location and cannot capture an updated image without blanking the screen and cannot ignore transient objects in the field of view.
Video technology could solve the problem and limitations of the prior art, but would increase the cost and complexity of linking remote sites. Linking remote sites would allow remote participants to view written information from other sites in real-time. Using video technology to this end, the presenter must be careful not to block the view unduly, adding an unnatural constraint to a presentation. On the remote end, video images of a person's arm, blouse or tie are unnatural, unsatisfactory, uninformative, distracting at best and, at worst, an annoyance that detracts from the value of the presentation to remote viewers. Moreover, such useless video data further burdens the transmission channel. Combining video images from dispersed locations adds even more complexity.
Transmitting even compressed video uses substantial bandwidth. Transmitting compressed video of images containing motion uses even more bandwidth.
SUMMARY OF THE INVENTION
The present invention is an apparatus and method for providing a composite image on a standard whiteboard, flipchart or other Writing Surface's location at a first site, consisting of Local Markings and a projection of only the meaningful changes (i.e., Writings and Erasures) made to at least a second Writing Surface located at a second site. The result is an appearance on the local Projection Surface of a combination of physical Local Markings together with a projection of the remote sites' respective Markings. Thus, the same composite image appears on the Projection Surface at every site, although local viewers see the actual physical Markings made locally, as opposed to the projected Remote Markings. To human perception, everyone at every connected site is seeing the “same” image, differing only in size and to the degree imposed by the technical capabilities of the local projector. The composite image also incorporates the Background Image if one is generated within the computer.
In general, each site may utilize an Image Sensor connected to a standard PC-type processor. The process, when employed in such a site, continuously “looks” (i.e., grabs Viewed Images via the Image Sensor) at the present composition of the Writing Surface. It also continuously monitors the present composition of the Computer Display Image, if it is projected on the Writing Surface. These image are analyzed to detect the existence and precise
Biran Liel
Halevy Gilad
Platzker Daniel M.
Segal Tsakhi
Goodwin & Procter LLP
Tegrity, Inc.
Wu Xiao
LandOfFree
Method and apparatus for processing, displaying and... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for processing, displaying and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for processing, displaying and... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2900762