Computer graphics processing and selective visual display system – Plural physical display element control system – Display elements arranged in matrix
Reexamination Certificate
1998-02-06
2001-02-06
Sax, Steven (Department: 2773)
Computer graphics processing and selective visual display system
Plural physical display element control system
Display elements arranged in matrix
C345S111000
Reexamination Certificate
active
06184858
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates generally to visual recognition systems and, more particularly, to a technique for updating a background image.
BACKGROUND OF THE INVENTION
An interface to an automated information dispensing kiosk represents a computing paradigm that differs from the conventional desktop environment. That is, an interface to an automated information dispensing kiosk differs from the traditional Window, Icon, Mouse and Pointer (WIMP) interface in that such a kiosk typically must detect and communicate with one or more users in a public setting. An automated information dispensing kiosk therefore requires a public multi-user computer interface.
Prior attempts have been made to provide a public multi-user computer interface and/or the constituent elements thereof. For example, a proposed technique for sensing users is described in “Pfinder: Real-time Tracking of the Human Body”, Christopher Wren, Ali Azarbayejani, Trevor Darrell, and Alex Pentland, IEEE 1996. This technique senses only a single user, and addresses only a constrained virtual world environment. Because the user is immersed in a virtual world, the context for the interaction is straight-forward, and simple vision and graphics techniques are employed. Sensing multiple users in an unconstrained real-world environment, and providing behavior-driven output in the context of that environment present more complex vision and graphics problems which are not addressed by this technique.
Another proposed technique is described in “Real-time Self-calibrating Stereo Person Tracking Using 3-D Shape Estimation from Blob Features”, Ali Azarbayejani and Alex Pentland, ICPR January 1996. The implementing system uses a self-calibrating blob stereo approach based on a Gaussian color blob model. The use of a Gaussian color blob model has a disadvantage of being inflexible. Also, the self-calibrating aspect of this system may be applicable to a desktop setting, where a single user can tolerate the delay associated with self-calibration. However, in an automated information dispensing kiosk setting, some form of advance calibration would be preferable so as to allow a system to function immediately for each new user.
Other proposed techniques have been directed toward the detection of users in video sequences. The implementing systems are generally based on the detection of some type of human motion in a sequence of video images. These systems are considered viable because very few objects move exactly the way a human does. One such system addresses the special case where people are walking parallel to the image plane of a camera. In this scenario, the distinctive pendulum-like motion of human legs can be discerned by examining selected scan-lines in a sequence of video images. Unfortunately, this approach does not generalize well to arbitrary body motions and different camera angles.
Another system uses Fourier analysis to detect periodic body motions which correspond to certain human activities (e.g., walking or swimming). A small set of these activities can be recognized when a video sequence contains several instances of distinctive periodic body motions that are associated with these activities. However, many body motions, such as hand gestures, are nonperiodic, and in practice, even periodic motions may not always be visible to identify the periodicity.
Another system uses action recognition to identify specific body motions such as sitting down, waving a hand, etc. In this if approach, a set of models for the actions to be recognized are stored and an image sequence is filtered using the models to identify the specific body motions. The filtered image sequence is thresholded to determine whether a specific action has occurred or not. A drawback of this system is that a stored model for each action to be recognized is required. This approach also does not generalize well to the case of detecting arbitrary human body motions.
Recently, an expectation-maximization (EM) technique has been proposed to model pixel movement using simple affine flow models. In this technique, the optical flow of images is segmented into one or more independent rigid body motion models of individual body parts. However, for the human body, movement of one body part tends to be highly dependent on the movement of other body parts. Treating the parts independently leads to a loss in detection accuracy.
The above-described proposed techniques either do not allow users to be detected in a real-world environment in an efficient and reliable manner, or do not allow users to be detected without some form of clearly defined user-related motion. These shortcomings present significant obstacles to providing a fully functional public multi-user computer interface. Accordingly, it would be desirable to overcome these shortcomings and provide a technique for allowing a public multi-user computer interface to detect users.
OBJECTS OF THE INVENTION
The primary object of the present invention is to provide a technique for updating a background image.
The above-stated primary object, as well as other objects, features, and advantages, of the present invention will become readily apparent from the following detailed description which is to be read in conjunction with the appended drawings.
SUMMARY OF THE INVENTION
According to the present invention, a technique for updating a background image is provided. The technique can be realized by having a processing device such as, for example, a digital computer, obtain at least two representations of an image. Each representation can be, for example, an electrical representation of an image of a scene that is captured by a camera at a distinct point in time. Thus, each electrical representation represents an image of the scene at a different point in time.
Each captured image of the scene can be digitized such that each electrical representation is in the form of a plurality of pixels, wherein each of the plurality of pixels has a respective value such as, for example, an intensity value of light over a range of light wavelengths. Each electrical representation can then be stored, for example, as digital data on a tape, disk, or other memory device for manipulation by the processing device.
The processing device identifies at least one portion of at least one of the at least two representations. Each identified portion of a representation can be, for example, an identified grouping of pixels. The pixels can be identified, for example, according to the value of each pixel. Pixels having similar values can represent an object within an image such as, for example, a human.
The processing device provides an updated representation of the image by averaging together the at least two representations, with the exception of each identified portion. Each identified portion can be excepted for a predetermined period of time. Alternatively, each identified portion can be excepted based upon an identifiable characteristic of each identified portion. For example, if movement of an identified portion of a representation is detected by the processing device, thereby corresponding to a moving object within an associated image, then the identified portion can continue to be excepted from the averaging step.
REFERENCES:
patent: 4644582 (1987-02-01), Morishita et al.
patent: 4821029 (1989-04-01), Logan et al.
patent: 4851616 (1989-07-01), Wales et al.
patent: 4951140 (1990-08-01), Ueno et al.
patent: 5048103 (1991-09-01), Leclerc
patent: 5067015 (1991-11-01), Combridge et al.
patent: 5105186 (1992-04-01), May
patent: 5262856 (1993-11-01), Lippman et al.
patent: 5280610 (1994-01-01), Travis, Jr. et al.
patent: 5376947 (1994-12-01), Kurode
patent: 5440744 (1995-08-01), Jacobson et al.
patent: 5551027 (1996-08-01), Choy et al.
patent: 5574762 (1996-11-01), Sato et al.
patent: 5581758 (1996-12-01), Burnett et al.
patent: 5606376 (1997-02-01), Shinohara
patent: 5630017 (1997-05-01), Gasper et al.
patent: 5640558 (1997-06-01), Li
patent: 5652880 (1997-07-01), Seagraves
patent: 5652882 (1997-07-01), Doktor
patent: 565
Avery Brian Lyndall
Christian Andrew Dean
Cesari and McKenna LLP
Compaq Computer Corporation
Sax Steven
LandOfFree
Technique for updating a background image does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Technique for updating a background image, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Technique for updating a background image will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2575022