Television – Special applications – Observation of or from a specific location
Reexamination Certificate
1999-02-16
2002-05-28
Rao, Andy (Department: 2713)
Television
Special applications
Observation of or from a specific location
C348S143000
Reexamination Certificate
active
06396535
ABSTRACT:
FIELD OF THE INVENTION
The invention relates generally to a monitoring system rendering a synthetic display derived from multiple cameras mounted at various locations, and more particularly, to alerting a viewer on special situations observed.
BACKGROUND OF THE INVENTION
Video monitoring systems are well known. In the case of vehicles, several types of monitoring systems are in use. Some vehicles, e.g., busses, have cameras mounted so that the driver can view road areas beside or behind the bus. However, there is typically only one camera, and the display merely shows exactly what the camera sees. There is no attempt to analyze the displayed image. These systems simply act as viewing mirrors for hard-to-see areas. Similarly, law enforcement vehicles may capture a historical record of the view from the front window.
Some vehicles, such as computer controlled cars, also include sensors. The sensors detect potentially dangerous situations, such as, closing-up too rapidly on another vehicle. A variety of sensors have been used, for example, sonar, lasers, and microwaves. These systems do not provide a general situation display, rather they merely detect a few dangerous situations.
Radar and sonar systems can produce a situation display, and sometimes do some amount of analysis, for example, as in an air traffic control system. However, radar and sonar systems are not based on video images, but rather on the processing of reflected signals transmitted at specific frequencies.
Several types of surveillance systems are known. Typically, the systems route multiple video streams to a central location. The video streams can be displayed on corresponding monitors. If the number of cameras is greater than the number of display stations, then the system usually displays camera views in sequence, or on operator demand. These type of systems do not perform analysis, nor do these systems merge multiple streams into a single situation display. At most they may tile multiple independent views on a single screen with time and location annotations.
There are also systems that monitor specific places, such as escalators, elevators, toll gates, bank machines, and perimeter fences, in order to determine the occurrence of particular situations. Some of these systems may attempt to analyze the video in order to detect moving objects, for example, to extract a license number. However, these system typically do not combine information from multiple sources, nor do they generate an overall situation display, nor synthesize an image from a different point of view.
SUMMARY OF THE INVENTION
The invention provides a situation awareness system which includes a plurality of cameras. Each camera acquires a sequence of images of overlapping parts of an area of interest. An analyzer merges the sequences of images acquired by the plurality of cameras, and identifies moving objects in the area of interest. A display device displays the merged sequences of images, and information associated with the identified moving objects.
In one aspect of the invention, the optical flow in temporally successive images of a single video stream are analyzed to generate motion fields. Spatially adjacent images of multiple video stream are registered to obtain depth images. The motion fields and depth images are segmented to generate partially attributed data objects. Using an application specific database and analysis, the partially attributed data objects are converted to fully attributed data objects and events which are displayed as annotated graphic elements and alerts. As one feature of the invention, the viewing orientation of the display is independent of the point of view of the cameras.
REFERENCES:
patent: 5680123 (1997-10-01), Lee
patent: 5768443 (1998-06-01), Michael et al.
patent: 5793420 (1998-08-01), Schmidt
patent: 5809161 (1998-09-01), Auty et al.
patent: 5819016 (1998-10-01), Watanabe et al.
patent: 5821990 (1998-10-01), Rudt et al.
patent: 5850352 (1998-12-01), Moezzi et al.
patent: 5969755 (1999-10-01), Courtney
patent: 5982420 (1999-11-01), Ratz
Brinkman Dirk
Mitsubishi Electric Research Laboratories Inc.
Rao Andy
LandOfFree
Situation awareness system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Situation awareness system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Situation awareness system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2915115