Computer graphics processing and selective visual display system – Computer graphics processing – Three-dimension
Reexamination Certificate
1995-03-27
2001-10-23
Feild, Joseph H. (Department: 2176)
Computer graphics processing and selective visual display system
Computer graphics processing
Three-dimension
Reexamination Certificate
active
06307556
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention is generally concerned with communication between one or more vision systems and specifically concerned with presentation of augmented images in a first vision system based partially on information derived from a second vision system.
Certain vision system devices have been provided to aid in the interpretation of a scene being addressed by a user of the vision system. Information relating to the scenes being addressed is somehow “known” to the system. This information is generally used to augment the user's view of the real scene.
For example, in U.S. Pat. No. 2,994,971, by Meisenheimer et al, a starmap is painted onto a clear substrate. When the substrate is placed at arm's length into the line-of-sight of a user observing astronomical scenes, the painted starmap can be viewed simultaneouly with the scene. Ceratin features of the real scene may be invisible; for example the imaginary lines which connect stars to form a constellation. As a prepared starmap may effectively represent those lines, it is useful to view the real scene in combination with the starmap.
Since the information painted onto the substrate is particular to a certain scene, we say the device has “prior knowledge” of which scene is to be addressed by the device. For the example at hand, a transparent substrate is prepared with starmap information which relates to a certain constellation. Therefore, the device is ineffective for viewing scenes other than the particular scene for which it has been designed.
It is also important to point out that this system superimposes the two images onto a single optical path. A viewer's line of sight defines the optical path and the substrate serves as an optical combiner to combine the image of the real scene at one plane (optical infinity) which the image of the starmap at a second plane.
A second example, U.S. Pat. No. 5,311,203 by Norton, is much more versatile. The device determines which scene is being addressed by the vision system and recalls from a computer previously recorded image information relating thereto. In this way, data relating to various scenes can be played onto the device in accordance with the different scenes which may be addressed by the device.
As in the prior example, the device relies on prerecorded information or prior knowledge of the scenes to be viewed. The system's designer must first prepare images which relate to those scene expected to be addressed by the system. If the system addresses an unknown scene, the computer has no facility for generating images to be superimposed with the real scenes.
Similarly with respect to the previous example, the device of Norton combines two optical paths with contain image information from two sources. Norton optically combines information from the real scene and information from a computer generated image.
Both of the devices described above superimpose the recorded information with information of the real scene via optical combiner schemes. Common head-up displays HUD and helmet mounted type displays HMD also rely on optical combiners to join image information generated by a computer to augment a scene being viewed. In HUDs and MMDs, information generated by a computer, for example the extent of a runway, is based on what is known to be within a particular scene being addressed by the system. The system's computer must possess knowledge of physical details of a runway to use the vision system to view that runway.
A vision system developed previously by the present inventors which is the subject of the patent application above-identified and which is the patent application to this application, identifies a scene based on position and attitude measurements to determine which scene is being addressed. The system then recalls information from a computer and forms a composite image to be displayed to a user. In contrast to other vision systems, the composite image is formed in the electrical domain compared to the optical domain. Operating on image information in a digital electronic domain provides certain advantages over manipulation of optical beams when considering the functions of these vision systems. Similar to other vision systems, recalled information relates to a particular scene, it constitutes “prior knowledge” of the scene being addressed.
Each of these systems rely on having prior knowledge of scenes being addressed and uses that information to manipulate the vision system to present to a user an augmented view of the scene. While the systems and inventions of the prior art are designed to achieve particular goals and objectives, some of those being no less than remarkable, these inventions have limitations which prevent their use in new ways now possible. These prior art inventions are not used and cannot be used to realize the advantages and objectives of the present invention.
SUMMARY OF THE INVENTION
Comes now, John, Thomas and Peter Ellenby with an invention of a vision system including devices and methods of augmenting images of real scenes wherein information used to augment the real scene is derived from a second vision system. It is a primary function of this vision system to provide augmented images of real scenes based on information received in real time from other vision systems. It is a contrast to prior art methods and devices that those systems do not share information with other similar vision systems. A fundamental difference between vision systems of the instant invention and those of the art can be found when considering its communication with other vision systems having different perspectives of a commonly addressed scene.
As a plurality of persons simultaneously viewing a single scene from different perspectives (from different points-of-view), there may be information which is readily available to a first perspective but not readily available to a second perspective. If vision systems used to view the scene are in communication with one another, they may be arranged to share image information such that features of the scene which were previously unavailable to a particular perspective then become available via that communication. An image of a scene as viewed from the second perspective can be operated on in a digital domain with a translation of perspective routine to result in image information useful to the first vision system. The second vision system addressing the same scene from a second perspective can then provide presentation of a composite image of the scene in the natural perspective of that second vision system. The image is comprised of image information from two sources: 1) image information gathered normally from the second vision system and 2) image information gathered at the first vision system, operated on by a translation of perspective, and transmitted from the first vision system to the second vision system.
The composite image could then have content relating to the second perspective which would be otherwise impossible to obtain in simple vision systems from that perspective.
It is a primary object of the invention to provide an apparatus having a plurality of vision systems in communication with each other. It is an object of the invention to provide communication between a plurality of vision systems. It is a further object to augment an image of a first vision system based on information received from a second vision system. It still further an object to provide a first vision system having certain perspective with image information from a second vision system having another perspective which enables the first vision system to present a composite image to a user where the composite image has information content based on information from the first and second vision systems.
In accordance with those features and objectives, an apparatus operable for providing an image of a scene, the image being a composite image comprised of information relating to the scene realized from a plurality of perspectives, the apparatus comprising: a) a first vision system; and b) a second vision
Ellenby John
Ellenby Peter
Ellenby Thomas
Feild Joseph H.
Geovector Corp.
Page Lohr Associates
LandOfFree
Augmented reality vision systems which derive image... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Augmented reality vision systems which derive image..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Augmented reality vision systems which derive image... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2575533