3D multispectral lidar

Details 3D multispectral lidar 3D multispectral lidar

2002-01-15

2003-12-16

Gutierrez, Diego (Department: 2818)

Radiant energy

Photocells; circuits and apparatus

Photocell controlled circuit

C356S004010

Reexamination Certificate

active

06664529

ABSTRACT:

BACKGROUND OF THE INVENTION
1. The Field of the Invention
The present invention relates generally to remote sensor technology, and more particularly, but not necessarily entirely, to an airborne remote sensor array capable of producing georectified three dimensional (3D) digital imagery in real time, using a lidar based system.
2. Description of Related Art
The prior art is characterized by photogrammetric systems which use stereographic image-matching techniques. Such systems produce 2.5-D imagery by draping aerial imagery onto previously obtained topographical data. The topographical data is acquired by photogrammetric measurements obtained through stereoscopic viewing of two images. Computerized image matching techniques can automatically measure the range to objects within an image and thereby create a topographic model on which the image can be coregistered and draped. These prior art methods require computational intensive post-processing and cannot be performed in real time.
The prior art also includes time-of-flight topographic lidar sensor systems, which have been developed and are used in conjunction with passive imaging sensors deployed as separate instruments on aircraft. The goal of such systems is to produce orthoimages by combining the lidar range data and the passive images such that each image pixel corresponds with known geographic coordinates.
However, the orthorectification accomplished by the prior art systems requires extensive computational post-processing because the data sets produced by the different sensors are not time synchronized. Rather, the prior art is characterized by systems in which the lidar system collects data at one time and from one direction, while the imaging sensors collect data at a slightly different time and from a slightly different direction. Following the removal of parallax and co-registration of the data sets, the imagery is then associated with the lidar data to produce an interpolated three-dimensional (hereinafter 3D) aerial image. After the 3D aerial image is produced, the image can be incorporated into a geographic information system for viewing from various perspectives including an orthoprojection. However, this process requires the surface application of complex analytic equations which in combination require a large amount of computation that cannot be completed in real time without the assistance of substantial parallel processing. The resulting time delay in acquiring such 3D aerial images is prohibitive for time-critical applications encountered in both civilian and military settings.
The publication identified as Clapis et al. “Real-time image processing and data fusion of a two-channel imaging laser radar sensor,” SPIE Vol. 1633 Laser Radar VII (1992) pp. 281-287 (hereinafter “Clapis et al. publication”), discloses a real-time image processing and data fusion of a two-channel imaging laser radar (lidar) sensor. The first channel is the lidar return intensity image or lidar image. The second channel is a lidar range image. These two data sets are derived from the same laser shot, the intensity image from the laser return signal intensity, and the range image from the time-of-arrival of the laser return signal. The two data sets are inherently synchronized and are therefore already fused at the pixel level, and are not derived as a combination of a passive imaging sensor that is separate from the lidar sensor. However, the Clapis et al. publication does not suggest the concept of combining passive spectral images in the final image. Applicant's invention is the first to synchronize a passive imaging sensor with a lidar sensor to enable real-time pixel-level fusion of the two data sets.
Canadian Patent No. 2,105,501 by Jasiobedzki et al. (hereafter “′501 Canadian patent”) discloses an invention which coaligns a lidar sensor along the same optical axis as an imaging sensor to allow a robot to sight the lidar sensor in a particular direction, and allow the robot to determine what part of the environment the beam is currently striking. This invention successfully removes parallax between the two sensors when they are static relative to the target. However, the ′501 Canadian patent fails to synchronize the two sensors and therefore fails to remove parallax introduced by moving objects or a moving sensor.
The prior art is characterized by the above-described and other disadvantages that are addressed by the present invention. The present invention minimizes, and in some aspects eliminates, the above-mentioned failures, and other problems, by utilizing the methods and structural features described herein.


REFERENCES:
patent: 5006721 (1991-04-01), Cameron et al.
patent: 5101108 (1992-03-01), Gaalema et al.
patent: 5177556 (1993-01-01), Rioux
patent: 5231401 (1993-07-01), Kaman et al.
patent: 5270780 (1993-12-01), Moran et al.
patent: 5446529 (1995-08-01), Stettner et al.
patent: 5696577 (1997-12-01), Stettner et al.
patent: 5796471 (1998-08-01), Wilkerson et al.
patent: 5822047 (1998-10-01), Contarino et al.
patent: 5835204 (1998-11-01), Urbach
patent: 5870179 (1999-02-01), Cathey, Jr. et al.
patent: 5872621 (1999-02-01), Wilkerson et al.
patent: 5889582 (1999-03-01), Wong et al.
patent: 6396577 (2002-05-01), Ramstack
patent: 6448572 (2002-09-01), Tennant et al.
patent: 6473189 (2002-10-01), Reedy
patent: 6535158 (2003-03-01), Wilkerson et al.
patent: 2105501 (1993-09-01), None
Paul Clapis, Mark Cullen, Duncan Harris, David Jenkins, “Real-time Image Processing and Data Fusion of a Two-Channel Imaging Laser Radar Sensor” SPIE vol. 1633 Laser Radar VII (1992) pp. 281, 283, 285, 287.
www.lasermap.com/laserM/english/p3.asp. Lasermap Image Plus. At least as early as Jun. 27, 2001.
Mosaic Mapping Systems Inc. LIDAR Remote Sensing Services. At least as early as Jun. 27, 2001.
www.sani-ita.com/photo/orthoimage.html. Orthoimage Production. At least as early as Jun. 25, 2001.

Affiliated with

Also associated with

Rating

3D multispectral lidar does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with 3D multispectral lidar, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and 3D multispectral lidar will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3162486