Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
2011-04-12
2011-04-12
Johns, Andrew W (Department: 2624)
Image analysis
Applications
3-d or stereo imaging analysis
C382S278000, C348S046000
Reexamination Certificate
active
07925077
ABSTRACT:
A powerful, scaleable, and reconfigurable image processing system and method of processing data therein is described. This general purpose, reconfigurable engine with toroidal topology, distributed memory, and wide bandwidth I/O are capable of solving real applications at real-time speeds. The reconfigurable image processing system can be optimized to efficiently perform specialized computations, such as real-time video and audio processing. This reconfigurable image processing system provides high performance via high computational density, high memory bandwidth, and high I/O bandwidth. Generally, the reconfigurable image processing system and its control structure include a homogeneous array of 16 field programmable gate arrays (FPGA) and 16 static random access memories (SRAM) arranged in a partial torus configuration. The reconfigurable image processing system also includes a PCI bus interface chip, a clock control chip, and a datapath chip. It can be implemented in a single board. It receives data from its external environment, computes correspondence, and uses the results of the correspondence computations for various post-processing industrial applications. The reconfigurable image processing system determines correspondence by using non-parametric local transforms followed by correlation. These non-parametric local transforms include the census and rank transforms. Other embodiments involve a combination of correspondence, rectification, a left-right consistency check, and the application of an interest operator.
REFERENCES:
patent: 3946696 (1976-03-01), Lubnow
patent: 4067027 (1978-01-01), Yamazaki
patent: 4418993 (1983-12-01), Lipton
patent: 4717958 (1988-01-01), Gal et al.
patent: 4751570 (1988-06-01), Robinson
patent: 4761066 (1988-08-01), Carter
patent: 4879596 (1989-11-01), Miura et al.
patent: 4905081 (1990-02-01), Morton
patent: 5004328 (1991-04-01), Suzuki et al.
patent: 5049988 (1991-09-01), Sefton et al.
patent: 5063441 (1991-11-01), Lipton et al.
patent: 5142357 (1992-08-01), Lipton et al.
patent: 5179441 (1993-01-01), Anderson et al.
patent: 5206503 (1993-04-01), Toops
patent: 5270861 (1993-12-01), Estelle
patent: 5402171 (1995-03-01), Tagami et al.
patent: 5440343 (1995-08-01), Parulski et al.
patent: 5453784 (1995-09-01), Krishnan et al.
patent: 5453785 (1995-09-01), Lenhardt et al.
patent: 5454064 (1995-09-01), Castelaz
patent: 5548327 (1996-08-01), Gunday et al.
patent: 5633491 (1997-05-01), Kasdan
patent: 5652616 (1997-07-01), Chen et al.
patent: 5712483 (1998-01-01), Boone et al.
patent: 5719954 (1998-02-01), Onda
patent: 5721608 (1998-02-01), Taniguchi
patent: 5727078 (1998-03-01), Chupeau
patent: 5764871 (1998-06-01), Fogel
patent: 5767922 (1998-06-01), Zabih et al.
patent: 5768404 (1998-06-01), Morimura et al.
patent: 5812191 (1998-09-01), Orava et al.
patent: 5819120 (1998-10-01), Hamada et al.
patent: 5861994 (1999-01-01), Kelly
patent: 5864630 (1999-01-01), Cosatto et al.
patent: 5917937 (1999-06-01), Szeliski et al.
patent: 5969760 (1999-10-01), Ernest et al.
patent: 6028672 (2000-02-01), Geng
patent: 6038071 (2000-03-01), Chikazawa
patent: 6115482 (2000-09-01), Sears et al.
patent: 6141036 (2000-10-01), Katayama et al.
patent: 6141434 (2000-10-01), Christian et al.
patent: 6188777 (2001-02-01), Darrell et al.
patent: 6204880 (2001-03-01), Nishimura
patent: 6215898 (2001-04-01), Woodfill et al.
patent: 6456737 (2002-09-01), Woodfill et al.
patent: 6587148 (2003-07-01), Takeda et al.
patent: 6661918 (2003-12-01), Gordon et al.
patent: 6693666 (2004-02-01), Baker et al.
patent: 6807290 (2004-10-01), Liu et al.
patent: 6967678 (2005-11-01), Baker et al.
patent: 7317830 (2008-01-01), Gordon et al.
patent: 7486311 (2009-02-01), Baker et al.
patent: 7567702 (2009-07-01), Woodfill et al.
patent: 2006/0013473 (2006-01-01), Woodfill et al.
patent: 4304529 (1994-06-01), None
patent: 0512403 (1992-11-01), None
patent: 2210530 (1989-06-01), None
patent: 2238576 (1990-09-01), None
patent: 05288532 (1993-11-01), None
patent: 7303207 (1995-11-01), None
U.S. Appl. No. 12/191,891, filed Mar. 14, 2008, Baker et al.
“Spherically Symmetrical Lenses and Associated Equipment for Wide Angle Aerial Photography,” Office of Scientific Research ad Development, National Defense Research Committee, Optical Research Laboratory; Harvard University, Contract No. OEMsr-474, Nov. 30, 1945, 121 pgs.
Appenzeller et al, “A Low-Cost Real-Time Stereo Vision System for Looking at People,” Proc. of IEEE International Symposium on Industrial Electronics, 1997, vol. 3, pp. 767-722.
Baker et al., “Realtime Stereo and Motion Integration for Navigation,” ISPRS Commission III, IC Working Group V/III, Aug. 1994, pp. 17-24.
Gordon et al., “Integrated person tracking using stereo, color and pattern detection,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Jun. 25, 1998, 10 pgs.
Gordon, et al, “Background Estimation and Removal Based on Range and Color,” Interval Research Corporation, 1999, 7 pages.
Hannah, “Computer Matching of Areas in Stereo Images,” Dissertation, Jul. 1974, 100 pgs.
Kanade, et al., “A Stereo Machine for Video-rate Dense Depth Mapping and Its New Applications,” Proceedings of the 15th Computer Vision and Patter Recognition Conference, Jun. 18-20, 1996m San Francisco, 7 pgs.
Kanade, et al., “Development of a Video-Rate Stereo Machine,” Proceedings of the International Robotics and Systems Conference, Aug. 5-9, 1995, Pittsburgh, PA, pp. 95-100.
Kayaalp et al., “A Pipeline Architecture for Near Real-time Stereo Range Detection,” 1007 SPIE Mobile Robots III, 1988, pp. 279-286.
Kim, Sang-Hoon et al, “Facial Region Detection Using Range Color Information,” IEICE Transactions on Information and Systems, JP, Institute of Electronics Information and Comm. Eng. Tokyo, vol. E81-D, No. 9, Sep. 1998, pp. 968-975.
Lewis, “WFOV Star Tracker Camera,” Sensors and Sensor Systems for Guidance and Navigation, 1991, SPIE, vol. 1478, pp. 2-12.
Malassiotis et al, “Coding of video-conference stereo image sequences using 3D models,” Signal Processing: Image Communication, vol. 9, No. 2, Jan. 1997, pp. 125-135, Elsevier Science, Amsterdam, NL.
McDonnell, “Box-Filtering Techniques,” 17 Computer Graphics and Image Processing, 17, 1981. pp. 65-70.
Nickerson, S.B., et al, “The ARK project: Autonomous Mobile Robots for Known Industrial Environments”; Robotics and Autonomous Systems, NL, Elsevier Science Publishers, Amsterdam, vol. 25, No. 1-2, Oct. 1998, pp. 83-104.
Park et al. “Realtime Tracking System for the Wide-Field-of-View Telescope Project,” Acquisition, Tracking, and Pointing, Proceedings of SPIE—The International Society for Optical Engineering, Mar. 27-29, 1989, Orlando Florida, SPIE Series, vol. 1111, 10 pgs.
Taniguchi, et al, “Scene Interpretation by Fusing Intermediate Results of Multiple Visual Sensory Information Processing,” Proc. IEEE International Conference on MFI 1994, Multi-sensor Fusion and Integration for Intelligence Systems, pp. 699-706.
Woodfill, “Motion, Vision and Tracking for Robots in Dynamic, Unstructured Environment,” Dissertation, pp. 10-151, Aug. 1992.
Woodfill, John, “Real-Time Stereo Vision on the PARTS Reconfigurable Computer,” IEEE Symposium on FPGAs for Custom Computing Machines, Apr. 1997, 10 pgs.
Yoshida, “Real-Time Stereo Vision with Multiple Arrayed Camera,” Proceedings of the 1992 IEEE International Conference on Robotics and Automation, Nice, France, May 1992, pp. 1765-1770.
Zabih, et al., “Individual Unknown Objects by Combining Motion and Stereo,” Dissertation, Aug. 1994, 124 pgs.
Zabih, R. and Woodfill, J., “Non-parametric Local Transforms for Computing Visual Correspondence,” Proceedings of the third European conference on Computer Vision, 1994, vol. II, pp. 151-158, Springer-Verlag New York, Inc.
Non-Final Office Action for U
Alkire Robert Dale
Baker Henry Harlyn
Herzen Brian Von
Woodfill John Iselin
Johns Andrew W
Tyzx, Inc.
Van Pelt & Yi & James LLP
LandOfFree
Generation of a disparity result with low latency does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Generation of a disparity result with low latency, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Generation of a disparity result with low latency will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2673110