Image analysis – Applications – Biomedical applications
Reexamination Certificate
2001-03-21
2003-06-03
Patel, Jayanti K. (Department: 2625)
Image analysis
Applications
Biomedical applications
C600S101000, C600S102000, C600S103000, C600S104000
Reexamination Certificate
active
06574355
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention relates to telemanipulation using telepresence, and more particularly to applications of telemanipulation to laparoscopic surgery.
A telemanipulation system allows an operator to manipulate objects located in a workspace from a remote control operator's station. For example, in a laparoscopic abdominal surgery procedure, the patient's abdomen is insufflated with gas, and cannulas are passed through small incisions to provide entry ports for laparoscopic surgical instruments. Laparoscopic surgical instruments include an image capture means for viewing the surgical field and working tools, such as forceps or scissors. The working tools are similar to those used in open surgery, except that the working end of each tool is separated from its handle by an extension tube. The surgeon performs surgery by sliding the instruments through the cannulas and manipulating them inside the abdomen while referencing a displayed image of the interior of the abdomen. Surgery by telepresence, that is, from a remote location by means of remote control of the surgical instruments, is a next step. A surgeon is ideally able to perform surgery through telepresence, which, unlike other techniques of remote manipulation, gives the surgeon the feeling that he is in direct control of the instruments, even though he only has remote control of the instruments and view via the displayed image.
The effectiveness of telepresence derives in great measure from the illusion that the remote manipulators are perceived by the operator of the system to be emerging from the hand control devices located at the remote operator's station. If the image capture means, such as a camera or laparoscope, are placed in a position with respect to the manipulators that differs significantly from the anthropomorphic relationship of the eyes and hands, the manipulators will appear to be located away from the operator's hand controls. This will cause the manipulators to move in an awkward manner relative to the viewing position, inhibiting the operator's ability to control them with dexterity and rapidity. However, it is often unavoidable in applications such as laparoscopic surgery to move the laparoscope in order to obtain the best possible image of the abdominal cavity.
Thus, a technique is needed for providing to the operator the sense of direct hand control of the remote manipulator, even in the presence of a substantially displaced imaging device, such that the operator feels as if he is viewing the workspace in true presence.
BRIEF SUMMARY OF THE INVENTION
According to the invention, in a telemanipulation system for manipulating objects located in a workspace at a remote worksite by an operator at an operator's station, such as in a remote surgical system, the remote worksite having a manipulator or pair of manipulators each with an end effector for manipulating an object at the workspace, such as a body cavity, a controller including a hand control at the control operator's station for remote control of the manipulators, an image capture means, such as a camera, for capturing in real-time an image of the workspace, and image producing means for reproducing a viewable image with sufficient feedback to give the appearance to the control operator of real-time control over the object at the workspace, the improvement wherein means are provided for sensing position of the image capture means relative to the end effector and means are provided for transforming the viewable real-time image into a perspective image with correlated manipulation of the end effector by the hand control means such that the operator can manipulate the end effector and the manipulator as if viewing the workspace in substantially true presence. By true presence, it is meant that the presentation of an image is a true perspective image simulating the viewpoint of an operator. Image transformation according to the invention includes rotation, translation and perspective correction.
The invention will be better understood by reference to the following detailed description in connection with the accompanying drawings.
REFERENCES:
patent: 4853874 (1989-08-01), Iwamoto et al.
patent: 5046022 (1991-09-01), Conway et al.
patent: 5182641 (1993-01-01), Diner et al.
patent: 5305203 (1994-04-01), Raab
patent: 5313306 (1994-05-01), Kuban et al.
patent: 5339799 (1994-08-01), Kami et al.
patent: 5368015 (1994-11-01), Wilk
patent: 5417210 (1995-05-01), Funda et al.
patent: 5597146 (1997-01-01), Putman
patent: 5630431 (1997-05-01), Taylor
patent: 5696837 (1997-12-01), Green
patent: 5697939 (1997-12-01), Kubota et al.
patent: 5754741 (1998-05-01), Wang et al.
patent: 5762458 (1998-06-01), Wang et al.
patent: 5808665 (1998-09-01), Green
patent: 5817084 (1998-10-01), Jensen
patent: 5855553 (1999-01-01), Tajima et al.
patent: 5855583 (1999-01-01), Wang et al.
patent: 5876325 (1999-03-01), Mizuno et al.
patent: 5907664 (1999-05-01), Wang et al.
patent: 6246200 (2001-06-01), Blumenkranz et al.
patent: 6259806 (2001-07-01), Green
patent: 291 965 (1988-11-01), None
patent: 323 681 (1989-07-01), None
patent: 411 498 (1991-02-01), None
patent: 2 128 842 (1984-05-01), None
patent: WO 93/05479 (1993-03-01), None
patent: WO 95/01757 (1995-01-01), None
Alexander, III,Proc. of the 1.sup.st CISM-ITOMM Symposium, held Sep. 5-8, 1973, Springer-Verlag. Wien-New York. Impacts of Telemation on Modern Society.
Askew et al., “Ground Control Tesbed for Space Station Freedom Robot Manipulators,”Proc. Virtual Reality Annual International Symp., by Institute of Electrical and Electronics Engineers, pp. 69-75, held Sep. 18-22, 1993 in Seattle, WA.
Bajura et al., “Merging virtual objects with the real world: Seeing ultrasound imagery within the patient,”Computer Graphics, 26(2):203-210 (1992).
Bergamasco et al.,Advanced Interfaces for Teleoperated Biomedical Robots, Jun. 1989.
Christensen et al., “Model Based, Sensor Directed Remediation of Underground Storage Tanks,”Proc. of Int. Conf. of Robotics and Automation, by Institute of Electrical and Electronics Engineers, 2:1377-1383, held Apr. 9-11, 1991 in Sacramento, CA.
DAS et al., “Kinematic Control and Visual Display of Redundant Teleoperators,”Proc. of Int. Conf. of systems, Man and Cybernetics, pp. 1072-1077, held Nov. 14-17, 1989 in Cambridge, MA.
Gayed et al., “An advanced control surgical micromanipulator for surgical applications,”Systems Science,13(1-2):123-134 (1987).
Hayati et al., “Remote Surface Inspection System,”Robotics and Autonomous Systems, 11(1):45-59 (1993), Amsterdam, NL.
Hunter et al., “Opthalmic microsurgical robot and associated virtual environment,”Comput. Biol. Med., 25(2):173-182 (1995).
Hunter et al., “A teleoperated microsurgical robot and associated virtual environment for eye surgery,”Presence: Teleoperators and Virtual Environments, 2(4):265-280 (1994).
Kim et al., “A helmut mounted display for telerobotics,”IEEE, pp. 543-547 (1988).
NASA Tech Briefs, Circle Reader Actiuon No. 480 (1991), Anthropomorphic Remote Manipulator.
Preising et al., “A literature review: Robots in medicine,”IEEE Engineering in Medicine and Biology, pp. 13-22 (1991).
Taubes et al., “Surgery in cyberspace,”Discover, pp. 85-92 (1994).
Toon, “Virtual Reality for Eye Surgery,”Research Horizons, pp. 22-23 (1993).
Trivedi et al., “Developing Telerobotic Systems Using Virtual Reality Concepts,”Proc. of 1993 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 352-359, held Jul. 26-30, 1993 in Yokohama Japan.
Tsai et al., “A new technique for fully autonomous and efficient #D robotics hand-eye calibration,”.
Barrish, Esq. Mark D.
Intuitive Surigical, Inc.
Patel Jayanti K.
Tabatabai Abolfazl
Townsend Townsend & CrewLLP
LandOfFree
Method and apparatus for transforming coordinate systems in... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for transforming coordinate systems in..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for transforming coordinate systems in... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3134971