Data processing: generic control systems or specific application – Specific application – apparatus or process – Mechanical control system
Reexamination Certificate
2003-03-03
2004-09-07
Paladini, Albert W. (Department: 2125)
Data processing: generic control systems or specific application
Specific application, apparatus or process
Mechanical control system
C600S101000, C600S118000, C901S041000
Reexamination Certificate
active
06788999
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to teleoperator method and apparatus, and particularly to those which include means for providing the operator of remote apparatus with the same sense as working directly with his hands at the worksite.
BACKGROUND OF THE INVENTION
Teleoperating, which is well known, includes the human performance of tasks at a remote location using manipulators. Telepresense includes providing the teleoperator with the same feedback and control that he would have were he actually at the worksite carrying out the operation with his own hands. Telepresence operation generally includes use of a stationary visual display, particularly a stereographic visual display of the remote workspace. Stereoscopic television systems are well known as shown, for example, in U.S. Pat. Nos. 4,562,463 and 4,583,117 and in U.K. Patent Application GB 2,040,134.
Remote manipulators employing stereoscopic TV viewing together with force feedback also are well known as shown, for example, in an article entitled, “
Controlling Remote Manipulators Through Kinesthetic Coupling
,” Bejczy et al,
Computers in Mechanical Engineering
, July 1983, pps. 48-60, and in an article entitled, “
Stereo Advantage for a Peg-In-Hole Task Using a Force-Feedback Manipulator
” by E. H. Spain,
SPIE
Vol. 1256 Stereoscopic Displays and Applications, 1990, pps. 244-254. In the Bejczy et al. article, force-torque feedback is disclosed. Also, in U.S. Pat. No. 3,921,445, a manipulator which includes force, torque and slip sensors of a type which may be employed with the present invention is shown.
Even though the operator of prior art manipulators is provided with a stationary three-dimensional image of the workspace, and manual controllers for control of the manipulators are provided with feedback, the operator is not provided with a sense of actually being present at the worksite. The present invention is directed to a viewing arrangement for use in a remote manipulation system which substantially adds to the operator's sense of presence at the remote manipulator site.
BRIEF SUMMARY OF THE INVENTION
An object of this invention is the provision of an improved teleoperator system and method which include an improved viewing system to enhance the operator's sense of presence at remote manipulators controlled by the operator from a remote location.
An object of this invention is the provision of an improved teleoperator system and method of the above-mentioned type wherein an image of manipulator end effectors for viewing by the operator are sensed by the operator as comprising an integral part of hand-controllers used by the operator to control the end effectors, thereby giving the operator a strong sense of presence at the worksite.
An object of this invention is the provision of an improved teleoperator system and method of the above-mentioned type which is well adapted for use in a wide variety of applications including military, industrial, biomedical, and the like.
The present invention includes manipulators located at a worksite and which are controlled by hand-operated means at a remote operator control station. End effectors at the manipulators are used for manipulating objects located in a workspace at the worksite, and force-torque feedback is employed for transmitting back to the operator mechanical resistance encountered by the end effectors. Stereographic visual display means provide the operator with an image of the workspace. In accordance with the present invention, the image is located adjacent the hand-operated means so that the operator looks in the direction of the hand-operated means for viewing the image adjacent the hand-operated means. Either a real or virtual image of the workspace may be provided adjacent the hand-operated means. Display means for display of a real image may be located adjacent the hand-operated means for direct viewing of the real image by the operator. For display of a virtual image of the workspace, a mirror is located between the operator's eyes and the hand-operated means. In this case, display means provide a real image which is inverted from top to bottom, which inverted image is viewed via the mirror, which mirror inverts the image and provides the operator with a virtual image of the workspace, which appears to be located adjacent the hand-operated means. By locating the image of the workspace adjacent the hand-operated means the operator is provided with a sense that the end effectors and hand-operated means are substantially integral despite the fact the end effectors are located at the worksite and the hand-operated means are located at the remote operator's station. A stereophonic sound system may be included to provide the operator with stereophonic sound from the worksite. Video camera means are provided for viewing the workspace from which an image of the workspace is obtained. Various other sensors and associated responders may be located at the worksite and operator's station, respectively, for transmission of pressure, tactile, heat, vibration and similar information for enhanced telepresence operation.
Depending upon the application, different scaling may be provided in the transmission of information between the operator's station and worksite. For example, for microassembly, microsurgery and like operations involving small part manipulation, optical and/or video magnification may be employed to provide an enlarged 3-dimensional image for viewing by the operator. With similar scaling between the hand operated means and manipulators, the perception of the operator is substantially that which a miniature operator would have were he at the worksite.
REFERENCES:
patent: 1418184 (1922-05-01), Trunick
patent: 2815697 (1957-12-01), Singer
patent: 2901258 (1959-08-01), Brandafl
patent: 3145333 (1964-08-01), Pardini et al.
patent: 3171549 (1965-03-01), Orloff
patent: 3463329 (1969-08-01), Gartner
patent: 3818125 (1974-06-01), Butterfield
patent: 3921445 (1975-11-01), Hill et al.
patent: 3923166 (1975-12-01), Fletcher et al.
patent: 3934201 (1976-01-01), Majefski
patent: 4058001 (1977-11-01), Waxman
patent: 4133115 (1979-01-01), Stockholm
patent: 4150326 (1979-04-01), Engelberger et al.
patent: 4221997 (1980-09-01), Flemming
patent: 4260319 (1981-04-01), Motoda et al.
patent: 4264266 (1981-04-01), Trechsel
patent: 4349837 (1982-09-01), Hinds
patent: 4367998 (1983-01-01), Causer
patent: 4419041 (1983-12-01), Rose
patent: 4436684 (1984-03-01), White
patent: 4456961 (1984-06-01), Price et al.
patent: 4474174 (1984-10-01), Petruzzi
patent: 4490022 (1984-12-01), Reynolds
patent: 4503854 (1985-03-01), Jako
patent: 4506393 (1985-03-01), Murphy
patent: 4510574 (1985-04-01), Guittet et al.
patent: 4517963 (1985-05-01), Michel
patent: 4562463 (1985-12-01), Lipton
patent: 4582067 (1986-04-01), Silverstein
patent: 4583117 (1986-04-01), Lipton et al.
patent: 4601000 (1986-07-01), Montabert
patent: 4636138 (1987-01-01), Gorman
patent: 4638799 (1987-01-01), Moore
patent: 4651201 (1987-03-01), Schoolman
patent: 4655257 (1987-04-01), Iwashita
patent: 4672963 (1987-06-01), Barken
patent: 4676243 (1987-06-01), Clayman
patent: 4722056 (1988-01-01), Roberts et al.
patent: 4728974 (1988-03-01), Nio et al.
patent: 4744363 (1988-05-01), Hasson
patent: 4750475 (1988-06-01), Yoshihashi
patent: 4751925 (1988-06-01), Tontarra
patent: 4762455 (1988-08-01), Coughlan et al.
patent: 4764944 (1988-08-01), Finlayson
patent: 4788482 (1988-11-01), Tachibana et al.
patent: 4791588 (1988-12-01), Onda et al.
patent: 4791934 (1988-12-01), Brunnett
patent: 4794912 (1989-01-01), Lia
patent: 4806066 (1989-02-01), Rhodes et al.
patent: 4808898 (1989-02-01), Pearson
patent: 4815006 (1989-03-01), Andersson et al.
patent: 4826392 (1989-05-01), Hayati
patent: 4833383 (1989-05-01), Skarr et al.
patent: 4837703 (1989-06-01), Kakazu et al.
patent: 4837734 (1989-06-01), Ichikawa et al.
patent: 4853874 (1989-08-01), Iwamoto et al.
patent: 4854301 (1989-08-01), Nakajima
patent: 4855822 (1989-08-01), Narendra et al.
patent: 4860215 (1989-08-01), Seraji
patent
Barrish, Esq. Mark D.
Paladini Albert W.
SRI International, Inc.
Townsend&Townsend&CrewLLP
LandOfFree
Surgical system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Surgical system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Surgical system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3215058