Surgery – Diagnostic testing – Detecting nuclear – electromagnetic – or ultrasonic radiation
Reexamination Certificate
1999-09-03
2002-04-23
Lateef, Marvin M. (Department: 3737)
Surgery
Diagnostic testing
Detecting nuclear, electromagnetic, or ultrasonic radiation
C600S411000, C600S425000, C600S430000, C600S436000, C600S437000, C600S451000, C382S128000, C250S363010, C250S363020, C250S363030, C250S363040, C345S418000, C345S426000
Reexamination Certificate
active
06377833
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates generally to computer input devices, and more particularly provides a system and method for computer input of dynamic mental information such as visual mental imagery.
2. Description of the Background Art
Conventional computer input devices include keyboards, mice, tracker balls, touch sensitive displays and microphones. Each of these input devices translate physical actions by a user into computer instructions. For example, a computer may recognize mouse movement as a computer instruction to move a pointer and may recognize key depression on a keyboard as a computer instruction to generate text.
For physically disabled individuals who cannot control a mouse, type on a keyboard or speak into a microphone, computer input is difficult and potentially impossible. There have been several studies into the use of bioelectrical activity in the brain to control a pointer device. An article by John Charles, entitled “Neural Interfaces Link the Mind and the Machine,” indicates that, by recognizing particular electrical biosignals such as electroencephalograph (EEG), electrooculograph (EOG) and electromyograph (EMG), it is possible to move a computer pointer. However, this technique does not enable computer input of text, images, sound, body movement or other sensory information to a computer.
Therefore, a system and method enabling computer input of dynamic mental information are needed.
SUMMARY OF THE INVENTION
Images on the retina are geometric mappings (projections) of what a person sees. These images are carried to a region in the visual cortex commonly referred to as the V
1
region (or the primary visual cortex). The V
1
region is retinotopically mapped, i.e., the physical locations of the activated neurons in the V
1
region are a geometric mapping (homeomorphism) of the image on the retina. The image in the V
1
region can be and has been read by using brain-scanning instruments such as functional magnetic resonance imaging (functional MRI) or positron emission tomography (PET). Neurons then carry the signals out of the V
1
region and into deeper regions of the brain, which are not geometrically mapped. It has been recently recognized that there is feedback from those deeper regions back to the V
1
region. It has also been recently recognized that this feedback includes images generated by the imagination. Accordingly, a system embodying the present invention reads these feedback signals to obtain and interpret this dynamic mental imagery as computer input.
It will be appreciated that other brain regions (e.g., the auditory cortex, the somatosensory cortex, etc.) may similarly provide physiological responses to other actual sensory information (e.g., sounds and voices, body movement, etc.) and may similarly receive feedback to other imagined sensory information (e.g., imagined sounds and voices, imagined body movement, etc.). Preferably, the other brain regions are large enough to distinguish content, are mapped according to a continuous sensory quantity, and receive feedback corresponding to that quantity. Accordingly, all sensory modalities could be used together to control a virtual reality system.
The system of the present invention calibrates a user's brain region (e.g., the primary visual cortex or V
1
region) to actual sensory information (e.g., the visual field), and enables imagined sensory information (e.g., dynamic mental imagery) to be interpreted as computer input. The system comprises a configuration engine and an input device control engine. The configuration engine includes a test pattern; a functional information gatherer for presenting the test pattern to a user; a brain-scanning device interface for obtaining functional information from a region in the user's brain that provides a physiological response to the test pattern and that receives feedback corresponding to imagined sensory information; and a mapping engine for using the functional information to map the user's brain region to the test pattern. The input device control engine includes a brain-scanning device interface for obtaining functional information from a brain region that provides a physiological response to actual sensory information and that receives feedback corresponding to imagined sensory information; an interpretation engine for interpreting the feedback; and a computer control engine for using the interpreted feedback as computer input.
The present invention further provides a method for calibrating a user's brain region to actual sensory information, and enables imagined sensory information to be interpreted as computer input. The method comprises a configuration process and a computer input process. The configuration process includes presenting a test pattern to a user; obtaining functional information from a region in the user's brain that provides a physiological response to the test pattern and that receives feedback corresponding to imagined sensory information; and using the functional information to map the user's brain region to the test pattern. The computer input process includes obtaining functional information from a brain region that provides a physiological response to actual sensory information and that receives feedback corresponding to imagined sensory information; interpreting the feedback; and using the interpreted feedback as computer input.
The system and method of the present invention may advantageously enable computer input of imagined sensory information such as imagined images, imagined sounds, imagined body movements, etc. Accordingly, an individual unable to manipulate conventional computer input devices may be able to control a computer using only thoughts and imagination. Further, computer input of imagined sensory information may be faster than traditional computer input. Still further, since computer input is effected via the imagination, drawing ability is not as crucial.
REFERENCES:
patent: 4649482 (1987-03-01), Raviv et al.
patent: 4736751 (1988-04-01), Gevins et al.
patent: 5137027 (1992-08-01), Rosenfeld
patent: 5331969 (1994-07-01), Silberstein
patent: 5447166 (1995-09-01), Gevins
patent: 5450855 (1995-09-01), Rosenfeld
patent: 6104943 (2000-08-01), Frederick et al.
B.R. Rosen et al., “Event-related functional MRI: Past, present, and future,” The National Academy of Sciences, vol. 95, Feb. 1998, pp. 773-780.
G.H. Glover, “Deconvolution of Impulse Response In Event-Related BOLD fMRI1, ” Academic Press, Aug. 19, 1998, pp. 416-429, url: http://www.idealibrary.com.
M.E. Raichle, “Behind the scenes of functional brain imaging: A historical and physiological perspective,” The National Academy of Sciences, vol. 95, Feb. 1998, pp. 765-772.
R.B.H. Tootell et al., “Functional analysis of primary visual cortex (V1) in humans,” The National Academy of Sciences, vol. 95, Feb. 1998, pp. 811-817.
B.B. Forster et al., “Functional magnetic resonance imaging: the basics of blood-oxygen-level dependent (BOLD) imaging,” Canadian Association of Radiologists, vol. 49, No. 5, Oct. 1998, pp. 320-329.
W. Chen et al., “Human primary visual cortex and lateral geniculate nucleus activation during visual imagery,” NeuroReport 9, vol. 9, no 16, Nov. 16, 1998, pp. 3669-3674.
B.A. Wandell, “Computational Neuroimaging Of Human Visual Cortex,” Annual Reviews, Neuroscience, 1999, pp. 145-173.
H. Muller et al., “Spatial Interpolants for Wraping,” Academic Press, Chapter 12, 1999, pp. 199-220.
E. Mullet et al., “Reopening the Mental Imagery Debate: Lessons from Functional Anatomy,” Academic Press, Neuroimage 8, Article No. NI980355, 1998, pp. 129-139.
G. Wolberg,“Image Resampling,” Digital Image Warping, Chapter 5, 1990, pp. 150-161.
G. Wolberg, “Scanline Algorithms,” Digital Image Warping, Chapter 7, 1990, pp. 187-260.
G. Wolberg, “Separable Image Warping With Spatial Lookup Tables,” Computer Graphics, vol. 23, No. 3, Jul. 1989, pp. 369-378.
K.M. Fant, “A Nonaliasing, Real-Time Spatial Transform Technique,” IEEE CG & A, Jan. 1986, pp. 71-80.
J. Charles, “Neural Interfaces
Lateef Marvin M.
Lin Jeoyuh
Squire Sanders & Dempsey L.L.P.
LandOfFree
System and method for computer input of dynamic mental... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for computer input of dynamic mental..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for computer input of dynamic mental... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2852224