Optics: eye examining – vision testing and correcting – Eye examining or testing instrument – Objective type
Reexamination Certificate
2001-11-08
2003-07-29
Manuel, George (Department: 3737)
Optics: eye examining, vision testing and correcting
Eye examining or testing instrument
Objective type
Reexamination Certificate
active
06598971
ABSTRACT:
BACKGROUND OF INVENTION
1. Field of Invention
Embodiments of the present invention relate to eyetracking systems and methods that compensate for physiological variations in the location of the pupil within the eye.
2. Background Information
Eyetracking has application in many areas of technology, including software applications used to assist those with disabilities, military uses, and space programs. Generally, eyetracking has application in any system where it is desired to know where a user is looking.
In known video eyetracking methods, the angular orientation, or gaze direction, of the eye is measured via analysis of an image of the eye. Typically, the image is made with a camera. Referring to
FIG. 1
, a video camera
4
observes an observer's eye
1
, which is illuminated by a light source
3
. The light source
3
(e.g., an infrared light-emitting diode) illuminates the eye
1
as the viewer looks at a screen
2
.
FIG. 2
illustrates an example of an image of the eye
1
as seen by a camera. The resulting camera image of the eye
1
includes the iris, the pupil
5
(with a center
10
) and a corneal reflection
6
, i.e., a reflection of the light source off the reflective corneal surface of the eye.
Given that the cornea is approximately spherical in shape, the corneal reflection moves continuously across the eye as the eye changes its orientation. Using the Pupil Center Corneal Reflection (PCCR) method, as disclosed in the references U.S. Pat. No. 3,462,604 to K. Mason, Control Apparatus Sensitive to Eye Movement; John Merchant & Richard Morrissette,
A Remote Oculometer Permitting Head Movement
, Report No. AMRL-TR-73-69 (Honeywell Radiation Center 1973); and Laurence R. Young & David Sheena,
Methods
&
Designs: Survey of Eye Movement Recording Methods
, Behavior Research Methods & Instrumentation, Vol. 7(5), 397-429 (1975), the eye's orientation is determined from the relative locations of the pupil center
10
and the corneal reflection
6
within the camera image (see FIG.
2
). It is known that the vertical and horizontal orientation of the eye is directly related to the vector distance between the corneal reflection
6
and the pupil center
10
. For example, as the eye rotates upward, the pupil
5
(and thus the pupil center
10
) moves upward with respect to the corneal reflection
6
, and as the eyeball rotates toward the camera's right, the pupil center
10
moves right with respect to the corneal reflection image.
The corneal reflection is often referred to as the glint spot, and the vector between the glint spot and the pupil center is often referred to as the glint-pupil vector:
v
x
x
pupil
−x
glint
(1a)
v
y
=y
pupil
−y
glint
(1b)
where:
v
x
, v
y
are the horizontal and vertical components of the glint-pupil vector (input variable set)
x
pupil
, y
pupil
are the x,y location of the pupil-center image within the camera frame
x
glint, y
glint
are the x,y location of the corneal-reflection image within the camera frame.
Known eyetracker systems and methods commonly use mathematical equations to predict the eye orientation from the measured glint-pupil vector. A simple example of a known equation to predict the eye orientation is:
Theta
horz
=A
x0
+A
x1
v
x
(2a)
Theta
vert
=A
y0
+A
y1
v
y
(2b)
where:
Theta
horz
, Theta
vert
are the horizontal and vertical angles of the eye orientation, and A
x0
, Ax
1
, A
y0
, A
y1
are the coefficients used in predicting the eye's orientation (calibration parameter set).
The variables from which the eye orientation is computed are commonly referred to as the “input variable set”. In the example of Equations 2a, 2b above, the input variable set consists of the variables (v
x
and v
y
). The coefficients, used to compute the eye orientation from the input variable set, are often referred to as the “calibration parameter set”. In the example of Equations 2a, 2b above, the calibration parameter set consists of the coefficients (A
x0
, Ax
1
, A
y0
, and A
y1
).
Typically, a “calibration procedure” is used to determine optimum values for calibration parameters. One known calibration procedure consists of the user fixating on a sequence of known locations. A set of “raw” data is collected at each calibration point, where the raw data consists of the known gaze directions and a set of measured input data for each of the calibration points. After the raw data for all the calibration points has been collected an optimization procedure, such as a regression analysis, is executed to find optimal values for the calibration parameters, which yield a minimum aggregate error in predicting the known gaze directions for all the calibration points.
Problem Predicting Gaze Direction Accurately
When using the PCCR method to measure the orientation of an eye, it is assumed that the pupil center represents a fixed point within the eyeball structure. A problem exists, however, in that as the iris dilates and constricts, the pupil typically does not open and close completely concentrically about a fixed point on the eye. An exaggerated example of an eye with pupil-center shift is illustrated in FIG.
3
.
FIG. 3
illustrates an example of how two pupils are not concentric; the two pupil centers (
9
,
10
) are at different locations within the eye. Pupil center
9
, the center point of pupil circumference
8
is offset from pupil center
10
, the center point of pupil circumference
7
.
This pupil center shift can be explained as follows: The iris contracts the dilates using two opposing muscles. The sphincter pupillae, oriented circumferentially around the inner edge of the iris, effects contraction by pulling the pupil closed. The dilator pupillae, oriented radially, effects dilation by pulling the pupil open. If the sphincter and/or dilator pupillae do not actuate symmetrically around the pupil, or if there is an imbalance in the counteracting push/pull mechanics of the iris's sphincter and dilator muscles, the pupil center shifts within the eyeball.
A problem exists because of the extent that the pupil-center location varies within an eyeball, the glint pupil vector (as measured within the camera image) will not represent a vector from the corneal reflection to a fixed point on the eyeball, and errors result in the calculation of the eyeball orientation, unless these pupil-center shifts are accommodated.
Typically, human pupils open and close concentrically enough to maintain PCCR eyetracking accuracies of approximately 0.7 degrees (using root mean square error measurement). However, a need exists for a more accurate method for cases where more accurate eyetracking is desired, or for people whose pupil center(s) shift more than normal within the eyeball(s). Accordingly, it is desirable to have methods to measure the image location of a more nearly fixed reference point within the eyeball.
SUMMARY OF THE INVENTION
Embodiments of the invention include a method of using a computer system to determine an eye's pupil-offset from a fixed location on the eyeball as a function of its diameter using an eyetracker system and the pupil-center-corneal reflection method to measure glint-pupil vectors of an observer's eye. Preferably, the observer fixates an eye on one or more given points on a screen and the system is used to measure at least one additional glint-pupil vector of the eye. The system quantifies measured variations in the glint-pupil vector as pupil offsets with respect to a fixed location on the eyeball and codifies them as a function of measured pupil diameters.
Additional embodiments of the invention include a method to determine the orientation of an eye by accommodating for the eye's pupil center shift, comprising the steps of determining the location of the pupil; measuring at least one observable feature of the eye related to the relative location of the pupil within the eyeball; estimating a pupil-location-offset parameter with respect to a fixed point on the eyeball using at least one said mea
LC Technologies Inc.
Manuel George
Shaw Pittman LLP
LandOfFree
Method and system for accommodating pupil non-concentricity... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and system for accommodating pupil non-concentricity..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for accommodating pupil non-concentricity... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3001467