Computer graphics processing and selective visual display system – Computer graphics processing – Animation
Reexamination Certificate
2001-01-05
2003-11-11
Padmanabhan, Mano (Department: 2671)
Computer graphics processing and selective visual display system
Computer graphics processing
Animation
C345S474000
Reexamination Certificate
active
06646643
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates generally to a method and apparatus for interfacing locomotive 3D movements of a user to a reference in a virtual or remote environment, and more particularly to such a method and apparatus where a gestural pace made by a user is sensed and used to move the reference in accordance with the extent, direction, and timing of the gestural pace.
A virtual environment is an array of sensory cues generated in response to a user's actions that gives the user the impression of dealing directly with a three dimensional model. Typically either a head mounted display or a surround screen display is used to present a dynamic perspective image of the visual environment as the user moves within it. The virtual environment may be synthetically generated within a computer or may involve sensory input from a remote physical location (as in tele-operations). Virtual locomotion is movement over long distances in a virtual environment which is controlled by a user remaining within a relatively small physical space.
Virtual locomotion can be used for a variety of purposes, such as: training or rehearsal in executing skills, tasks, strategies and navigation that involve moving through an environment on foot; planning activities that involve moving through a target environment; evaluating the ergonomics or aesthetics of structures designed for human habitation, or of devices intended for mobile operation; piloting remote surface vehicles; communications between people at different locations when they want to relate to each other in a way that involves locomotion; and entertainment experiences that involve moving through a virtual environment. Particular applications would include training people to perform hazardous tasks without risking bodily harm or to train soldiers in combat simulators where the soldier interacts directly with the surrounding environment which includes other members of a team.
Head based steering is widely used in virtual environment systems. It is economical because the same position tracker used to determine the user's field of view is also used to control the direction of motion. Head based steering also encourages the user to look where they are going, and the hands are free for manipulation. However, looking and moving are no longer independent, so that the user cannot turn their head to look to the side while moving without altering their path. This makes it difficult to move to a desired position in the virtual environment.
Hand based steering techniques are also widely used and determine direction either from where the arm is pointed, from where a hand-grip is pointed, or from where a finger is pointed. Hand based steering thus frees the head for looking and allows the user to move sideways relative to the head or body. However, the control mechanism interferes with manipulation, so that the hand cannot be used for other, more normal tasks. In addition, the user must remain aware of the significance of where the hand is pointed at all times.
Torso based steering frees the head for looking and the hands for manipulation, but it does not support sidestepping. While a user will typically move in the direction that the front of the torso is pointing, sometimes this is not the case. For example, a soldier aiming a rifle across his chest may prefer to advance in the direction that he is aiming.
Another steering technique is lean based steering, which has three approaches: tilting of the upper torso, shifting of weight relative to the feet, and shifting of weight relative to a platform. All three approaches provide hands-free operation and can support sidestepping. However, the tilting of the torso approach precludes the user tilting for other purposes. The shifting of weight approach, where weight is shifted relative to the feet, is of limited use because a user cannot pace to turn.
The shifting of weight relative to a platform approach is controlled by moving the body of the user locally, relative to a central neutral position. However, when using a head-mounted display, the user easily loses track of where he stands with respect to the neutral position although the direction and rate of optical flow provides one indication of where the user is situated. A set of elastic straps attached to a ring around the user's waist gives haptic feedback, pushing the user back towards the neutral position. However, with the directional coordinate frame relative to a fixed external point in space, this is an unnatural condition that makes turning of the body and controlling the direction of motion even more independent than they are with natural locomotion. For example, the user may choose to move in one direction and then turn to face in another, making it as easy to move backwards as forwards. This approach is also incompatible with physical locomotion because velocity is controlled by the relative position of the body.
Speed of movement in a virtual environment can be controlled by using finger pressure for hand based systems, by the degree of leaning for lean based systems, by the rate at which a user paces in place, or by the degree of leg movement when the user paces in place. Often a pair of binary switches attached to a hand control are used to invoke either forward or backward virtual motion. This widely used technique is easy and inexpensive to implement. The use of such hand controls is advantageous as they work independently of head, torso and leg movements, and are thus compatible with a wide range of physical motions. However, use of hand controls for speed interferes with use of the fingers for manipulative tasks which are becoming more desired and common, especially in combat systems where the user needs to hold and aim a weapon. Another disadvantage is that when head-mounted displays are used, the user cannot see his hands or how the fingers touch the buttons, limiting the number of buttons the user can deal with.
Another speed control system was based on detecting the gesture of walking in place. A six degree of freedom magnetic sensor was attached to a head mounted display in order to track the user's head motion so that a computer could recognize walking in place versus other activity such as turning one's head or bending at the waist. Head based steering was also used so that the head tracker fully controlled virtual locomotion. While useful, this system did not allow a user to walk in one direction and look in another direction.
A number of mechanical systems have also been disclosed. One such system uses the sliding motion of the feet to indicate walking. In this system, the user wears sandals with low friction film on the middle of their sole and a rubber brake pad at the toe. The user thus glides on a low friction surface by pushing their waist against a hoop that surrounds the user and sliding his feet. A position sensor attached to each ankle and contact sensors on the bottom of each foot allow the system to recognize the length and direction of each pace and hence to specify movement in the virtual environment. However, the placement of a hoop at waist level does not allow a user to hold an object such as a rifle by their side.
Another mechanical system utilizes an omni-directional treadmill and allows the user to walk in any direction. The treadmill consists of a pair of conveyor belts nested one insider the other, with each belt mounted horizontally and perpendicular to each other. The outer belt has rollers so that it can transmit the motion produced by the inner belt, so that motion in any horizontal direction can be made. An associated control is used to keep the user centered in the middle of the platform. This system allows a user to walk in a straight line in any direction and to accelerate in that direction. However, turning while accelerating can lead to a misalignment between the user's direction of translation and the centering motion of the controller, causing a loss of balance. Even turning in place can be difficult because the controller registers the motion a
Karasek John J.
Legg Lawrence G.
Padmanabhan Mano
The United States of America as represented by the Secretary of
LandOfFree
User control of simulated locomotion does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with User control of simulated locomotion, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and User control of simulated locomotion will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3137066