Multi-modal interface apparatus and method

Image analysis – Applications – Personnel identification

Patent

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

345336, 345358, G06K 900

Patent

active

061188883

ABSTRACT:
In the multi-modal interface apparatus of the present invention, a gaze object detection section always detects a user's gaze object. The user inputs at least one medium of sound information, character information, image information and operation information through a media input section. In order to effectively input and output information between the user and the apparatus, a personified image presentation section presents a personified image to the user based on the user's gaze object. A control section controls a reception of the inputted media from the media input section based on the user's gaze object.

REFERENCES:
patent: 4513317 (1985-04-01), Ruoff, Jr.
patent: 4755045 (1988-07-01), Borah et al.
patent: 5008946 (1991-04-01), Ando
patent: 5323470 (1994-06-01), Kara et al.
patent: 5367454 (1994-11-01), Kawamoto et al.
patent: 5454043 (1995-09-01), Freeman
patent: 5566271 (1996-10-01), Tomitsuka et al.
patent: 5731805 (1998-03-01), Tognazzini et al.
patent: 5801704 (1998-09-01), Oohara et al.
patent: 5859642 (1999-01-01), Jones
patent: 5880731 (1999-03-01), Liles et al.
Koons et al.; "Integrating Simultaneous Input From Speech, Gaze, and Hand Gestures", Mark T. Mayburg (Eds), Intelligent Multimedia Interfaces, AAAI Press/The MIT Press, 1993, pp. 257-276.
Boll et al.; "Suppression Of Acoustic Noise In Speech Using Spectral Subtraction", IEEE Transactions on Acoustics, Speech and Signal Processing, vol. ASSP-27, No. 2, Apr. 1979, pp. 113-120.
Cipolla et al. "Uncalibrated Stereo Vision With Pointing For a Man-Machine Interface", MVA '94 IAPR Workshop on Machine Vision Applications, Dec. 13-15, 1994, Kawasaki, pp. 163-166.
Hatfield et al., Principles and Guidelines for the Design of Eye/Voice Interaction Dialogs, IEEE publication, pp. 10-19, Aug. 1996.
Stiefelhagen et al., A Model-Based Gaze Tracking System, IEEE publication, pp. 304-310, Jul. 1996.
Thomas E. Hutchinson, Eye-Gaze Computer Interfaces, IEEE publication, pp. 65-66, Jul. 1993.
Wang et al., Integration of Eye-Gaze, Voice and Manual Response in Multimodal User Interface, IEEE publication, pp. 3938-3942, Jan. 1995.
Colombo et al., Prototype of a Vision-Based Gaze-Driven Man-Machine Interface, IEEE publication, pp. 188-192, Apr. 1995.
Hara et al., Real-Time Facial Interaction Between Human and 3D Face Robot Agent, IEEE publication, pp. 401-409, Sep. 1996.
Maes et al., The Alive System: Full-Body Interaction with Autonomous Agents, IEEE publication, pp. 11-18, Feb. 1995.
Koda et al., Agents with Faces: The Effect of Personification, IEEE publication, pp. 189-194, Sep. 1996.
Mori et al., A Multi-Purpose Dialogue Management System Employing Visual Anthropomorphous Agent, IEEE publication, pp. 187-192, 1995.
Hutchinson et al., Human-Computer Interaction Using Eye-Gaze Input, IEEE publication, pp. 1527-1534, 1989.
Saeyor et al., NURBS-Based Facial Expression Modeling for Anthropomorphic Interface Agent, IEEE publication, pp. 395-400, Sep. 1996.
Hasegawa et al., Realtime Synthesis of Moving Human-Like Agent in Response to User's Moving Image, pp. 39-42, Aug. 1992.
Miyashita et al., A Face to Face Communication using Real-Time media Conversion System, IEEE publication, pp. 543-544, Sep. 1996.
Hasegawa et al., Real-Time Parallel and Cooperative Recognition of Facial Images for an Interactive Visual Human Interface, IEEE publication, pp. 384-387, 1994.
Hiramoto et al., A Speech Dialogue Management System for Human Interface employing Visual Anthropomorphous Agent, IEEE publication, pp. 277-282, Jun. 1994.
Pierre Wellner, The DigitalDesk Calculator: Tangible Manipulation on a Desk Top Display, UIST'91 Conference, pp. 27-33, Nov. 1991.

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Multi-modal interface apparatus and method does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Multi-modal interface apparatus and method, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Multi-modal interface apparatus and method will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-103347

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.