Systems and methods for extracting meaning from multimodal...

Details Systems and methods for extracting meaning from multimodal... Systems and methods for extracting meaning from multimodal...

2005-03-15

2005-03-15

{hacek over (S)}mits, Tālivaldis Ivars (Department: 2654)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Recognition

C704S251000, C345S215000

Reexamination Certificate

active

06868383

ABSTRACT:
Multimodal utterances contain a number of different modes. These modes can include speech, gestures, and pen, haptic, and gaze inputs, and the like. This invention use recognition results from one or more of these modes to provide compensation to the recognition process of one or more other ones of these modes. In various exemplary embodiments, a multimodal recognition system inputs one or more recognition lattices from one or more of these modes, and generates one or more models to be used by one or more mode recognizers to recognize the one or more other modes. In one exemplary embodiment, a gesture recognizer inputs a gesture input and outputs a gesture recognition lattice to a multimodal parser. The multimodal parser generates a language model and outputs it to an automatic speech recognition system, which uses the received language model to recognize the speech input that corresponds to the recognized gesture input.

REFERENCES:
patent: 5502774 (1996-03-01), Bellegarda et al.
patent: 5600765 (1997-02-01), Ando et al.
patent: 5677993 (1997-10-01), Ohga et al.
patent: 5748974 (1998-05-01), Johnson
patent: 5884249 (1999-03-01), Namba et al.
patent: 6529863 (2003-03-01), Ball et al.
Bangalore et al., Finite-State Multimodal Parsing and Understanding, Jul. 31, 2000—Aug. 4, 2000, International Conference of Computer Linguistics.*
Bangalore et al., Integrating Multimodal Language Processing with Speech Recognition, Oct. 2000, Proceeding of International Conference on Spoken Language Processing.*
Johnston et al., Unification-based Multimodal Integration, 1997, Proceeding of the 35thAnnual Meeting of the Association for Compuatational Lingustics.*
Johnston, M. Unification-based Multimodal Parsing, 1998, In Proceedings of the 17thInternational Conference on Computational Linguistics and 36thAnnual Meeting of the Association for Computational Linguistics, pp. 624-630.*
Johnston, M., Deixis and Conjunction in Multimodal Systems, 2000, Proceedings of Coling-2000.

Affiliated with

Also associated with

Rating

Systems and methods for extracting meaning from multimodal... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Systems and methods for extracting meaning from multimodal..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Systems and methods for extracting meaning from multimodal... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3448699