Method, system and module for multi-modal data fusion

Details Method, system and module for multi-modal data fusion Method, system and module for multi-modal data fusion

2006-12-19

2006-12-19

Chawan, Vijay (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Application

C704S270100

Reexamination Certificate

active

07152033

ABSTRACT:
A method for multi-modal data fusion (100), a multi-modal system data fusion system (10) and module (24) that in use operates by receiving segments (125) of multi-modal data associated respectively with a modalitiy. Initiating (130) a dynamically variable wait period after one of the segments is received is then performed. The dynamically variable wait period has a duration determined from data fusion timing statistics of the system (10). A waiting (140) for reception of any further segments during the dynamically variable wait period is then effected and thereafter a fusing (145) of the segments received provides fused data that is sent (160) to a dialog manager (25).

REFERENCES:
patent: 5748974 (1998-05-01), Johnson
patent: 5781179 (1998-07-01), Nakajima et al.
patent: 6779060 (2004-08-01), Azvine et al.
patent: 6807529 (2004-10-01), Johnson et al.
Wu et al. “Multimodal Integration—A Statistical View”, IEEE Transactions on Multimedia, vol. 1, Issue 4, Dec. 1999, pp. 334-341.
Johnston et al., “MATCH: An Architecture for Multimodal Dialogue Systems”, Proceedings of 40th Annual Meeting of Association of Computational Linguistics (ACL-02), Philadelphia, pp. 376-383.
Article by Oviatt, S.L., DeAngeli, A. and Kuhn, K., titled “Integration and synchronization of input modes during multimodal human-computer interaction” in proceedings of conference on Human Factors in Computing Systems CHI'97 (Mar. 22-27, Atlanta, GA). ACM Press, NY, 1997, 415-422.
Article by Johnston, M., Cohen, P.R., McGee, D., Oviatt, S.L., Pittman, J.A., and Smith, I., titled “Unification based multimodal integration” in proceedings of the 35thAnnual Meeting of the Association of Computational Linguistics, ACL. New York, 1997, 281-288.
Article by Vo, M.T., titled “A Framework and Toolkit for the Construction of Multimodal Learning Interfaces”, Thesis, School of Computer Science, Carnegie Mellon University, Apr. 1998; and.

Affiliated with

Also associated with

Rating

Method, system and module for multi-modal data fusion does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method, system and module for multi-modal data fusion, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method, system and module for multi-modal data fusion will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3696682