Management of speech and audio prompts in multimodal interfaces

Details Management of speech and audio prompts in multimodal interfaces Management of speech and audio prompts in multimodal interfaces

1998-04-21

2000-01-04

Hudspeth, David R.

Data processing: speech signal processing, linguistics, language

Speech signal processing

Application

704270, G10L 500

Patent

active

060120304

ABSTRACT:
Management of speech and audio prompts, and interface presence, in multimodal user interfaces is provided. A communications device having a multimodal user interface including a speech interface, and a non-speech interface, e.g. a graphical or tactile user interface, comprises means for dynamically switching between a background state of the speech interface and a foreground state of the speech interface in accordance with a users input modality choice. Preferably, in the foreground state speech prompts and speech based error recovery are fully implemented and in a background state speech prompts are replaced by earcons, and no speech based error recovery is implemented. Thus there is provided a device which automatically subdue the speech prompts when a user selects a non-speech input/output mechanism. Also provided is a method for dynamic adjustment of audio prompts and speech prompts by switching from a foreground state to a background state of a speech interface in response to a users current interaction modality, by selecting alternative states for speech and audio interfaces that represent users needs for speech prompts. This type of system and method is particularly useful and applicable to hand held Internet access communication devices.

REFERENCES:
patent: 5632002 (1997-05-01), Hashimoto et al.
Jian Wang, et al. "Integration of Eye-gaze, Voice and Manual Reponsse in Multimodal User Interface," Proc. IEEE ICSMC, vol.5, pp. 3938-3942, Oct. 1995.
M. Billinghurst, et al. "Adding Intelligence to the Interface," Proc. IEEE VRAIS '96, pp. 168-175, Mar. 1996.
Rajeev Sharma, et al. "Toward Multimodal Human-Computer Interface," Proc. IEEE, vol. 86, No. 5, pp. 853-869, May 1998.
Ben Salem, et al. "Current Trends In Multimodal Input Recognition," Proc. IEE CVRPMPA (Ref. No. 1998/454). pp. 3/1-3/6, Oct. 1998.

Affiliated with

Also associated with

Rating

Management of speech and audio prompts in multimodal interfaces does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Management of speech and audio prompts in multimodal interfaces, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Management of speech and audio prompts in multimodal interfaces will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1080195