Method and apparatus for multi-sensory speech enhancement

Details Method and apparatus for multi-sensory speech enhancement Method and apparatus for multi-sensory speech enhancement

2003-11-26

2008-11-04

Smits, Talivaldis Ivars (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

For storage or transmission

C704S226000, C381S071100

Reexamination Certificate

active

07447630

ABSTRACT:
A method and system use an alternative sensor signal received from a sensor other than an air conduction microphone to estimate a clean speech value. The estimation uses either the alternative sensor signal alone, or in conjunction with the air conduction microphone signal. The clean speech value is estimated without using a model trained from noisy training data collected from an air conduction microphone. Under one embodiment, correction vectors are added to a vector formed from the alternative sensor signal in order to form a filter, which is applied to the air conductive microphone signal to produce the clean speech estimate. In other embodiments, the pitch of a speech signal is determined from the alternative sensor signal and is used to decompose an air conduction microphone signal. The decomposed signal is then used to determine a clean signal estimate.

REFERENCES:
patent: 3383466 (1968-05-01), Hilix et al.
patent: 3746789 (1973-07-01), Alcivar
patent: 3787641 (1974-01-01), Santori
patent: 4382164 (1983-05-01), May, Jr.
patent: 4769845 (1988-09-01), Nakamura
patent: 5054079 (1991-10-01), Frielingsdorf et al.
patent: 5151944 (1992-09-01), Yamamura
patent: 5197091 (1993-03-01), Takagi et al.
patent: 5241692 (1993-08-01), Harrison et al.
patent: 5295193 (1994-03-01), Ono
patent: 5404577 (1995-04-01), Zuckerman et al.
patent: 5446789 (1995-08-01), Loy et al.
patent: H1497 (1995-10-01), Marshall
patent: 5555449 (1996-09-01), Kim
patent: 5590241 (1996-12-01), Park et al.
patent: 5647834 (1997-07-01), Ron
patent: 5692059 (1997-11-01), Kruger
patent: 5701390 (1997-12-01), Griffin et al.
patent: 5757934 (1998-05-01), Yokoi
patent: 5812970 (1998-09-01), Chan et al.
patent: 5828768 (1998-10-01), Eatwell et al.
patent: 5933506 (1999-08-01), Aoki et al.
patent: 5943627 (1999-08-01), Kim et al.
patent: 5983073 (1999-11-01), Ditzik
patent: 5983186 (1999-11-01), Miyazawa et al.
patent: 6006175 (1999-12-01), Holzrichter
patent: 6028556 (2000-02-01), Shiraki
patent: 6029128 (2000-02-01), Jarvinen et al.
patent: 6052464 (2000-04-01), Harris et al.
patent: 6052567 (2000-04-01), Ito et al.
patent: 6094492 (2000-07-01), Boesen
patent: 6125284 (2000-09-01), Moore et al.
patent: 6137883 (2000-10-01), Kaschke et al.
patent: 6151397 (2000-11-01), Jackson et al.
patent: 6175633 (2001-01-01), Morrill et al.
patent: 6243596 (2001-06-01), Kikinis
patent: 6266422 (2001-07-01), Ikeda
patent: 6289309 (2001-09-01), deVries
patent: 6292674 (2001-09-01), Davis
patent: 6308062 (2001-10-01), Chien et al.
patent: 6339706 (2002-01-01), Tillgren et al.
patent: 6343269 (2002-01-01), Harada et al.
patent: 6377919 (2002-04-01), Burnett et al.
patent: 6389391 (2002-05-01), Terauchi
patent: 6408081 (2002-06-01), Boesen
patent: 6434239 (2002-08-01), DeLuca
patent: 6542721 (2003-04-01), Boesen
patent: 6560468 (2003-05-01), Boesen
patent: 6590651 (2003-07-01), Bambot et al.
patent: 6594629 (2003-07-01), Basu et al.
patent: 6664713 (2003-12-01), Boesen
patent: 6675027 (2004-01-01), Huang
patent: 6707921 (2004-03-01), Moore
patent: 6717991 (2004-04-01), Gustafsson et al.
patent: 6738485 (2004-05-01), Boesen
patent: 6754358 (2004-06-01), Boesen et al.
patent: 6754623 (2004-06-01), Deligne et al.
patent: 6760600 (2004-07-01), Nickum
patent: 6879952 (2005-04-01), Acero et al.
patent: 6959276 (2005-10-01), Droppo et al.
patent: 7054423 (2006-05-01), Nebiker et al.
patent: 7110944 (2006-09-01), Balan et al.
patent: 7117148 (2006-10-01), Droppo et al.
patent: 7181390 (2007-02-01), Droppo et al.
patent: 7190797 (2007-03-01), Johnston et al.
patent: 2001/0018655 (2001-08-01), Yeldener
patent: 2001/0027121 (2001-10-01), Boesen
patent: 2002/0035470 (2002-03-01), Gao
patent: 2002/0039425 (2002-04-01), Burnett et al.
patent: 2002/0057810 (2002-05-01), Boesen
patent: 2002/0068537 (2002-06-01), Shim et al.
patent: 2002/0075306 (2002-06-01), Thompson et al.
patent: 2002/0114472 (2002-08-01), Lee et al.
patent: 2002/0118852 (2002-08-01), Boesen
patent: 2002/0173953 (2002-11-01), Frey et al.
patent: 2002/0181669 (2002-12-01), Takatori et al.
patent: 2002/0196955 (2002-12-01), Boesen
patent: 2002/0198021 (2002-12-01), Boesen
patent: 2003/0061037 (2003-03-01), Droppo et al.
patent: 2003/0083112 (2003-05-01), Fukuda
patent: 2003/0097254 (2003-05-01), Holzrichter et al.
patent: 2003/0125081 (2003-07-01), Boesen
patent: 2003/0144844 (2003-07-01), Colmenarez et al.
patent: 2003/0179888 (2003-09-01), Burnett et al.
patent: 2003/0220786 (2003-11-01), Chandran et al.
patent: 2004/0028154 (2004-02-01), Yellin et al.
patent: 2004/0086137 (2004-05-01), Yu et al.
patent: 2004/0092297 (2004-05-01), Huang
patent: 2004/0186710 (2004-09-01), Yang
patent: 2004/0249633 (2004-12-01), Asseily et al.
patent: 2005/0038659 (2005-02-01), Helbing
patent: 2005/0049857 (2005-03-01), Seltzer et al.
patent: 2006/0008256 (2006-01-01), Khedouri et al.
patent: 2006/0009156 (2006-01-01), Hayes et al.
patent: 2006/0072767 (2006-04-01), Zhang et al.
patent: 2006/0079291 (2006-04-01), Granovetter et al.
patent: 199 17 169 (2000-11-01), None
patent: 0 720 338 (1996-07-01), None
patent: 742 678 (1996-11-01), None
patent: 0 854 535 (1998-07-01), None
patent: 0 899 718 (1999-03-01), None
patent: 0 939 534 (1999-09-01), None
patent: 0 951 883 (1999-10-01), None
patent: 1 333 650 (2003-08-01), None
patent: 1 569 422 (2005-08-01), None
patent: 2 761 800 (1997-04-01), None
patent: 2 375 276 (2002-11-01), None
patent: 2 390 264 (2003-12-01), None
patent: 3108997 (1991-05-01), None
patent: 04245720 (1992-09-01), None
patent: 5276587 (1993-10-01), None
patent: 8065781 (1996-03-01), None
patent: 8070344 (1996-03-01), None
patent: 8079868 (1996-03-01), None
patent: 08214391 (1996-08-01), None
patent: 09284877 (1997-10-01), None
patent: 10-023122 (1998-01-01), None
patent: 10-023123 (1998-01-01), None
patent: 11265199 (1999-09-01), None
patent: 2001119797 (1999-10-01), None
patent: 2001245397 (2000-02-01), None
patent: 20002-09688 (2000-07-01), None
patent: 2000196723 (2000-07-01), None
patent: 2000250577 (2000-09-01), None
patent: 2000261529 (2000-09-01), None
patent: 2000261530 (2000-09-01), None
patent: 2000261534 (2000-09-01), None
patent: 2000354284 (2000-12-01), None
patent: 20012924989 (2001-10-01), None
patent: 2002-125298 (2002-04-01), None
patent: 2002-358089 (2002-12-01), None
patent: 2003143253 (2003-05-01), None
patent: WO 93/01664 (1993-01-01), None
patent: WO 95/17746 (1995-06-01), None
patent: WO 00/21194 (1998-10-01), None
patent: WO 99/04500 (1999-01-01), None
patent: WO 00/021194 (2000-04-01), None
patent: WO 00/45248 (2000-08-01), None
patent: WO 02/007477 (2002-01-01), None
patent: WO 02/098169 (2002-05-01), None
patent: WO 02/077972 (2002-10-01), None
patent: WO 03/055270 (2003-07-01), None
patent: WO 2004012477 (2004-05-01), None
U.S. Appl. No. 10/629,278, filed Jul. 29, 2003, Huang et al.
U.S. Appl. No. 10/785,768, filed Feb. 24, 2004, Sinclair et al.
U.S. Appl. No. 10/636,176, filed Aug. 7, 2003, Huang et al.
O.M. Strand, T. Holter, A. Egeberg, and S. Stensby, “On the Feasibility of ASR in Extreme Noise Using the PARAT Earplug Communication Terminal,” ASRU 2003, St. Thomas, U.S. Virgin Islands, Nov. 20-Dec. 4, 2003.
Z. Zhang, Z. Liu, M. Sinclair, A. Acero, L. Deng, J. Droppo, X. D. Huang, Y. Zheng, “Multi-Sensory Microphones For Robust Speech Detection, Enchantment, and Recognition,” ICASSP 04, Montreal, May 17-21, 2004.
Search Report dated Dec. 17, 2004 from International Application No. 04016226.5.
European Search Report from Application No. 05107921.8, filed Aug. 30, 2005.
European Search Report from Application No. 05108871.4, filed Sep. 26, 2005.
http://www.snaptrack.com/ (2004).
http://www.misumi.com.tw/PLIST.ASP?PC.ID:21 (2004).
http://www.wherifywireless.com/univLoc.asp (2001).
http://www.wherifywireless.com/prod.watches.htm (2001).
Microsoft Office, Live Communications Server 2003, Microsoft Corporation, pp. 1-10, 2003.
Shoshana Berger, http://www.cnn.com/technology, “Wireless, wearable, and wondrous tech,” Jan. 17, 2003.
http://www.3G.co.uk, “NTT DoCoMo to Introduce First Wireless GPS Handset,” M

Affiliated with

Also associated with

Rating

Method and apparatus for multi-sensory speech enhancement does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and apparatus for multi-sensory speech enhancement, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for multi-sensory speech enhancement will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4042392