Data processing: speech signal processing – linguistics – language – Speech signal processing – Application
Reexamination Certificate
1996-09-25
2003-07-08
Dorvil, Richemond (Department: 2654)
Data processing: speech signal processing, linguistics, language
Speech signal processing
Application
C704S270000
Reexamination Certificate
active
06591240
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a speech signal modification and concatenation method used in forming a spoken message by using sound-recording and editing techniques, for efficiently performing addition or modification of spoken messages, so as to establish and economically maintain a system using spoken messages.
2. Description of the Related Art
Recently, spoken messages are used in services such as announcements in stations; highway radio-announcements for providing information about traffic jams and the like; and voice guidance systems for information searches. Such spoken messages are formed by previously recording spoken sounds produced by a human, and then concatenating these sounds.
In forming spoken messages in this way, in a case in which a new message which differs from any already-formed messages was required, and if the “new” message had not yet been recorded, additional recording of any new spoken sounds was necessary.
In such a case, it was necessary for the same person who previously produced the already-recorded spoken sounds to produce additional spoken sounds in order to avoid an abrupt change of voice characteristics between the already-recorded voice and the newly-recorded voice, and to naturally concatenate the two voices.
However, even if the speaker were the same, the voice characteristics may be different from those at the time of the previous recording due to the passage of time since the previous recording, and the like. Therefore, if any comprehension difficulty due to concatenation of old and new spoken messages were expected, re-recording and re-forming of all relevant spoken messages was required.
In addition, if the previous speaker were absent, it was necessary for another speaker to produce the necessary spoken sounds instead, wherein re-recording of all relevant spoken messages was required.
Furthermore, it is also possible to form those spoken messages by using a speech-synthesis device. However, also in this case, similar problems may appear when two speech signals having different voice characteristics, due to, for example, having used different speech-synthesis devices, are concatenated.
SUMMARY OF THE INVENTION
The present invention was made in consideration of the above problems, and it is an object of the present invention to provide a speech signal modification and concatenation method for combining spoken messages having different voice characteristics, without causing a sense of incompatibility, and for making it possible to efficiently perform addition or modification of spoken messages.
Accordingly, the present invention provides: a speech signal modification and concatenation method for concatenating two speech signals having different voice characteristics, the method comprising the step of concatenating the speech signals by modifying a parameter indicating a character of speech signals in a manner such that the parameter is gradually changed from a value indicating a feature of one of the speech signals to a value indicating a feature of the other speech signal over a predetermined period.
Even if voice characteristics of the speakers are significantly different, listeners do not sense substantial incompatibility if the amount of modification per unit of time is relatively small. According to the present invention, it is possible to concatenate voices by repeating a measure of modification, which does not produce a sense of incompatibility, a plurality of times. That is, in a concatenation section of a spoken message, which is concatenated according to the present invention, the voice characteristic thereof gradually changes over a period.
As the above parameter, a spectrum of spoken sounds or a fundamental frequency of spoken sounds may be used, and the rate of changing the parameter can be arbitrarily set. For example, if the spectrum of speech signals is used as the parameter, it is possible to adopt a method comprising the steps of: in a phoneme which corresponds to the two speech signals, determining each pitch correspondence between the two signals; generating a spectrum, for every corresponding pitch, by combining, with respect to a boundary frequency, a portion above the boundary frequency among the spectrum of one speech signal and a portion below the boundary frequency among the spectrum of the other speech signal, and determining the generated spectrum as a spectrum at the relevant pitch; and with respect to the generation of spectra, changing the boundary frequency for each unit time. Here, if the change of the boundary frequency is performed such that the boundary frequency gradually increases from a value at the start of change to a value at the end of change; the rate of change is lower in a stage of relatively low boundary frequencies near the start of change, while the rate of change is higher in a stage of relatively high boundary frequencies near the end of change, a more natural voice (characteristic) change can be realized, and the change further matches the characteristics of the sense of hearing of humans.
That is, according to the present invention, a time-scaled change of a feature-amount of spoken sounds can be performed. As a result, even if two speech signals of different speakers are concatenated, it is possible to avoid an abrupt change of voice characteristics in the concatenation section, and it is thus possible to concatenate speech signals without causing a sense of incompatibility to listeners.
REFERENCES:
patent: 3828132 (1974-08-01), Flanagan et al.
patent: 4384169 (1983-05-01), Mozer et al.
patent: 4601052 (1986-07-01), Saito et al.
patent: 4624012 (1986-11-01), Lin et al.
patent: 4850022 (1989-07-01), Honda et al.
patent: 5189701 (1993-02-01), Jain
patent: 5226108 (1993-07-01), Hardwick et al.
patent: 5278943 (1994-01-01), Gasper et al.
patent: 5479564 (1995-12-01), Vogten et al.
patent: 5504834 (1996-04-01), Fette et al.
patent: 5517595 (1996-05-01), Kleijn
patent: 5524172 (1996-06-01), Hamon
patent: 5577159 (1996-11-01), Shoham
patent: 5617507 (1997-04-01), Lee et al.
patent: 5623575 (1997-04-01), Fette et al.
patent: 5641927 (1997-06-01), Pawate et al.
patent: 5663517 (1997-09-01), Oppenheim
patent: 5703311 (1997-12-01), Ohta
patent: 5749073 (1998-05-01), Slaney
patent: 61-103200 (1986-05-01), None
patent: 7-104791 (1995-04-01), None
patent: 8-016183 (1996-01-01), None
patent: 8-328575 (1996-12-01), None
patent: 9-050295 (1997-02-01), None
Masanobu Abe, “Speech Morphing by Gradually Changing Fundamental Frequency and Spectra”, Proceedings of the Acoustical Society of Japan, pp. 259-260, Sep. 27, 1996 (Abstract of the proceedings is attached).
Eric Moulines et al., “Pitch-Synchronous Waveform Processing Techniques for Text-to-Speech Synthesis Using Diphones”, Speech Communication 9 (1990) pp. 453-467.
Japanese Office Action dated Oct. 22, 2002.
Dorvil Richemond
Finnegan Henderson Farabow Garrett & Dunner L.L.P.
Nippon Telegraph and Telephone Corporation
Opsasnick Michael N.
LandOfFree
Speech signal modification and concatenation method by... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Speech signal modification and concatenation method by..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Speech signal modification and concatenation method by... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3019123