Data processing: speech signal processing – linguistics – language – Speech signal processing – Application
Reexamination Certificate
1998-12-17
2001-02-20
{haeck over (S)}mits, T{overscore (a)}livadis I. (Department: 2741)
Data processing: speech signal processing, linguistics, language
Speech signal processing
Application
C704S270000, C704S251000, C704S231000
Reexamination Certificate
active
06192343
ABSTRACT:
TECHNICAL FIELD
The present invention relates to interactive computer controlled display systems with speech command input and more particularly to such systems which present display feedback to query inputs from the interactive users.
BACKGROUND OF THE INVENTION
The 1990's decade has been marked by a technological revolution driven by the convergence of the data processing industry with the consumer electronics industry. This advance has been even further accelerated by the extensive consumer and business involvement in the Internet over the past few years. As a result of these changes it seems as if virtually all aspects of human endeavor in the industrialized world require human/computer interfaces. There is a need to make computer directed activities accessible to people who, up to a few years ago, were computer illiterate or, at best, computer indifferent.
Thus, there is continuing demand for interfaces to computers and networks which improve the ease of use for the interactive user to access functions and data from the computer. With desktop-like interfaces including windows and icons, as well as three-dimensional virtual reality simulating interfaces, the computer industry has been working hard to fulfill such interface needs by making interfaces more user friendly by making the human/computer interfaces closer and closer to real world interfaces, e.g. human/human interfaces. In such an environment it would be expected that speaking to the computer in natural language would be a very natural way of interfacing with the computer for even novice users. Despite these potential advantages of speech recognition computer interfaces, this technology has been relatively slow in gaining extensive user acceptance.
Speech recognition technology has been available for over twenty years, but it has only been recently that it is beginning to find commercial acceptance, particularly with speech dictation or “speech to text” systems such as those marketed by International Business Machines Corporation (IBM) and Dragon Systems. That aspect of the technology is now expected to have accelerated development until it will have a substantial niche in the word processing market. On the other hand, a more universal application of speech recognition input to computers, which is still behind expectations in user acceptance, is in command and control technology wherein, for example, a user may navigate through a computer system's graphical user interface (GUI) by the user speaking the commands which are customarily found in the systems menu text, icons, labels, buttons, etc.
Many of the deficiencies in speech recognition, both in word processing and in command technologies, are due to inherent voice recognition errors due in part to the status of the technology and in part to the variability of user speech patterns and the user's ability to remember the specific commands necessary to initiate actions. As a result, most current voice recognition systems provide some form of visual feed-back which permits the user to confirm that the computer understands his speech utterances. In word processing, such visual feedback is inherent in this process since the purpose of the process is to translate from the spoken to the visual. That may be one of the reasons that the word processing applications of speech recognition has progressed at a faster pace.
The above-referenced copending patent applications are directed toward making voice or speech command technology more user friendly and easier to use. Two of the applications are directed toward voice recognition systems and methods which interpret spoken inputs which are not commands, e.g. queries such as help queries and visual feedback present or prompt the user with lists of displayed proposed commands from which the user will, hopefully, find the appropriate command and then speak that command to the apparatus to initiate a desired action. “SPEECH COMMAND INPUT RECOGNITION SYSTEM FOR INTERACTIVE COMPUTER DISPLAY WITH INTERPRETATION OF ANCILLARY RELEVANT SPEECH QUERY TERMS INTO COMMANDS”, Scott A. Morgan et al. (Attorney Docket No. AT9-98-343) is directed toward the provision of a relevance table including a basic active vocabulary provided by collecting from a computer operation—including the operating system and all significant application programs—all words and terms from menus, buttons and other user interface controls including the invisible but active words from currently active application windows, all names of macros supplied by the speech system, the application and the user, names of other applications that the user may switch to, generic commands that are generic to any application and any other words and terms which may be currently active. This basic active vocabulary is constructed into a relevance table, wherein each word or term will be related to one or more of the actual commands and, conversely, each of the actual commands will have associated with it a set of words and terms which are relevant to the command. “SPEECH COMMAND INPUT RECOGNITION SYSTEM FOR INTERACTIVE COMPUTER DISPLAY WITH MEANS FOR CONCURRENT AND MODELESS DISTINGUISHING BETWEEN SPEECH COMMANDS AND SPEECH QUERIES FOR LOCATING COMMANDS”, Scott A. Morgan et al. (Attorney Docket No. AT9-98-344) is directed to the modeless or transparent transitions between the spoken query state when the user presents queries to search for desired commands and the command mode when the user controls the system by speaking the located actual commands. In the dynamic operation of the systems and methods covered by these copending applications, the user may still be barraged by a substantial number of displayed proposed commands.
SUMMARY OF THE PRESENT INVENTION
The present invention organizes the displayed commands being prompted to the user through probability determining means, which for each of a predetermined plurality of speech commands store an associated set of speech terms, each term having relevance to its associated command combined with means responsive to a speech query for determining the probability of speech terms from said set in said query, and means responsive to said probability determining means for prompting the user with a displayed sequence of commands sorted based upon said probability of speech terms associated with said commands. When such a sorted command is selected, the system has means responsive to a speech command for carrying out the system action corresponding to the command. Preferably, means for determining probability of speech terms weight said probability upon the firmness of recognition of the speech terms. Excellent results are achieved when in determining said probability, a firm recognition of a speech term is accorded twice the weight of an infirm recognition of the term.
In addition, there may be circumstances where the user in speaking a run of speech words and terms to seek out commands appropriate to his needs may use phrases which include actual commands. These spoken commands may be inadvertent and not the best commands for the user's purpose or they may be very pertinent. Therefore, in the sorting of displayed commands, any exact match of a speech term with any command doubles the weight accorded to that command in the sorting.
The system also provides means for adding terms to previous speech terms wherein the probability determining means will redetermine probability to include such added terms. In such a situation, the probability determining means will redetermine the weights to include the additional weights of such added terms.
REFERENCES:
patent: 4726065 (1988-02-01), Foressl
patent: 4766529 (1988-08-01), Nakano et al.
patent: 5027406 (1991-06-01), Roberts et al.
patent: 5068900 (1991-11-01), Searcy et al.
patent: 5133011 (1992-07-01), McKiel, Jr.
patent: 5157384 (1992-10-01), Greanias et al.
patent: 5222146 (1993-06-01), Bahl et al.
patent: 5231670 (1993-07-01), Goldhor et al.
patent: 5305244 (1994-04-01), Newman et al.
patent: 5386494 (1995-01-01), White et al.
patent: 5408582 (1995-04-01), Colier
patent: 54287
Morgan Scott Anthony
Roberts David John
Swearingen Craig Ardner
Tannenbaum Alan Richard
International Business Machines - Corporation
Kraft J. B.
Leeuwen Leslie A. Van
Nolan Daniel A.
{haeck over (S)}mits T{overscore (a)}livadis I.
LandOfFree
Speech command input recognition system for interactive... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Speech command input recognition system for interactive..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Speech command input recognition system for interactive... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2613890