Morphological analysis method and device and Japanese language m

Details Morphological analysis method and device and Japanese language m Morphological analysis method and device and Japanese language m

1998-03-19

2000-08-01

Thomas, Joseph

Data processing: speech signal processing, linguistics, language

Linguistics

Natural language

707531, G06F 1727

Patent

active

060980354

ABSTRACT:
There is provided a morphological analysis method and device whereby, even if unknown words are present, processing can be effected with high accuracy and at high speed and economy of resources can be achieved. Expanded characters e.sub.i are generated by adding to each character c.sub.i of input text, in addition to word division information d.sub.i, expansion information including required arbitrarily selectable information such as tag information, and all possible expanded character sequences are generated. Beforehand, by training, the partial chain probabilities (appearance probabilities) of N-gram (where, normally N=1 or 2 or 3) character sequences are stored in an expanded character table. The partial character sequences of the expanded character sequences are successively extracted from the beginning of the expanded character sequence and the respective partial chain probabilities are found by referring to the expanded character table, and the product of the thus-found partial chain probabilities is obtained. This product is found for all the expanded character sequences, and analysis results etc. consisting of a row of word sequences in order of character sequences corresponding to largest such products, as well as a row of tag sequences and/or arbitrarily selectable information is output as the morphological analysis result.

REFERENCES:
patent: 4964044 (1990-10-01), Kumano et al.
patent: 5321608 (1994-06-01), Namba et al.
patent: 5426583 (1995-06-01), Uribe-Echebarria Diaz De Mendibil
patent: 5619410 (1997-04-01), Emori et al.
patent: 5835893 (1998-11-01), Ushioda
patent: 5946648 (1999-08-01), Halstead, Jr. et al.
patent: 5963893 (1999-10-01), Halstead, Jr. et al.
Nagata, Masaaki, A Stochastic Japanese Morphological Analyzer Using A Forward-DP Backward-A* N-Best Search Algorithm, pp. 1-7.

Affiliated with

Also associated with

Rating

Morphological analysis method and device and Japanese language m does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Morphological analysis method and device and Japanese language m, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Morphological analysis method and device and Japanese language m will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-673262