Identification of words in Japanese text by a computer system

Details Identification of words in Japanese text by a computer system Identification of words in Japanese text by a computer system

1998-07-24

1999-08-31

Thomas, Joseph

Data processing: speech signal processing, linguistics, language

Linguistics

Natural language

707531, G06F 1727

Patent

active

059466480

ABSTRACT:
A word breaking facility operates to identify words within a Japanese text string. The word breaking facility performs morphological processing to identify postfix bound morphemes and prefix bound morphemes. The word breaking facility also performs opheme matching to identify likely stem characters. A scoring heuristic is applied to determine an optimal analysis that includes a postfix analysis, a stem analysis, and a prefix analysis. The morphological analyses are stored in an efficient compressed format to minimize the amount of memory they occupy and maximize the analysis speed. The morphological analyses of postfixes, stems, and prefixes is performed in a right-to-left fashion. The word breaking facility may be used in applications that demand identity of selection granularity, autosummarization applications, content indexing applications, and natural language processing applications.

REFERENCES:
patent: 5268840 (1993-12-01), Chang et al.
patent: 5490061 (1996-02-01), Tolin et al.
patent: 5497319 (1996-03-01), Chong et al.
patent: 5535121 (1996-07-01), Roche et al.
patent: 5590257 (1996-12-01), Forcier
patent: 5778361 (1998-07-01), Nanjo et al.
patent: 5794177 (1998-08-01), Carus et al.
patent: 5799269 (1998-08-01), Schabes et al.
Abe, Masahori et al., "A Kana-Kanji Translation System for Non-Segmented Input Sentences Based on Syntactic and Semantic Analysis," Zeitschrift fuer Werkstofftechnik--Journal of Materials Technology, Aug. 25, 1986, pp. 280-285.
Hisamitsu, Toru et al., "An Efficient Treatment of Japanese Verb Inflection for Morphological Analysis," Coling 1994 Proceedings, 1:194-200.
Itoh Yoshiharu et al., "Sub-Phonemic Optimal Path Search for Concatenative Speech Synthesis," in 4.sup.th European Conference on Speech Communication and Technology, Madrid, Sep., 1995, pp. 577-580.
Itoh, Nobuyashu, "Japanese Language Model Based on Bigrams and its Application to On-Line Character Recognition, " Pattern Recognition, 28(2):135-140, 1995.
Kurohashi et al., "Improvement of Japanese Morphological Analyzer Juman," Proceedings of SNLR, 1994, pp. 22-28.
Takeda, Koichi et al., "CRITAC--An Experimental System for Japanese Text Proofreading," IBM Journal of Research and Development, 32(2):201-216.
Teller, Virginia et al., "A Probabilistic Algorithm for Segmenting Non-Kanji Japanese Strings," in Jul. 12-16, 1992--Proceedings Tenth National Conference on Artificial Intelligence, vol. 1, Jul. 31, 1994, pp. 742-747.

Affiliated with

Also associated with

Rating

Identification of words in Japanese text by a computer system does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Identification of words in Japanese text by a computer system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Identification of words in Japanese text by a computer system will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2428805