Regular expression factoring for scanning multibyte character se

Details Regular expression factoring for scanning multibyte character se Regular expression factoring for scanning multibyte character se

1992-01-21

1994-05-31

Enval, Jr., Roy M.

Boots, shoes, and leggings

395700, 395200, G06F 1100

Patent

active

053175093

ABSTRACT:
The present invention provides a system and method for building a lexical analyzer that can scan multibyte character sets. The present invention factors regular expressions that contain multibyte characters, so that a single byte finite state automata can be constructed. In particular, the present invention provides a computer-based system and method for tokenizing a source program written in a programming language that is represented by both single byte values and two byte values. The present invention includes a mechanism for building a lexical analyzer that is configured to accept an input specification. The input specification typically includes a regular expression(s) and a corresponding associated action(s). The present invention also including a mechanism for factoring the regular expression(s), if the regular expression(s) contains at least one two byte character, into a regular expression(s) containing only single byte characters. The present invention will result in both a significantly smaller lexical analyzer which uses substantially less memory and a lexical analyzer which easily recognizes a heterogeneous input stream of single and two byte characters.

REFERENCES:
patent: 4989145 (1991-01-01), Kyushima
patent: 4991094 (1991-02-01), Fagan et al.
patent: 5113342 (1992-05-01), Zamora

Affiliated with

Also associated with

Rating

Regular expression factoring for scanning multibyte character se does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Regular expression factoring for scanning multibyte character se, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Regular expression factoring for scanning multibyte character se will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1632705