Education and demonstration – Question or problem eliciting response – Correctness of response indicated to examine by...
Reexamination Certificate
2002-01-23
2004-09-28
Walberg, Teresa (Department: 3713)
Education and demonstration
Question or problem eliciting response
Correctness of response indicated to examine by...
C434S353000
Reexamination Certificate
active
06796800
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to document processing and automated identification of discourse elements, such as a thesis statements, in an essay.
BACKGROUND OF THE INVENTION
Given the success of automated essay scoring technology, such application have been integrated into current standardized writing assessments. The writing community has expressed an interest in the development of an essay evaluation systems that include feedback about essay characteristics to facilitate the essay revision process.
There are many factors that contribute to overall improvement of developing writers. These factors include, for example, refined sentence structure, variety of appropriate word usage, and organizational structure. The improvement of organizational structure is believed to be critical in the essay revision process toward overall essay quality. Therefore, it would be desirable to have a system that could indicate as feedback to students, the discourse elements in their essays.
SUMMARY OF THE INVENTION
The invention facilitates the automatic analysis, identification and classification of discourse elements in a sample of text.
In one respect, the invention is a method for automated analysis of an essay. The method comprises the steps of accepting an essay; determining whether each of a predetermined set of features is present or absent in each sentence of the essay; for each sentence in the essay, calculating a probability that the sentence is a member of a certain discourse element category, wherein the probability is based on the determinations of whether each feature in the set of features is present or absent; and choosing a sentence as the choice for the discourse element category, based on the calculated probabilities. The discourse element category of preference is the thesis statement. The essay is preferably in the form of an electronic document, such as an ASCII file. The predetermined set of features preferably comprises the following: a feature based on the position within the essay; a feature based on the presence or absence of certain words wherein the certain words comprise words of belief that are empirically associated with thesis statements; and a feature based on the presence or absence of certain words wherein the certain words comprise words that have been determined to have a rhetorical relation based on the output of a rhetorical structure parser. The calculation of the probabilities is preferably done in the form of a multivariate Bernoulli model.
In another respect, the invention is a process of training an automated essay analyzer. The training process accepts a plurality of essays and manual annotations demarking discourse elements in the plurality of essays. The training process accepts a set of features that purportedly correlate with whether a sentence in an essay is a particular type of discourse element. The training process calculates empirical probabilities relating to the frequency of the features and relating features in the set of features to discourse elements.
In yet other respects, the invention is computer readable media on which are embedded computer programs that perform the above method and process.
REFERENCES:
patent: 4958284 (1990-09-01), Bishop et al.
patent: 4978305 (1990-12-01), Kraft
patent: 5672060 (1997-09-01), Poor
patent: 5878386 (1999-03-01), Coughlin
patent: 6115683 (2000-09-01), Burstein et al.
patent: 6181909 (2001-01-01), Burstein et al.
patent: 6267601 (2001-07-01), Jongsma et al.
patent: 6356864 (2002-03-01), Foltz et al.
patent: 6366759 (2002-04-01), Burstein et al.
Andreyev Vyacheslav
Burstein Jill
Chodorow Martin Sanford
Leacock Claudia
Marcu Daniel
Christman Kathleen M
Educational Testing Service
Melnik W. Joseph
Pepper Hamilton LLP
Walberg Teresa
LandOfFree
Methods for automated essay analysis does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods for automated essay analysis, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods for automated essay analysis will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3264094