Adaptive scoring of responses to constructed response questions

Details Adaptive scoring of responses to constructed response questions Adaptive scoring of responses to constructed response questions

2004-05-21

2010-02-02

Mosser, Kathleen (Department: 3715)

Education and demonstration

Question or problem eliciting response

Grading of response form

C434S362000

Reexamination Certificate

active

07657220

ABSTRACT:
A method for adaptive scoring of responses to constructed response questions is disclosed. Adaptive scoring may be used to apply evaluator time in such a way that a predetermined reliability level is reached with the least possible use of evaluator time, including adjusting the number of response graded and/or the number of evaluators grading each response. A score may be calculated after grading a subset of a test taker's responses to the constructed response questions. A probability or an error estimate is calculated and compared to a threshold value. Grading may be discontinued based on the comparison. A score may be calculated based on a predetermined number of ratings for the test taker's response to a constructed response. A probability that the score is within a predetermined range of what the score would be if all the responses are graded is calculated. If the probability is less than a threshold value, the number of ratings is increased.

REFERENCES:
patent: 4958284 (1990-09-01), Bishop et al.
patent: 4978305 (1990-12-01), Kraft
patent: 5059127 (1991-10-01), Lewis et al.
patent: 5987302 (1999-11-01), Driscoll
patent: 6115683 (2000-09-01), Burstein et al.
patent: 6181909 (2001-01-01), Burstein et al.
patent: 6193521 (2001-02-01), Clark
patent: 6234806 (2001-05-01), Trenholm
patent: 6356864 (2002-03-01), Foltz et al.
patent: 6366759 (2002-04-01), Burstein et al.
patent: 6461166 (2002-10-01), Berman
patent: 6577846 (2003-06-01), Poor
patent: 6796800 (2004-09-01), Burstein et al.
patent: 6876990 (2005-04-01), Yamanishi et al.
patent: 6970677 (2005-11-01), Jongsma et al.
patent: 6996365 (2006-02-01), Okubo
patent: 7149468 (2006-12-01), Patz et al.
patent: 2005/0142529 (2005-06-01), Andreyev et al.
“How ePEN Works,” (Dec. 31, 2003). (www.pearsonedmeasurement.com/epen/works.htm).
“Computer Adaptive Testing Enables Accurate Skills Measurement,” (Dec. 31, 2003). (www.brainbench.com/xml/bb/business/learnmore/cat.xml).

Affiliated with

Also associated with

Rating

Adaptive scoring of responses to constructed response questions does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Adaptive scoring of responses to constructed response questions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Adaptive scoring of responses to constructed response questions will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4202372