Education and demonstration – Question or problem eliciting response – Grading of response form
Patent
1998-03-20
1999-11-23
Cheng, Joe H.
Education and demonstration
Question or problem eliciting response
Grading of response form
434118, 434322, 434350, 382321, G09B 300, G09B 700
Patent
active
059915951
ABSTRACT:
Systems and methods for presentation to raters of constructed responses to test questions in electronic workfolders. The systems and methods provide for selection and designation of constructed responses into categories for use in quality control functions and training applications. A storage device is used to relationally store data regarding the raters, the constructed responses, and the scores awarded for use in selecting constructed responses for use in quality control and training. The system also comprises rater stations and processing systems for selectively transmitting constructed responses to the rater stations and receiving scores awarded by the raters assigned to the rater stations during both training and actual production scoring. The system further comprises rater stations and processing systems for displaying rater performance data, topic performance data, constructed response volume data, and candidate sample volume data.
REFERENCES:
patent: 4671772 (1987-06-01), Slade et al.
patent: 4768087 (1988-08-01), Taub et al.
patent: 4867685 (1989-09-01), Brush et al.
patent: 4895518 (1990-01-01), Arnold et al.
patent: 4953209 (1990-08-01), Ryder, Sr. et al.
patent: 4978305 (1990-12-01), Kraft
patent: 5002491 (1991-03-01), Abrahamson et al.
patent: 5011413 (1991-04-01), Ferris et al.
patent: 5033969 (1991-07-01), Kamimura
patent: 5059127 (1991-10-01), Lewis et al.
patent: 5170362 (1992-12-01), Greenberg et al.
patent: 5176520 (1993-01-01), Hamilton
patent: 5180309 (1993-01-01), Egnor
patent: 5195033 (1993-03-01), Samph et al.
patent: 5204813 (1993-04-01), Samph et al.
patent: 5211563 (1993-05-01), Haga et al.
patent: 5211564 (1993-05-01), Martinez et al.
patent: 5247670 (1993-09-01), Matsunaga
patent: 5287519 (1994-02-01), Dayan et al.
patent: 5309564 (1994-05-01), Bradley et al.
patent: 5318450 (1994-06-01), Carver
patent: 5321611 (1994-06-01), Clark et al.
patent: 5432932 (1995-07-01), Chen et al.
patent: 5433615 (1995-07-01), Clarke et al.
patent: 5437554 (1995-08-01), Clark et al.
patent: 5442759 (1995-08-01), Chiang et al.
patent: 5458493 (1995-10-01), Clark et al.
patent: 5466159 (1995-11-01), Clark et al.
patent: 5509127 (1996-04-01), Datuyler et al.
patent: 5513994 (1996-05-01), Kershaw et al.
patent: 5524193 (1996-06-01), Covington et al.
patent: 5558521 (1996-09-01), Clark et al.
patent: 5565316 (1996-10-01), Kershaw et al.
"The Integrated Instructional Systems Report", Feb., 1990, EPIE Institute.
Results of literature search re: new products and educational/psychological academic literature performed by Educational Testing Service on Jul. 29, 1992, using various commercial databases.
"The MicroCAT Testing System", 1992 Computerized Testing Products Catalog, Assessment Systems Corporation, 1992.
Wayne Patience, "Software Review-MicroCAT Testing System Version 3.0", Journal of Educational Measurement/Spring 1990, vol. 27, No. 1, pp. 82-88.
G. Gage Kingsbury, "Adapting Adaptive Testing: Using the MicroCat Testing System in a Local School District", Educational Measurement: Issues and Practice, Summer, 1990, pp. 3-6 and 29.
Anthony DePalma, "Standardized College Exam Is Customized by Computers", The New York Times, Front Page Story, Mar. 21, 1992.
ETS/ACCESS Summer 1992 Special Edition Newsletter.
Elliot Soloway, "Quick, Where Do the Computers Go; Computers in Education", Communications of the ACM, Association for Computing, Machinery, 1991, Feb., 1991, vol. 34, No. 2, p. 29.
Tse-chi Hsu and Shula F. Sadock, "Computer-Assisted Test Construction: A State of the Art", TME Report 88, Educational Testing Service, Nov. 1985.
Abdel-fattah, "Comparison of the Chi-Square Procedure with the Symmetric Regression Procedure for Developing a Common Metric in Item Response Theory", 1992, Abstract.
Adams et al., "Quest: The Interactive Test Analysis System", 1993, Abstract.
Burstein et al., "GE FRST Evaluation Report: How Well Does a Statistically-Based Natural Language Processing System Score Natural Language Constructed-Responses?", 1995, Abstract.
de la Torre et al., "The Development and Evaluation of a Computerized Adaptive Testing System", 1991, Abstract.
Gearhart et al., "Writing Portfolios at the Elementary Level: A Study of Methods for Writing Assessment", 1992, Abstract.
Halpin et al., "So You Have Chosen an Unequal Cell Size ANOVA Option--Do you Really Know What you Have?", 1991, Abstract.
Henning et al., "Automated Assembly of Pre-equated Language Proficiency Tests", Language Testing, 1994, 11, Abstract.
Kaplan et al., "Using the Free-Response Scoring Tool to Automatically Score the Formulating-Hypotheses Item", 1994, p. 41.
Sebrechts et al., "Agreement between Expert System and Human Raters' Scores on Complex Constructed-Response Quantitative Items", 1991, Abstract.
Smittle, "Computerized Adaptive Testing: Revolutionizing Academic Assessment", Community College J., 1994, 65, Abstract.
Solomon et al., "A Pilot Study of the Relationship between Experts' Ratings and Scores Generated by the NBME's Computer-Based Examination System", Acad. Med., 1992, 67, Abstract.
Stowitschek et al., "A Computerized Risk Index Screening Program for At-Risk Students", 1990, Abstract.
Wang, "An Analytical Approach to Generating Norms for Skewed Normative Distributions", 1992, Abstract.
Weiss et al., "User's Manual for the Basic Math Mastery Tests", 1992, Abstract.
Farnum Marisa D.
Grant Mark
Romano Frank J.
Cheng Joe H.
Educational Testing Service
LandOfFree
Computerized system for scoring constructed responses and method does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Computerized system for scoring constructed responses and method, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Computerized system for scoring constructed responses and method will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1233164