Education and demonstration – Question or problem eliciting response – Electrical means for recording examinee's response
Patent
1998-12-18
2000-11-07
Cheng, Joe H.
Education and demonstration
Question or problem eliciting response
Electrical means for recording examinee's response
434118, 434322, 434350, G09B 700
Patent
active
061448389
ABSTRACT:
A method for diagnostic assessment and proficiency scaling of test results is provided. The method uses as input a vector of item difficulty estimates for each of n items and a matrix of hypothesized skill classifications for each of said n items on each of k skills. The method includes using a tree-based regression analysis based on the vector and matrix to model ways in which required skills interact with different item features to produce differences in item difficulty. This analysis identifies combinations of skills required to solve each item, and forms a plurality of clusters by grouping the items according to a predefined prediction rule based on skill classifications. A nonparametric smoothing technique is used to summarize student performance on the combinations of skills identified in the tree-based analysis. The smoothing technique results in cluster characteristic curves that provide a probability of responding correctly to items with specified skill requirements. The probability is expressed as a function of underlying test score.
REFERENCES:
patent: 4012848 (1977-03-01), Diament et al.
patent: 4247895 (1981-01-01), Weber
patent: 4820165 (1989-04-01), Kanapa
patent: 5059127 (1991-10-01), Lewis et al.
patent: 5117353 (1992-05-01), Stipanovich et al.
patent: 5763217 (1998-06-01), Cynader et al.
patent: 5797130 (1998-08-01), Nelson et al.
patent: 5987302 (1999-11-01), Driscoll et al.
patent: 5991595 (1999-11-01), Romano et al.
patent: 6029195 (2000-02-01), Herz
Beaton, et al., "Interpreting scales through scale anchoring," Journal of Educational Statistics,vol. 17, pp. 191-204, 1992.
Beller, "Tree versus geometric representation of tests and items," Applied Psychological Measurement, vol. 14(1), pp. 13-28, 1990.
Breland, et al., "English Word Frequency Statistics: Analysis of a Selected Corpus of 14 Million Tokens," College Entrance Examination Board, New York, NY, pp. 1-6, 1997.
Brieman, et al., "Classification and Regression Trees," Wadsworth & Brooks/Cole, pp. 216-264, 1984.
Clark, et al., "Tree-Based Models," in Chambers, J.M. and T.J. Hastie, Eds., Statistical Models in S, Wadsworth and Brooks/Cole, pp. 377-378, 1992.
Cleveland, et al., "Local Regression Models," in J.M. Chambers & T.J. Hastie, Eds., Statiscial Models in S, Wadsworth & Brooks/Cole, pp. 312-314, 1992.
James E. Corter, "Using Clustering Methods to Explore the Structure of Diagnostic Tests," in Cognitively Diagnostic Assessment, P. Nichols, S. Chapman & R. Brennan, Eds., Lawrence Erlbaum Associates, pp. 305-326, 1995.
Susan E. Embretson, "A Measurement Model for Linking Individual Learning to Processes and Knowledge: Application to Mathematical Reasoning," Journal of Educational Measurement, vol. 32, pp. 277-294, 1995.
Enright, et al., "Items by Design: The Impact of Systematic Feature Variation on Item Statistical Charactersticis," Draft ETS Report GRE No. 95-15, Princeton, NJ; Educational Testing Service, 1998.
Gitomer, et al., "Performance Modeling That Integrates Latent Trait and Latent Class Theory," Journal of Educational Measurement, vol. 28, pp. 173-189, 1991.
Gitomer, et al., "Diagnostic Assessment of Troubleshooting Skill in an Intelligent Tutoring System," in Cognitively Diagnostic Assessment, P. Nicols, S. Chapman & R. Brennan, Eds., Lawrence Erlbaum Associates, pp. 73-101, 1995.
Hambleton, et al., "Item Response Theory, Principles and Applications," Kluwer-Nijhoff Publishing, pp. 147-149, 1985.
Kirsch, et al., "Exploring document literacy: Variables underlying the performance of young adults," Reading Research Quarterly, vol 25, pp. 5-30, 1990.
Lewis, et al., "Using Bayesian Decision Theory to Design a Computerized Mastery Test," Applied Psychological Measurement, vol. 14, pp. 367-386, 1990.
Robert J. Mislevy, "Probability-Based Interfence in Cognitive Diagnosis," in Cognitively Diagnostic Assessment, P. Nichols, S. Chapman & R. Brennan, Eds., Lawrence Erlbaum Associates, pp. 43-71, 1995.
Kathleen M. Sheehan, "A Tree-Based Approach to Proficiency Scaling and Diagnostic Assessment," Journal of Educational Measurements, vol. 34, pp. 333-352, 1997.
Sheehan, et al., "A Tree-Based Analysis of Items from an Assessment of Basic Mathematics Skills," ETS Research Report No. RR-94-14, Eucational Testing Service, 1994, p. 1-28.
Sheehan, et al., "Computerized Mastery Testing with Nonequivalent Testlets," Applied Psychological Measurement, vol. 16, No. 1, pp. 65-76, 1992.
Kikumi K. Tatsuoka, "Architecture of Knowledge Structures and Cognitive Diagnosis," in Cognitively Diagnostic Assessment, P. Nichols, S. Chapman & R., Brennan, Eds., Lawrence Erlbaum Associates, pp. 327-359, 1995.
Tatsuoka, et al. "Proficiency Scaling Based on Conditional Probability Functions for Attributes," ETS Research Report No. RR-93-50-ONR, Educational Testing Service, 1993, p. 1-70.
Wainer, et al., "Some Paths Toward Making Praxis Scores More Useful" ETS Research Report RR-98-44, Educational Testing Service, 1998, p. 1-30.
Benjamin D. Wright, "Solving Measurement Problems with the Rasch Model," Journal of Educational Measurement, vol. 14, No. 2, pp. 97-116, 1977.
Cheng Joe H.
Educational Testing Services
LandOfFree
Tree-based approach to proficiency scaling and diagnostic assess does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Tree-based approach to proficiency scaling and diagnostic assess, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Tree-based approach to proficiency scaling and diagnostic assess will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1650706