Data processing: measuring – calibrating – or testing – Testing system
Reexamination Certificate
2002-05-21
2004-08-03
Barlow, John (Department: 2863)
Data processing: measuring, calibrating, or testing
Testing system
C434S322000
Reexamination Certificate
active
06772081
ABSTRACT:
TECHNICAL FIELD
This application relates generally to systems and methods for electronic tracking and control of documents, and more particularly to electronic tracking and control of standardized tests within a standardized test management system.
BACKGROUND
One method for evaluating the knowledge or skill of a person includes the use of standardized tests. For example, standardized tests are used to monitor the academic progress of students. Some standardized tests incorporate objective test questions that are answered by filling in an appropriate oval in an associated bubble-type answer sheet using a pencil. Some standardized tests include open-ended questions. Examples of open-ended questions in these tests include essay questions, fill-in-the-blank questions, fill-in-the-map questions, math questions, and motor skill questions in which a test taker draws geometric shapes. Open-ended questions, also referred to herein as scoring tasks or test items, are evaluated and scored by a human reviewer, also referred to herein as a reader.
A large number of completed standardized tests are received at a test-processing center from a number of test-taking centers. Many testing projects have various time constraints. These time constraints provide a complicating factor in processing the large number of tests.
There is a need in the art to provide improved systems and methods for processing completed standardized tests.
SUMMARY
The above mentioned problems are addressed by the present subject matter and will be understood by reading and studying the following specification. The present subject matter relates to systems and methods for prioritizing the processing of standardized tests. The present subject matter allows a test process to follow external time constraints, such as those time constraints provided by the customer. The present subject matter also allows a test process to follow internal time constraints, such as those time constraints designed for implementing efficient processing of the standardized tests. In one embodiment, external and internal refer to those time constraints provided outside of or within, respectively, a test-processing center.
One aspect of the present subject matter relates to a method for processing completed standardized tests. In one embodiment, test-processing priority information is received, and is associated with machine-readable identifiers for standardized tests. Completed standardized tests are received, and are identified by reading the machine-readable identifiers on the tests. The identified standardized tests are processed according to the associated test-processing priority information, such that higher priority tests are automatically processed before lower priority tests.
In one embodiment, boxes of test booklets are received from a plurality of test-taking centers, and criteria are received to prioritize the processing of the test booklets. Bar codes for the received boxes are read to prioritize the processing of the received boxes according to the received criteria. Bar codes for the test booklets contained within the processed boxes are read to prioritize processing of the test booklets according to the received criteria. The test booklets are processed in preparation for scoring test items in the test booklets according to the received criteria, such that higher priority test booklets are processed before lower priority test booklets. The test items are scored according to the received criteria.
According to one embodiment, completed test items are electronically received from test-taking centers, and criteria are received to prioritize the processing of the test items. The test items are processed in preparation for scoring, and the test items are scored according to the criteria.
One aspect of the present subject matter relates to a system for processing completed standardized tests. According to one embodiment, the system includes reading device(s) and a server connected to the reading device(s). The reading device(s) machine-read test identifiers for tests. The server includes a database module and at least one applications module. The database module associates test identifiers with test-processing priority information. The applications module(s) processes standardized tests according to the test-processing priority information, such that higher priority tests are processed before lower priority tests.
These and other aspects, embodiments, advantages, and features will become apparent from the following description of the present subject matter and the referenced drawings.
REFERENCES:
patent: 4120049 (1978-10-01), Thaler et al.
patent: 4437838 (1984-03-01), Tauber et al.
patent: 4478584 (1984-10-01), Kaney
patent: 4705479 (1987-11-01), Maron
patent: 4708503 (1987-11-01), Poor
patent: 4813077 (1989-03-01), Woods et al.
patent: 4817179 (1989-03-01), Buck
patent: 4820165 (1989-04-01), Kanapa
patent: 4837842 (1989-06-01), Holt
patent: 4967354 (1990-10-01), Buchanan
patent: 4978305 (1990-12-01), Kraft
patent: 5046005 (1991-09-01), Vilardebo et al.
patent: 5321611 (1994-06-01), Clark et al.
patent: 5386482 (1995-01-01), Basso et al.
patent: 5433615 (1995-07-01), Clark
patent: 5437554 (1995-08-01), Clark et al.
patent: 5445369 (1995-08-01), Golicz et al.
patent: 5452379 (1995-09-01), Poor
patent: 5458493 (1995-10-01), Clark et al.
patent: 5466159 (1995-11-01), Clark et al.
patent: 5531429 (1996-07-01), Clark
patent: 5558521 (1996-09-01), Clark et al.
patent: 5672060 (1997-09-01), Poor
patent: 5690497 (1997-11-01), Clark et al.
patent: 5709551 (1998-01-01), Clark et al.
patent: 5716213 (1998-02-01), Clark et al.
patent: 5718591 (1998-02-01), Clark et al.
patent: 5735694 (1998-04-01), Clark et al.
patent: 5752836 (1998-05-01), Clark et al.
patent: 5987149 (1999-11-01), Poor
patent: 6155839 (2000-12-01), Clark et al.
patent: 6159018 (2000-12-01), Clark et al.
patent: 6168440 (2001-01-01), Clark et al.
patent: 6181909 (2001-01-01), Burstein et al.
patent: 6183260 (2001-02-01), Clark et al.
patent: 6183261 (2001-02-01), Clark et al.
patent: 6193521 (2001-02-01), Clark et al.
patent: 6212130 (2001-04-01), Brazeal, Jr. et al.
patent: 6234806 (2001-05-01), Trenholm et al.
patent: 6256399 (2001-07-01), Poor
patent: 6366759 (2002-04-01), Burstein et al.
patent: 0 107 010 (1994-03-01), None
patent: 0 374 127 (1995-04-01), None
patent: 0 374 892 (1997-04-01), None
patent: WO-90/04004 (1990-04-01), None
patent: WO-91/09734 (1991-07-01), None
““Score Image” Processing of Constructed-Responses, Essays, and Writing Samples”,UNISCORE, Incorporated, (1992), 3 pgs.
“Image Processing of Open-Ended Questions”,UNISCORE, Incorporated, (1992), 4 pgs.
Anderson, Jonathan, “The Role of the Computer in Assessment: Recent Developments in Australia [Journal Paper]”,Journal of Educational Processing, vol. 10, No. 1-2, USA, (1973),4-11.
Brown, Peter, et al., “Validation: Cost effective eternal evaluation”,Australian Journal of Education Technology, 6(2), (1990), 1-6.
Cason, Gerald J., et al., “Integrated Test Scoring, Performance Rating and Assessment Records Keeping”,Innovations in Medical Education, Association of American Medical Colleges, Washington, D.C.., Paper presented at the annual meeting of the Association of Medical Colleges.,(Nov. 1, 1987),2-20.
Epstein, Marion G., “Computer Assisted Assembly of Tests at Educational Testing Service”,Educational Technology, (Mar. 1, 1973),23-24.
Feldker, Paul , “Online Computer Testing with Networked Apple II Microcomputers [Conference Paper]”,Conference on Computers in Physics Instruction. Proceedings. Addison-Wesley. Redwood City, CA, USA, (1990),510-511.
Foxon, Marguerite , “Evaluation of training and development programs: A review of the literature”,Australian Journal of Educational Technology, 5 (2), (1989),1-16.
Garris, Michael D., et al., “NIST Scoring Package User's Guide Release 1.0”,NTIS, U.S. Department of Commerce, Technology Administration, National Institute of Standards and Technology, Oct. 1992, NISTIR 4950, 76 pgs.
Gathy, P., et al., “Computer-Assisted Self-Assessment (CASA)
Edenborg Michelle
Gedlinske Mark
Kirkeby Doyle
Data Recognition Corporation
Le Toan M.
Schwegman Lundberg Woessner & Kluth P.A.
LandOfFree
Priority system and method for processing standardized tests does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Priority system and method for processing standardized tests, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Priority system and method for processing standardized tests will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3305047