Education and demonstration – Question or problem eliciting response – Grading of response form
Reexamination Certificate
2001-03-05
2004-10-26
Harris, Chandra L. (Department: 3714)
Education and demonstration
Question or problem eliciting response
Grading of response form
C382S317000
Reexamination Certificate
active
06810232
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to a method and apparatus for organizing and tracking the workflow of test question responses provided by a test taker and captured as electronic images.
BACKGROUND OF THE INVENTION
The scoring of test question responses that cannot be scored by machine is typically carried out manually or by presentation on a computer monitor. Manual scoring involves a human manually scoring a physical test question response sheet. Scoring by presentation to a human of the test question responses using a computer involves scoring an electronic representation of the test question response or responses presented to a scorer via a computer monitor or other machine that can be programmed to manipulate symbols. It is the latter scoring procedure to which the present invention relates.
In order to present a test question response to a scorer viewing a computer monitor, several preparation steps typically occur to enable the scorer to receive the test question response, view it, score it and record the score with the necessary precision, speed and accuracy required in the test scoring industry. With test processing that analyzes optically imaged test question responses, scanners, facsimile machines and other optical imaging devices known to those skilled in the art are used to create an electronic image of the test question response that was provided by a test taker. The electronic images may be broken down into smaller images generally referred to as image clips. The electronic images and image clips may be stored in a computer or other storage media known to those skilled in the art. Multiple optical imaging devices of varying types are often used in a distributed test processing system. The electronic images and image clips are then often converted to data using well known and commercially available optical character recognition software, image character recognition software and other similar computer programs. The data or images, or both, can then be utilized in a number of ways to aid the test scoring process.
A problem typically faced in the test processing industry, especially when imaging of the test question responses is utilized, is the difficulty in organizing and tracking the workflow of the test question response images simply and inexpensively in a server/client workflow system. The problem is magnified when different types of optical image devices (e.g., different types of scanners) are used to generate the electronic images. It will be appreciated that accuracy and reliability are of primary concern in the test question response industry. It is critical that all test items received are processed. Often, a client will want the test answer documents analyzed in different sub-sets. The result to-date often was a decrease in volume and turn-around time of customer projects.
SUMMARY OF THE INVENTION
The present test question response workflow tracking method and system increases the volume and speed of test question responses processed by improving the distribution and tracking of the electronic images of the test question responses. The tracking method and system also ensure that all test items received are processed.
In the method, electronic images of test question responses are stored on a server subsystem. Depending on what kind of optical imaging equipment is used, each image covers either one page (one side of a sheet of paper) or a small region of a page known as a clip. A clip contains one item of information, such as the answer to one test question or some information about the person taking the test.
The test question responses are organized in batches for production of the electronic images, and the association of each image with its batch is preserved during all subsequent processing. Images are held in TIFF (tagged image file format) files and each image is tagged with an individual digital identifier (IDI) that uniquely identifies it. The IDI contains all the information about the image that the system requires for displaying it in the correct context. Holding this information in the IDI, rather than in a database, permits faster retrieval of the data when the image needs to be displayed. It has the added benefit of avoiding any risk of the image becoming separated from the relevant data.
Human operators using computers connected to the server through a network may view the images and may enter data that they derive from the images into a corresponding database record. Information within the IDI is used to link the image to the correct database record.
When the processing of a batch of test question responses is complete, a report may be generated from the database. The completeness of each batch is ensured by comparing the number of test question responses processed with the number originally assigned to the batch.
REFERENCES:
patent: 3405457 (1968-10-01), Bitzer
patent: 3538626 (1970-11-01), Frank
patent: 3762072 (1973-10-01), From
patent: 3932948 (1976-01-01), Goddard et al.
patent: 4004354 (1977-01-01), Yamauchi
patent: 4151659 (1979-05-01), Lien et al.
patent: 4205780 (1980-06-01), Burns et al.
patent: 4478584 (1984-10-01), Kaney
patent: 4518267 (1985-05-01), Hepp
patent: 4518361 (1985-05-01), Conway
patent: 4553261 (1985-11-01), Froessl
patent: 4627818 (1986-12-01), Von Fellenberg
patent: 4648062 (1987-03-01), Johnson et al.
patent: 4671772 (1987-06-01), Slade et al.
patent: 4694352 (1987-09-01), Ina et al.
patent: 4705479 (1987-11-01), Maron
patent: 4708503 (1987-11-01), Poor
patent: 4715818 (1987-12-01), Shapiro et al.
patent: 4741047 (1988-04-01), Sharpe, II
patent: 4760246 (1988-07-01), Shepard
patent: 4764120 (1988-08-01), Griffin et al.
patent: 4798543 (1989-01-01), Spiece
patent: 4845739 (1989-07-01), Katz
patent: 4867685 (1989-09-01), Brush et al.
patent: 4878175 (1989-10-01), Norden-Paul et al.
patent: 4895518 (1990-01-01), Arnold et al.
patent: 4908759 (1990-03-01), Alexander, Jr. et al.
patent: 4930077 (1990-05-01), Fan
patent: 4937439 (1990-06-01), Wanninger et al.
patent: 4958284 (1990-09-01), Bishop et al.
patent: 4978305 (1990-12-01), Kraft
patent: 4996642 (1991-02-01), Hey
patent: 5002491 (1991-03-01), Abrahamson et al.
patent: 5003613 (1991-03-01), Lovelady et al.
patent: 5011413 (1991-04-01), Ferris et al.
patent: 5023435 (1991-06-01), Deniger
patent: 5035625 (1991-07-01), Munson et al.
patent: 5038392 (1991-08-01), Morris et al.
patent: 5054096 (1991-10-01), Beizer
patent: 5058185 (1991-10-01), Morris et al.
patent: 5059127 (1991-10-01), Lewis et al.
patent: 5072383 (1991-12-01), Brimm et al.
patent: 5086385 (1992-02-01), Launey et al.
patent: 5100329 (1992-03-01), Deesen et al.
patent: 5101447 (1992-03-01), Sokoloff et al.
patent: 5103490 (1992-04-01), McMillin
patent: 5105354 (1992-04-01), Nishimura
patent: 5119433 (1992-06-01), Will
patent: 5134669 (1992-07-01), Keogh et al.
patent: 5140650 (1992-08-01), Casey et al.
patent: 5147205 (1992-09-01), Gross et al.
patent: 5151948 (1992-09-01), Lyke et al.
patent: 5176520 (1993-01-01), Hamilton
patent: 5180309 (1993-01-01), Egnor
patent: 5195033 (1993-03-01), Samph et al.
patent: 5204813 (1993-04-01), Samph et al.
patent: 5211564 (1993-05-01), Martinez et al.
patent: 5258855 (1993-11-01), Lech et al.
patent: 5259766 (1993-11-01), Sack et al.
patent: 5261823 (1993-11-01), Kurokawa
patent: RE34476 (1993-12-01), Norwood
patent: 5267865 (1993-12-01), Lee et al.
patent: 5294229 (1994-03-01), Hartzell et al.
patent: 5302132 (1994-04-01), Corder
patent: 5310349 (1994-05-01), Daniels et al.
patent: 5318450 (1994-06-01), Carver
patent: 5321611 (1994-06-01), Clark et al.
patent: 5344132 (1994-09-01), LeBrun et al.
patent: 5376007 (1994-12-01), Zirm
patent: 5379213 (1995-01-01), Derks
patent: 5387104 (1995-02-01), Corder
patent: 5416312 (1995-05-01), Lamoure
patent: 5418865 (1995-05-01), Bloomberg
patent: 5433615 (1995-07-01), Clark
patent: 5437554 (1995-08-01), Clark et al.
patent: 5452379 (1995-09-01), Poor
patent: 5458493 (1995-10-01), Clark et al.
patent: 5466159 (1995-11-01), Clark et al.
patent: 5496175 (1996-03-01), Oyama et al.
patent: 5544255 (1996-
Knowles Kristian
Pascale Robert Nicola
Harris Chandra L.
NCS Pearson, Inc.
LandOfFree
Test processing workflow tracking system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Test processing workflow tracking system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Test processing workflow tracking system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3309919