Test question response verification system

Image analysis – Pattern recognition

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C434S354000, C434S324000, C709S241000

Reexamination Certificate

active

06751351

ABSTRACT:

FIELD OF THE INVENTION
The present invention relates to a system and method for verifying and editing optically imaged responses received from a response provider.
BACKGROUND OF THE INVENTION
The scoring of test question responses that cannot be scored by machine is typically carried out manually or by presentation on a computer monitor. Manual scoring involves a human manually scoring a physical test question response sheet. Scoring by presentation to a human of the test question responses using a computer involves scoring an electronic representation of test question response or responses presented to a scorer via a computer monitor or other machine that can be programmed to manipulate symbols. It is the latter scoring procedure to which the present invention relates.
In order to present a test question response to a scorer viewing a computer monitor, several preparation steps typically occur to enable the scorer to receive the test question response, view it, score it and record the score with the necessary precision, speed and accuracy required in the test scoring industry. With test processing that analyzes optically imaged test question responses, scanners, facsimile machines and other optical imaging devices known to those skilled in the art are used to create an electronic image of the test question response that was provided by a test taker. The electronic images may be broken down into smaller images generally referred to as image clips. The electronic images and image clips may be stored in a computer or other storage media known to those skilled in the art. The electronic images and image clips are typically extracted to data using well known and commercially available optical character recognition software, image character recognition software and other similar computer programs. The data can then be utilized in a number of ways to aid the test scoring process.
While character recognition software programs have improved greatly, a need still exists to verify the results of the image conversion. Verification is especially important in the test scoring industry where test takers' scores may depend on the accuracy of the data extracted from the electronic images of the test question responses. Most character recognition software programs provide an automatic verification process performed electronically; however, even those results often are subject to a relatively high rate of error. In many situations, human editors use computer monitors at remotely-located geographic locations to verify the accuracy of the data extracted from the electronic images. A workflow system may be utilized to present to the editors data or images, or both, from which they are to verify accuracy.
Several problems using human editors to verify converted images have been identified. Editors often lack particular skills desired to analyze all types of data that may have been extracted from images. For example, if the test taker used Chinese characters to indicate his/her test question responses, editors not fluent in Chinese would find it difficult to analyze the information presented to them. Similarly, editors not comfortable with the numerous and complex symbols used on math tests may find it difficult to analyze the math test question responses presented to them.
The slow speed at which editors typically have analyzed the data extracted from images has also been a problem. Editors were randomly presented with data and/or images in need of analysis. For instance, an editor might be first presented with the image or the image and data of the test taker's first name. Rather than presenting a last name or middle initial to the editor next, the editor might be presented with the image or the image and data of a math test question response. The random nature of the materials presented to editors slowed their process in verifying the data extracted.
SUMMARY OF THE INVENTION
The present distributed test processing workflow system facilitates accurate, consistent and high quality image capture, conversion to data and verification of test question responses provided by a test taker.
The present verification editing method divides test question response images into smaller images or “image clips” for conversion to data using well known image recognition software. In the method, it is determined whether the particular data obtained from the image clips requires verification. If verification is required, information related to each image clip is processed against particular appropriate skills of human editors in order to select human editors having particular appropriate skills. Selected image clips are then recompiled into coherent image portions of the test question response and selectively presented, with or without corresponding data, to the human editor for analysis. Finally, the decisions of the human editor are electronically recorded.


REFERENCES:
patent: 3405457 (1968-10-01), Bitzer
patent: 3538626 (1970-11-01), Frank
patent: 3762072 (1973-10-01), From
patent: 3932948 (1976-01-01), Goddard et al.
patent: 4004354 (1977-01-01), Yamauchi
patent: 4151659 (1979-05-01), Lien et al.
patent: 4205780 (1980-06-01), Burns et al.
patent: 4478584 (1984-10-01), Kaney
patent: 4518267 (1985-05-01), Hepp
patent: 4518361 (1985-05-01), Conway
patent: 4553261 (1985-11-01), Froessl
patent: 4627818 (1986-12-01), Von Fellenberg
patent: 4648062 (1987-03-01), Johnson et al.
patent: 4671772 (1987-06-01), Slade et al.
patent: 4694352 (1987-09-01), Ina et al.
patent: 4705479 (1987-11-01), Maron
patent: 4708503 (1987-11-01), Poor
patent: 4715818 (1987-12-01), Shapiro et al.
patent: 4741047 (1988-04-01), Sharpe, II
patent: 4760246 (1988-07-01), Shepard
patent: 4764120 (1988-08-01), Griffin et al.
patent: 4798543 (1989-01-01), Spiece
patent: 4845739 (1989-07-01), Katz
patent: 4867685 (1989-09-01), Brush et al.
patent: 4878175 (1989-10-01), Norden-Paul et al.
patent: 4895518 (1990-01-01), Arnold et al.
patent: 4908759 (1990-03-01), Alexander, Jr. et al.
patent: 4930077 (1990-05-01), Fan
patent: 4937439 (1990-06-01), Wanninger et al.
patent: 4958284 (1990-09-01), Bishop et al.
patent: 4978305 (1990-12-01), Kraft
patent: 4996642 (1991-02-01), Hey
patent: 5002491 (1991-03-01), Abrahamson et al.
patent: 5003613 (1991-03-01), Lovelady et al.
patent: 5011413 (1991-04-01), Ferris et al.
patent: 5023435 (1991-06-01), Deniger
patent: 5035625 (1991-07-01), Munson et al.
patent: 5038392 (1991-08-01), Morris et al.
patent: 5054096 (1991-10-01), Beizer
patent: 5058185 (1991-10-01), Morris et al.
patent: 5059127 (1991-10-01), Lewis et al.
patent: 5072383 (1991-12-01), Brimm et al.
patent: 5086385 (1992-02-01), Launey et al.
patent: 5100329 (1992-03-01), Deesen et al.
patent: 5101447 (1992-03-01), Sokoloff et al.
patent: 5103490 (1992-04-01), McMillin
patent: 5105354 (1992-04-01), Nishimura
patent: 5119433 (1992-06-01), Will
patent: 5134669 (1992-07-01), Keogh et al.
patent: 5140650 (1992-08-01), Casey et al.
patent: 5147205 (1992-09-01), Gross et al.
patent: 5151948 (1992-09-01), Lyke et al.
patent: 5176520 (1993-01-01), Hamilton
patent: 5180309 (1993-01-01), Egnor
patent: 5195033 (1993-03-01), Samph et al.
patent: 5204813 (1993-04-01), Samph et al.
patent: 5211564 (1993-05-01), Martinez et al.
patent: 5258855 (1993-11-01), Lech et al.
patent: 5259766 (1993-11-01), Sack et al.
patent: 5261823 (1993-11-01), Kurokawa
patent: RE34476 (1993-12-01), Norwood
patent: 5267865 (1993-12-01), Lee et al.
patent: 5294229 (1994-03-01), Hartzell et al.
patent: 5302132 (1994-04-01), Corder
patent: 5310349 (1994-05-01), Daniels et al.
patent: 5318450 (1994-06-01), Carver
patent: 5321611 (1994-06-01), Clark et al.
patent: 5344132 (1994-09-01), LeBrun et al.
patent: 5376007 (1994-12-01), Zirm
patent: 5379213 (1995-01-01), Derks
patent: 5387104 (1995-02-01), Corder
patent: 5416312 (1995-05-01), Lamoure
patent: 5418865 (1995-05-01), Bloomberg
patent: 5433615 (1995-07-01), Clark
patent: 5437554 (1995-08-01), Clark et al.
patent: 5452379 (1995-09-01), Poor
patent: 5458493 (1995-10-01), Clark et al.
patent: 5466159 (1995-11-01), Clark et al.
patent:

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Test question response verification system does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Test question response verification system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Test question response verification system will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-3305377

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.