Systems and methods for data quality management

Details Systems and methods for data quality management Systems and methods for data quality management

1996-11-27

1998-11-24

Black, Thomas G.

Data processing: database and file management or data structures

Database design

Data structure types

707 2, 707 4, 707 5, 707 6, 707 7, G06F 1700

Patent

active

058422021

ABSTRACT:
Systems and methods that model and measure the propagation of error within information systems. The invention provides data management systems that determine an error measure that represent the accuracy, or inaccuracy of a query result achieved for processing a structured data set. In one embodiment, the invention provides systems that have a model of error which exists within a structured data set. The system can further include an error propagation monitor that processes the error model and the structured data set to determine errors within the structured data set that will propagate to a query result generated by performing a query process on the structured data set. The propagated error represents the error that exists within the query result signal.

REFERENCES:
patent: 5410493 (1995-04-01), Konayaga
patent: 5495567 (1996-02-01), Iizawa et al.
patent: 5524240 (1996-06-01), Barabara et al.
patent: 5553284 (1996-09-01), Barbara et al.
patent: 5625767 (1997-04-01), Bartell et al.
patent: 5671403 (1997-09-01), Shekita et al.
Ballou, D.P., & Pazer, H. L., "Modeling Data and Process Quality in Multi-input, Multi-output Information Systems", Management Science, Vol. 31, No. 2, pp. 150-162, 1985.
Bunge, Mario, Treatise on Basic Philosophy, Epistemology and Methodology I: Exploring the World, vol. 5, pp. 72-75, 250-253, Reidel, Boston, 1983.
Fuller, W. A., Measurement Error Models, pp. 1-13, John Wiley & Sons, New York, 1987.
Groves, R. M., "Measurement Error Across the Disciplines," in Biemer, P., Groves, R., Lyberg, L, Mathiowetz, N., and Sudman, S. (Ed(s)),Measurement Errors in Surveys, pp. 1-25, John Wiley and Sons, New York, 1991.
Kennedy, P., A Guide to Econometrics, pp. 111-125, MIT Press, Cambridge, Mass, 1985.
Kish, L., "Diverse Adjustments for Missing Data", Proceedings of the 1980 Conference on Census Undercount, pp. 83-87, Arlington, Va., 1980.
LePage, N., "Data Quality Control at United States Fidelity and Guaranty Company", In Liepens, G. E. & Uppuluri, V. R. R., (Ed(s.)), Data Quality Control: Theory and Pragmatics, pp. 25-41, Marcel Dekker, Inc., New York, 1990.
McCarthy, J. L., "Scientific Information = Data + Meta-data", LBL-19086, Lawrence Berkeley Laboratory, University of California, Berkeley, California, 1985.
Morey, R. C., "Estimating and Improving Quality of Information in the MIS", Communications of the Association for Computing Machinery, vol. 25, No. 5, pp. 337-342, no date.
Reiter, R., "Towards a Logical Reconstruction of Relational Database Theory", In Brodie, M., Mylopolous, J., & Schmidt, J., (Ed(s.)), On Conceptual Modeling: Perspectives from Al, Databases, and Programming Languages, pp. 191-233, Springer-Verlag, New York, 1984.
Wand, Y., & Weber, R., "Mario Bunge's Ontology as a Formal Foundation for Information Systems Concepts", In Weingartner P., & Dorn, G. J. W., (Ed(s.)), Studies on Mario Bunge's Treatise, pp. 123-150, Rodopi, Amsterdam, 1990.
Barbara, D., Garcia-Molina, H., Porter, D., "The Management of Probabilistic Data", IEEE Transactions on Knowledge and Data Engineering, vol. 4, No. 5, pp. 487-502 (Oct. 1992).
Biskup, J., "A Foundation of Codd's Relational Maybe-Operations", ACM Transactions on Database Systems, vol. 8, No.4, pp. 608-636 (Dec. 1983).
Cavallo, R., Pittarelli, M., "The Theory of Probabilistic Database", Proceedings of the 13th VLDB Conference, Brighton, England, pp. 71-81 (1987).
Imielinski, T., Lipski, W. Jr., "Incomplete Information in Relational Databases", Journal of the Association for Computing Machinery, vol. 31, No.4, pp. 761-791 (Oct. 1984).
Kon, H. B., Madnick, S. E., Siegel, M. D., "Good Answers from Bad Data: A Data Management Strategy", MIT Sloan School of Management WP#3868, pp. Abstract, 1-16 (Dec. 1995).
Meyen, D. M., Willshire, M. J., "A Data Quality Engineering Process"Proceedings of the 1996 Conference on Information Quality, Massachusetts Institute of Technology, pp. 221-236 (Oct. 1996).
Motro, A., "Integrity = Validity + Completeness", ACM Transactions on Database Systems, vol. 14, No. 4, pp. 480-502 (Dec. 1989).
Motro, A., Rakov, I., "estimating the Quality of Data in Relational Databases", Proceedings of the 1996 Conference on Information Quality, Massachusetts Institute of Technology, pp. 94-106 (Oct. 1996).
Orman, L., Storey, V. C., Wang, R. Y., "Systems Approaches to Improving Data Quality", Proceedings of the 1996 Conference on Information Quality, Massachusetts Institute of Technology pp. 117-126 (Oct., 1996).
Agmon, N., & Ahituv, N., "Assessing Data Reliability in an Information System", Journal of Management Information Systems, vol. 4, No. 2, pp. 34-44, Fall, 1987.
Ballou, D. P., & Kumar Tayi, G., "Methodology for Allocating Resources for Data Quality Enhancement", Communications of the ACM, vol. 32, No. 3, pp. 320-329, Mar., 1989.
Barabba, V. P., "Welcome and Introduction"Proceedings of the 1980 Conference on Census Undercount, pp. 9-11, Arlington, Virginia, Jul., 1980.
Biemer, P., & Stokes, S. L., "Approaches to the Modeling of Measurement Error", In Biemer, P., Groves, R., Lyberg, L., Mathiowetz, N., & Sudman, S. (Ed(s)), Measurement Errors in Surveys, pp. 487-497, John Wiley & Sons, New York, 1991.
Codd, E. F., "Extending the Database Relational Model to Capture More Meaning", ACM Transactions on Database Systems, vol. 4, pp. 397-434, Dec., 1979.
Codd, E. F., "A Relational Model of Data for Large Shared Data Banks", Communications of the ACM, vol. 13, No. 6, pp. 377-387, Jun. 1970.
Collett, C., Huhns, M. N., & Shen, W., "Resource Integration Using a Large Knowledge Base in Carnot", Computer, pp. 55-62, Dec., 1991.
Demichiel, L. G., "Resolving Database Incompatibility: An Approach to Performing Relational Operations over Mismatched Domains", IEEE Transactions on Knowledge and Data Engineering, vol. 1, No. 4, pp. 485-493, Dec., 1989.
Erickson, E. P., "Can Regression Be Used to Estimate Local Undercount Adjustments?", Proceedings of the 1980 Conference on Census Undercount, pp. 55-61, Arlington, Virginia, Jul., 1980.
Grant, J., "Incomplete Information in a Relational Database", Annales Societatis Mathematicae Polonae; Series IV: Fundamenta Informaticae III vol. 3, pp. 363-377, 1980.
Howard J. A., "Introduction: Noisy Data--A Common Problem in Social Research" in Farley, J. U., & Howard, J. A., Control of Error in Market Research Data, pp. 1-9, Lexington Books, Lexington, Massachusetts, 1975.
Johnson, J. R., Leitch, R. A., & Neter, J., "Characteristics of Errors in Accounts Receivable and Inventory Audits", Accounting Review, vol. 56, No. 2, pp. 270-293, Apr., 1981.
Johnston, D. C., "IRS Is Preparing a Tough Audit for Groups of Unwary Taxpayers", NY Times, (Jul. 19, 1995), p. 1.
Klug, A., "Equivalence of Relational Algebra and Relational Calculus Query Languages Having Aggregate Functions", Journal of the Association for Computing Machinery, vol. 29, No. 3, pp. 669-717, Jul. 1982.
Laudon, K. C., "Data Quality and Due Process in Large Interorganizational Record Systems", Communications of the ACM, vol. 29, No. 1, pp. 4-11, Jan., 1986.
Lipski, W., "On Semantic Issues Connected With Incomplete Information Databases", ACM Transactions on Database Systems, vol. 4, No. 3, pp. 262-296, Sep., 1979.
Litwin, W., & Abdellatif, A., "Multidatabase Interoperability", Computer, pp. 10-18, Dec., 1986.
Madnick, S. E., "From VLDB to VMLDB (Very MANY Large Data Bases): Dealing with Large-Scale Semantic Heterogeneity", Proceedings of the 21st International Very Large Database Conference, pp. 11-16, Zurich, Switzerland, 1995.
Madnick, S. E., "The Voice of the Customer: Innovative and Useful Research Directions", Proceedings of the 19th International Very Large Database Conference, pp. 701-704, Dublin, Ireland, 1993.
Madnick, S. E., & Wang, R. Y. (1992). Introduction to the TDQM Research Program; TDQM Working Paper, TDQM-92-01. pp. 1-7, Massachusetts Institute of Technology, Cambridge, Massachusetts, May, 1992.
McCarthy, J. L., "Metadata Management for Large Statistical Databases", Proceedings of the 8th International Very Large Database Conference, pp. 234-243, Mexico City, Mexico, 1982.
Paradice, D. B., & Fuers

Affiliated with

Also associated with

Rating

Systems and methods for data quality management does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Systems and methods for data quality management, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Systems and methods for data quality management will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1715124