Monitoring complex data feeds through ensemble testing

Details Monitoring complex data feeds through ensemble testing Monitoring complex data feeds through ensemble testing

2005-12-29

2010-06-29

Charioui, Mohamed (Department: 2857)

Data processing: measuring, calibrating, or testing

Measurement system

Statistical measurement

Reexamination Certificate

active

07747412

ABSTRACT:
Managing and monitoring multiple complex data feeds is a major challenge for data mining tasks in large corporations and scientific endeavors alike. The invention describes an effective method for flagging abnormalities in data feeds using an ensemble of statistical tests that may be used on complex data feeds. The tests in the ensemble are chosen such that the speed and ability to deliver real time decisions are not compromised.

REFERENCES:
patent: 5195095 (1993-03-01), Shah
patent: 5271000 (1993-12-01), Engbersen et al.
patent: 5481548 (1996-01-01), Wallace
patent: 2004/0015793 (2004-01-01), Saxena et al.
patent: 2004/0058652 (2004-03-01), McGregor et al.
patent: 2005/0128872 (2005-06-01), Valero et al.
Preeti Singh, Trimmed mean, Jan. 28, 2003, Six Sigma, pp. 1-2.
Hancong Liu et al., On-line oulier detection and data cleaning, Aug. 15, 2004, Computers & Chemical Engineering, vol. 28, pp. 1635-1647.
T.G. Dietterich, “Ensemble Methods in Machine Learning”, First International Workshop on Multiple Classifer Systems, pp. 1-15, Springer Verlag, 2000, Oregon State University, Corvallis, Oregon USA.
T. Dasu, G.T. Vesonder and J.R. Wright, “Data Quality Through Knowledge Engineering”, ACM SIGKDD, pp. 705-710, 2003.
D. Kifer, S. Ben-David and J. Gehrke, “Detecting Change in Data Streams”, Department of Computer Science, Cornell University, Proceedings of the 30th VLDB Conference, pp. 180-191, Toronto, Canada 2004.
L. Davis and U. Gather, “The Identification of Multiples Outliers”, Journal of the American Statistical Association, vol. 88, No. 423, pp. 782-801, Sep. 1993.
R.L. Mason, C. Champ, N. Tracy, S. Wierda and J. Young, “Assessment of Multivariate Process Control Techniques”, Journal of Quality Technology, vol. 29, No. 2, pp. 140-143, Apr. 1997.
A.J. Duncan, “Quality control and Industrial Statistics”, 4th Edition, 1974.
P.J. Huber, “Robust Statistics”, Wiley Series in Probability and Mathematical Statistics, 1981.
G.Box, G. Jenkis and G. Reinsel, “Time Series Analysis, Forecasting and Control”, 3rd Edition, 1994.
C.R. Rao, “Linear Statistical Inference and Its Applications”, 1965.

Affiliated with

Also associated with

Rating

Monitoring complex data feeds through ensemble testing does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Monitoring complex data feeds through ensemble testing, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Monitoring complex data feeds through ensemble testing will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4241129