Data processing: artificial intelligence – Neural network
Reexamination Certificate
2000-08-18
2004-03-09
Khatri, Anil (Department: 2122)
Data processing: artificial intelligence
Neural network
C706S016000, C706S050000, C706S025000
Reexamination Certificate
active
06704717
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates in general to a relational database management system, and in particular, to an enhanced back-propagation neural network application that creates analytic models from the data residing in a relational database.
2. Description of Related Art
Relational databases are the predominate form of database management systems used in computer systems. Relational database management systems are often used in so called “data warehouse” applications where enormous amounts of data are stored and processed. In recent years, several trends have converged to create a new class of data warehousing applications known as data mining applications. Data mining is the process of identifying and interpreting patterns in databases, and can be generalized into three stages.
Stage one is the reporting stage, which analyzes the data to determine what happened. Generally, most data warehouse implementations start with a focused application in a specific functional area of the business. These applications usually focus on reporting historical snap shots of business information that was previously difficult or impossible to access. Examples include Sales Revenue Reporting, Production Reporting and Inventory Reporting to name a few.
Stage two is the analyzing stage, which analyzes the data to determine why it happened. As stage one end-users gain previously unseen views of their business, they quickly seek to understand why certain events occurred; for example, a decline in sales revenue. After discovering a reported decline in sales, data warehouse users will then obviously ask, “Why did sales go down?” Leaming the answer to this question typically involves probing the database through an iterative series of ad hoc or multidimensional queries until the root cause of the condition is discovered. Examples include Sales Analysis, Inventory Analysis or Production Analysis.
Stage three is the predicting stage, which tries to determine what will happen. As stage two users become more sophisticated, they begin to extend their analysis to include prediction of unknown events. For example, “Which end-users are likely to buy a particular product”, or “Who is at risk of leaving for the competition?” It is difficult for humans to see or interpret subtle relationships in data, hence as data warehouse users evolve to sophisticated predictive analysis they soon reach the limits of traditional query and reporting tools. Data mining helps end-users break through these limitations by leveraging intelligent software tools to shift some of the analysis burden from the human to the machine, enabling the discovery of relationships that were previously unknown.
Many data mining technologies are available, from single algorithm solutions to complete tool suites. Most of these technologies, however, are used in a desktop environment where little data is captured and maintained. Therefore, most data mining tools are used to analyze small data samples, which were gathered from various sources into proprietary data structures or flat files. On the other hand, organizations are beginning to amass very large databases and end-users are asking more complex questions requiring access to these large databases.
Unfortunately, most data mining technologies cannot be used with large volumes of data. Further, most analytical techniques used in data mining are algorithmic-based rather than data-driven, and as such, there are currently little synergy between data mining and data warehouses. Moreover, from a usability perspective, traditional data mining techniques are too complex for use by database administrators and application programmers, and are too difficult to change for a different industry or a different customer.
Thus, there is a need in the art for data mining applications that directly operate against data warehouses, and that allow non-statisticians to benefit from advanced mathematical techniques available in a relational environment.
SUMMARY OF THE INVENTION
To overcome the limitations in the prior art described above, and to overcome other limitations that will become apparent upon reading and understanding the present specification, the present invention discloses a method, apparatus, and article of manufacture for performing data mining applications in a relational database management system. At least one analytic algorithm for enhanced back-propagation neural network processing is performed by a computer, wherein the analytic algorithm for enhanced back-propagation neural network processing includes SQL statements performed by the relational database management system directly against the relational database and programmatic iteration. The analytic algorithm for enhanced back-propagation neural network processing operates on data in the relational database that has been partitioned into training, test and validation data sets. The analytic algorithm for enhanced back-propagation neural network processing maps data in a training data set to nodes in the neural network, wherein the data is processed as it moves from an input node of the neural network through a hidden node of the neural network to an output node of the neural network In addition, the analytic algorithm for enhanced back-propagation neural network processing determines an error difference between the output node's value and a target value as the data is mapped to the output node in the neural network, and changes a weight value for one or more of the nodes based on an accumulation of the error difference for the node, in order to get the neural network to converge on a solution. Finally, the analytic algorithm for enhanced back-propagation neural network processing cross-validates the changed weight value to prevent overfitting the node.
An object of the present invention is to provide more efficient usage of parallel processor computer systems. An object of the present invention is to provide a foundation for data mining tool sets in relational database management systems. Further, an object of the present invention is to allow data mining of large databases.
REFERENCES:
patent: 5701400 (1997-12-01), Amado
patent: 5765028 (1998-06-01), Gladden
patent: 5933818 (1999-08-01), Kasravi et al.
patent: 5970482 (1999-10-01), Pham et al.
The KDD Process for Extracting Useful Knowledge from Volumes of Data, Usama Fayyad, Gregory Paitetsky-Shapiro, Padhriac Smyth, Communications of the ACM, Nov. 1996/vol. 30, No. 11, pps. 27-34.*
Strategic Directions in Artificial Intelligence, Jon Doyle, Thomas Dean et al., ACM Computing Surveys, vol. 28, No. 4, Dec. 1996, pps. 653-670.*
Discovering Internet Marketing Intelligence through Online Analytical Web Usage Mining, Alex G. Bucher, Maurice D. Mulvenna, ACM SIGMOND Record, vol. 27, No. 4, Dec. 1998, pps. 54-61.*
Application of Intelligent Agent Technology for Managerial Data Analysis and Mining, Ranjit Bose, Vijayan Sugumaran, The Database for Advances in Information Systems—Winter 1999 (vol. 30, No. 1) pps. 77-94.*
Towards On-Line Analytical Mining in Large databases, Jiawei Han, ACM SIGMOND Record, vol. 27, Issue, (Mar. 1998) pps. 07-107.*
Intuitive Decision-Making, Viki L. Sauter, Communications of the ACM Jun. 1999/vol. 42, No. 6, 109-115.*
Data Clustering: A Review, A.K. Jainj, M.N. Murty, P.J. Flynn, ACM Computing Surveys, vol. 31, No. 3, Sep. 1999, pps. 264-323.
Gates & Cooper LLP
Holmes Michael B.
Khatri Anil
NCR Corporation
LandOfFree
Analytic algorithm for enhanced back-propagation neural... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Analytic algorithm for enhanced back-propagation neural..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Analytic algorithm for enhanced back-propagation neural... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3292244