Data processing: database and file management or data structures – Database design – Data structure types
Reexamination Certificate
1999-10-07
2002-08-20
Shah, Sanjiv (Department: 2174)
Data processing: database and file management or data structures
Database design
Data structure types
C707S793000
Reexamination Certificate
active
06438538
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates in general to database management systems performed by computers, and in particular to the optimized data replication technique utilizing incrementally maintained base aggregations of a dynamically increasing computer database, usable in data warehousing scenarios.
2. Description of Related Art
Databases are computerized information storage and retrieval systems. A Relational Database Management System (RDBMS) is a database management system (DBMS) which uses relational techniques for storing and retrieving data. RDBMS software using a Structured Query Language (SQL) interface is well known in the art. The SQL interface has evolved into a standard language for RDBMS software and has been adopted as such by both the American National Standards Organization (ANSI) and the International Standards Organization (ISO).
In RDBMS software all data is externally structured into tables. The SQL interface allows users to formulate relational operations on the tables either interactively, in batch files, or embedded in host language, such as C, COBOL, etc. Operators are provided in SQL that allow the user to manipulate the data, wherein each operator operates on either one or two tables and produces a new table as a result. The power of SQL lies on its ability to link information from multiple tables or views together, to perform complex sets of procedures with a single statement.
One of the most common SQL queries executed by RDBMS software is the SELECT statement. In the SQL standard, the SELECT statement generally has the format: “SELECT <clause> FROM <clause> WHERE <clause> GROUP BY <clause> HAVING <clause> ORDER BY <clause>.” The clauses generally must follow this sequence. Only the SELECT and FROM clauses are required and all other clauses are optional.
Generally, the result of a SELECT statement is a subset of data retrieved by the RDBMS software from one or more existing tables stored in the relational database, wherein the FROM clause identifies the name of the table or tables from which data is being selected. The subset of data is treated as a new table, termed the result table. The WHERE clause determines which rows should be returned in the result table. Generally, the WHERE clause contains a search condition that must be satisfied by each row returned in the result table. The rows that meet the search condition form an intermediate set, which is then processed further according to specifications in the SELECT clause. The search condition typically comprises one or more predicates, each of which specifies a comparison between two values from certain columns, constants or correlated values. Multiple predicates in the WHERE clause are typically connected by Boolean operators.
The SELECT statement may also include a grouping function indicated by the GROUP BY clause. The GROUP BY clause causes the rows in the intermediate result set to be grouped according to the values specified in the clause. A number of column or aggregate functions are also built into SQL, such as MAX (maximum value in column), MIN (minimum value in column), AVG (average of values in column), SUM (sum of values in column), and COUNT (number of rows).
Queries using aggregate expressions return as many result rows as there exist unique “result groups” in the source of the aggregation. A result group is defined as the set of values contained in the fields of a row corresponding to the list of columns or expressions specified in the GROUP BY clause of the query. The value of the aggregate function is the cumulative result of applying the function to the result of the contained expression, for each row having the same result group.
A data warehouse is a subject-oriented, integrated, non-volatile, time-variant collection of data suited to the decision support needed at a certain network location of the enterprise data environment. For this purpose the IBM company created several replication products. One such product is named DataPropagator Relational Version 5.1, useable for AS/400 systems, having such features as efficient architecture for automatic capture and asynchronous propagation of data changes to DB2 databases, applicable for building data warehouses and creating client/server, distributed, or mobile applications. This product provides for automatic maintenance of consistent copies of relational data in the databases, and has a change-capture component that captures all application table changes. It utilizes subscription sets for transaction consistency, and supports full refresh and update change replication, update-anywhere replication, DB2 views-based replication, event-driven and continuous replication. Replication can help decrease batch workloads by replicating data in the background throughout the day.
Businesses today benefit from replicating data across a range of applications and business sites, to improve business cycle times and customer responsiveness. Frequently, these applications must share data with legacy applications on the host. Data replication can automatically deliver the shared data to the target platform, improving data availability and data access performance, and accommodating data restructuring and minimizing network load. This can improve employees' decision making capabilities. The decision-support databases assist in day-to-day decision-making activities, from determining what items to stock in various stores, to identifying customer sets for new products.
Data replication can improve application deployment and the existing application backlog can be reduced, since the majority of these applications are based on the relational model and use standard SQL. Data replication enables use of these applications by mapping, reformatting, and delivering data from legacy environments to relational databases elsewhere. In order to increase online throughput, replication supports off-load query processing to make room for increasing transaction processing requirements. Off-loading query processing reduces contention that impacts online transaction processing (OLTP) response time. Businesses are migrating applications from legacy systems or replicating data between multivendor environments. This reduces application development time and reduces application maintenance costs.
DataPropagator Relational, 5.1 provides read-only, update-anywhere, and on-demand replication between relational source and target processors. It consists of the following autonomous components and programs. Administration and replication control is performed by Control Center, Capture utility is used to capture changes made to data on replication sources, and Apply utility reads previously captured changed data and applies it to target tables.
The Control Center is used to define tables as sources, called replication sources, define target table definitions, called replication subscriptions, clone replication subscriptions to other servers and remove replication sources or subscriptions no longer needed. Whenever a replication request from the Control Center is submitted, such as a command defining a replication source, the processing information is generated as SQL statements. The statements may be run immediately, or saved in a file, which can be edited and the statements can be run at a later time from a replication folder object in the Control Center. Deferred SQL files let a user customize the replication tasks for his application needs.
The Capture component captures changes made to data in tables defined as replication sources by reading the database transaction log or journal, without making any changes to the sources, and is performed asynchronously to business applications using the same replication sources. The captured changes are placed in staging tables, with transaction detail stored separately in a Unit of Work (UOW) table.
The Apply component reads the changed data, previously captured and stored in a staging table, and applies it to the target tables. Apply components can also read
International Business Machines - Corporation
Oppenheimer Wolff & Donnelly LLP
Shah Sanjiv
LandOfFree
Data replication in data warehousing scenarios does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Data replication in data warehousing scenarios, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Data replication in data warehousing scenarios will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2885203