System, method, and computer-readable medium for dynamic...

Details System, method, and computer-readable medium for dynamic... System, method, and computer-readable medium for dynamic...

2011-05-10

2011-05-10

Trujillo, James (Department: 2159)

Data processing: database and file management or data structures

Database and file access

Query optimization

C707S770000

Reexamination Certificate

active

07941424

ABSTRACT:
A system, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations are provided. Receipt of an excessive number of redistributed rows by a processing module is detected thereby identifying the processing module as a hot processing module. Other processing modules then terminate redistribution of rows to the hot processing module and maintain rows of a skewed table of the join operation that would be redistributed to the hot processing module in a local spool. Rows of a smaller table that would be redistributed to the hot processing module are duplicated to each processing module involved in the join operation. Rows of tables that are to be redistributed by a processing module to any processing module excluding the hot processing module are redistributed accordingly and maintained locally by the processing module. The join operation is completed by merging results of local join data sets of each processing module.

REFERENCES:
patent: 5873074 (1999-02-01), Kashyap et al.
patent: 5978793 (1999-11-01), Kashyap et al.
patent: 7203686 (2007-04-01), Sinclair et al.
patent: 7640257 (2009-12-01), Watzke
patent: 2004/0093320 (2004-05-01), Shin
patent: 2004/0215639 (2004-10-01), Bamford et al.
patent: 2008/0065594 (2008-03-01), Faunce et al.
patent: 2008/0092142 (2008-04-01), Tran et al.
patent: 2008/0228709 (2008-09-01), Muras
patent: 2008/0228710 (2008-09-01), Muras
patent: 2009/0024568 (2009-01-01), Al-Omari et al.
patent: 421408 (1991-04-01), None
M. Bamha et al., An effiicient scalable parallel view maintenance algorithm for shared nothing multi-processor machines, pp. 1-10, publsihed 1999.
David Dewitt et al., Practical Skew Handling in Parallel Joins, 18th VLDB Conference, pp. 1-14, published 1992.
Yu Xu et al., Handling Data Skew in Parallel Joins in Shared-nothing Systems, SIGMOD 2008, pp. 1-10, published Jun. 2008.
Xiaofang Zhou, Handling Data Skew in Parallel Hash Join Computation Using Two-phase Scheduling, IEEE, pp. 527-527, published 1995.

Affiliated with

Also associated with

Rating

System, method, and computer-readable medium for dynamic... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with System, method, and computer-readable medium for dynamic..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System, method, and computer-readable medium for dynamic... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2618745