Patent
1995-12-11
1998-10-06
Banankhan, Majid A.
395670, 39518211, G06F 1100
Patent
active
058190210
ABSTRACT:
Two methods for partitioning the work to be done by a computer program into smaller pieces so that checkpoints may be done more frequently. Initially, a parallel task starts with one or more input data sets having q initial partitions, divides the input data sets into p partitions by some combination of partitioning elements (i.e., partitioners/gatherers), runs an instance of a component program on each of the p partitions of the data, and produces one or more sets of output files, with each set being considered a partitioned data set. The invention is applied to such a task to create a new, "overpartitioned" task as follows: (1) the partitioner is replaced with an "overpartitioner" which divides its q inputs into n*p partitions, for some integer factor n; (2) the component program is run in a series of n execution phases, with p instances of the component program being run at any time. In each phase, each instance of the component program will read one overpartition of the input data and produce one partition of output data; (3) at the end of each of the n execution phases, the system is quiescent and may be checkpointed. A first embodiment explicitly overpartitions input data by using known partitioner programs, communication channels, and gatherer programs to produce overpartitioned intermediate files. The second embodiment dynamically overpartitions input data by arranging for the component programs to consecutively read contiguous subsets of the original input data.
REFERENCES:
patent: 4005391 (1977-01-01), MacPherson
patent: 5363503 (1994-11-01), Gleeson
"Software Schemes of Reconfiguration and Recovery in Distributed Memory Multicomputers Using the Actor Model", Peercy et al, Jun., 1995.
"Ickp: A consistent Checkpointer for Multicomputers", James S. Plank IEEE Parallel & Distributed Technology, 1994.
"Recovery in Distributed Systems Using Optimistic Message Logging and Checkpointing", David B. Johnson, May 1988.
"The Kelne Square Query Decomposer", David Reiner, 1993.
Lasser Cliff
Lordi Robert
Stanfill Craig
Ab Initio Software Corporation
Banankhan Majid A.
LandOfFree
Overpartitioning system and method for increasing checkpoints in does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Overpartitioning system and method for increasing checkpoints in, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Overpartitioning system and method for increasing checkpoints in will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-88746