Systems and methods for replicating data

Details Systems and methods for replicating data Systems and methods for replicating data

2003-06-30

2010-06-15

Wong, Don (Department: 2163)

Data processing: database and file management or data structures

File or database maintenance

Synchronization

C707S615000, C707S623000, C707S626000, C707S633000, C707S636000

Reexamination Certificate

active

07739233

ABSTRACT:
A system facilitates the distribution and redistribution of chunks of data among multiple servers. The system may identify servers to store a replica of the data based on at least one of utilization of the servers, prior data distribution involving the servers, and failure correlation properties associated with the servers, and place the replicas of the data at the identified servers. The system may also monitor total numbers of replicas of the chunks available in the system, identify chunks that have a total number of replicas below one or more chunk thresholds, assign priorities to the identified chunks, and re-replicate the identified chunks based substantially on the assigned priorities. The system may further monitor utilization of the servers, determine whether to redistribute any of the replicas, select one or more of the replicas to redistribute based on the utilization of the servers, select one or more of the servers to which to move the one or more replicas, and move the one or more replicas to the selected one or more servers.

REFERENCES:
patent: 5548724 (1996-08-01), Akizawa et al.
patent: 5819272 (1998-10-01), Benson
patent: 5832487 (1998-11-01), Olds et al.
patent: 5838921 (1998-11-01), Speeter
patent: 5867657 (1999-02-01), Bolosky et al.
patent: 6070191 (2000-05-01), Narendran et al.
patent: 6292905 (2001-09-01), Wallach et al.
patent: 6324571 (2001-11-01), Hacherl
patent: 6324580 (2001-11-01), Jindal et al.
patent: 6363497 (2002-03-01), Chrabaszcz
patent: 6401121 (2002-06-01), Yoshida et al.
patent: 6463454 (2002-10-01), Lumelsky et al.
patent: 6671688 (2003-12-01), Nikols et al.
patent: 6754773 (2004-06-01), Ulrich et al.
patent: 7069325 (2006-06-01), Lu et al.
patent: 7072979 (2006-07-01), Aviani et al.
patent: 2001/0042073 (2001-11-01), Saether et al.
patent: 2003/0101258 (2003-05-01), Parham
patent: 2003/0120699 (2003-06-01), Hostetter et al.
patent: 2004/0088147 (2004-05-01), Wang et al.
patent: 2004/0122871 (2004-06-01), Hansen et al.
Thomas Anderson et al., “Serverless Network File Systems”, Proceedings of the 15thACM Symposium on Operating System Principles, Copper Mountain Resort, Colorado, Dec. 1995, pp. 1-21.
Remzi H. Arpaci-Dusseau et al., “Cluster I/O with River: Making the Fast Case Common”, Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS '99), Atlanta, Georgia, May 1999, pp. 1-13.
Garth A. Gibson et al., “A Cost-Effective, High Bandwidth Storage Architecture”, Proceedings of the 8thArchitectural Support for Programming Languages and Operating Systems, San Jose, California, Oct. 1998, pp. 1-12.
Barbara Liskov et al., “Replication in the Harp File System”, 13thSymposium on Operating System Principles, Pacific Grove, California, Oct. 1991, pp. 226-238.
David A. Patterson et al., “A Case for Redundant Arrays of Inexpensive Disks (RAID)”, Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, Chicago, Illinois, Sep. 1988, pp. 109-116.
Frank Schmuck et al., “GPFS: A Shared-Disk File System for Large Computing Clusters”, Proceedings in the First USENIX Conference on File and Storage Technologies, Monterey, California, Jan. 2002, pp. 231-244.
Chandramohan A. Thekkath et al., “Frangipani: A Scalable Distributed File System”, Proceedings of the 16thACM Symposium on Operating System Principles, Saint-Malo, France, Oct. 1997, pp. 224-237.
InterMezzo, http://www.inter-mezzo.org, 2003.
Luis-Felipe Cabrera et al., “Swift: Using Distributed Disk Striping to Provide High I/O Data Rates”, Computer Systems; 1991; pp. 1-24.
John H. Howard et al., “Scale and Performance in a Distributed File System”,ACM Transactions on Computer Systems, vol. 6, No. 1, Feb. 1988; pp. 51-81.
U.S. Appl. No. 10/608,140, filed Jun. 30, 2003; Ghemawat et al.; entitled: “Systems and Methods for Performing Record Append Operations”; 64 pages.
U.S. Appl. No. 10/608,037, filed Jun. 30, 2003; Ghemawat et al.; entitled: “Systems and Methods for Maintaining Data in a File System”; 58 pages.
U.S. Appl. No. 10/608,039, filed Jun. 30, 2003; Ghemawat et al.; entitled: “Garbage Collecting Systems and Methods”; 59 pages.
U.S. Appl. No. 10/608,135, filed Jun. 30, 2003; Ghemawat et al.; entitled: “Namespace Locking Scheme”; 59 pages.
U.S. Appl. No. 10/608,136, filed Jun. 30, 2003; Ghemawat et al.; entitled: “Leasing Scheme for Data-Modifying Operations”; 60 pages.
Steven R. Soltis et al., “The Global File System,” Department of Electrical Engineering and Laboratory for Computational Science and Engineering, University of Minnesota, Appears in the Proceedings of the Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, Sep. 17-19, 1996, College Park, MD., pp. 1-23.
Phil Schwan, “Lustre: building a cluster file system for 1,000 node clusters,” Cluster File Systems, Inc., Summer 2003, slides 1-27.

Affiliated with

Also associated with

Rating

Systems and methods for replicating data does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Systems and methods for replicating data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Systems and methods for replicating data will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4162075