Data processing: database and file management or data structures – Database design – Data structure types
Reexamination Certificate
2007-02-06
2007-02-06
Channavajjala, Srirama (Department: 2166)
Data processing: database and file management or data structures
Database design
Data structure types
C707S793000, C717S118000, C711S170000
Reexamination Certificate
active
10630525
ABSTRACT:
A system and method for use with a virtual machine, including an adaptive, automated memory management process that takes decisions regarding which garbage collector technique should be used, based on information extracted from the currently active applications. Reinforcement learning is used to decide under which circumstances to invoke the garbage collecting processing. The learning task is specified by rewards and penalties that indirectly tell the RLS agent what it is supposed to do instead of telling it how to accomplish the task. The decision is based on information about the memory allocation behavior of currently running applications. Embodiments of the system can be applied to the task of intelligent memory management in virtual machines, such as the Java Virtual Machine (JVM).
REFERENCES:
patent: 6070173 (2000-05-01), Huber et al.
patent: 6151618 (2000-11-01), Wahbe et al.
patent: 6353838 (2002-03-01), Sauntry et al.
patent: 6434575 (2002-08-01), Berry et al.
patent: 6480862 (2002-11-01), Gall
patent: 6629113 (2003-09-01), Lawrence
patent: 6865657 (2005-03-01), Traversat et al.
patent: 6892212 (2005-05-01), Shuf et al.
patent: 6912553 (2005-06-01), Kolodner et al.
patent: 6941410 (2005-09-01), Traversat et al.
patent: 2002/0198854 (2002-12-01), Berenji
patent: 2004/0073764 (2004-04-01), Andreasson
patent: 2005/0102670 (2005-05-01), Bretl et al.
patent: 1387273 (2004-02-01), None
patent: 1659496 (2006-05-01), None
patent: WO 99/00730 (1999-01-01), None
patent: WO 01/97042 (2001-12-01), None
patent: WO 02/23345 (2002-03-01), None
Richard S Sutton, “Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding”, Advances in neural Information processing systems 8, 1996, pp. 1038-1044.
Chris,Gaskett et al. “reinforcement learning applied to the control of an autonomous underwater vehicle”, AuCRA , 1999.
Richard S Sutton, et al. “Reinforcement learning 1: Introduction”, 1998, pp. 1-15.
Philippe Preux, Propagation of Q-values in Tabular TD (lambda), Proc. 13th european conference on Machine learning (ECML), 2002.
Steven J Bradtke et al. Reinforcement learning methods for continuous-Time markov decision problems, Advances in Neural information processing systems, 1994, pp. 1-7.
Ronald Parr et al. “Reinforcement learning with Hierarchies of Machines”, advances in neural information processing systems, 1997.
Eva Andreasson et al. “to collect or not to collect?”, JVM '02, 2002 pp. 27-40 of the proceedings 18 pages.
Jette Randlov, “Solving complex problems with reinforcement learning”, Ph.D Thesis, CATS, Niels Bohr instutute, Faculty of science, University of Copenhagen, Sep. 2001, pp. 1-102,and 148-150.
Makarevitch,B, “CDMA admission control based on reinforcement learning”, VTC 50thconference, 1999, vol. 5, pp. 2830-2834
Blackburn SM et al. “starting with termination: a methodology for building distributed garbage collection algorithms”, 24thaustralasian ACSC 2001 computer science conference, 2001, pp. 20-28.
Lars T Hansen et al. “An experimental study of renewal-older-first garbage collection”, ICFP'02, Oct. 2002, pp. 247-258.
Bea Systems Inc.
Channavajjala Srirama
Fliesler & Meyer LLP
LandOfFree
System and method for garbage collection in a computer... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for garbage collection in a computer..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for garbage collection in a computer... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3809353