Dynamic thread pool tuning techniques

Details Dynamic thread pool tuning techniques Dynamic thread pool tuning techniques

2007-06-26

2007-06-26

Bullock, Jr., Lewis A. (Department: 2195)

Electrical computers and digital processing systems: virtual mac

Task management or control

Process scheduling

C709S224000

Reexamination Certificate

active

10334768

ABSTRACT:
Thread pools in a multithreaded server are programmatically adjusted, based on observed statistics from the server's inbound workload. In a multithreaded server environment, response time to end users is improved while increasing the efficiency of software execution and resource usage. Execution time and wait/queued time are tracked, for various types of requests being serviced by a server. Multiple logical pools of threads are used to service these requests, and inbound requests are directed to a selected one of these pools such that requests of similar execution-time requirements are serviced by the threads in that pool. The number and size of thread pools may be adjusted programmatically, and the distribution calculation (i.e., determining which inbound requests should be assigned to which pools) is a programmatic determination. In preferred embodiments, only one of these variables is adjusted at a time, and the results are monitored to determine whether the effect was positive or negative. The disclosed techniques also apply to tracking and classifying requests by method name (and, optionally, parameters).

REFERENCES:
patent: 5664106 (1997-09-01), Caccavale
patent: 5675739 (1997-10-01), Eilert et al.
patent: 5745778 (1998-04-01), Alfieri
patent: 6105053 (2000-08-01), Kimmel et al.
patent: 6182109 (2001-01-01), Sharma et al.
patent: 6397252 (2002-05-01), Sadiq
patent: 6427161 (2002-07-01), LiVecchi
patent: 6477561 (2002-11-01), Robsman
patent: 6535878 (2003-03-01), Guedalia et al.
patent: 6542920 (2003-04-01), Belkin et al.
patent: 6629142 (2003-09-01), Badami et al.
patent: 6879995 (2005-04-01), Chinta et al.
patent: 6898617 (2005-05-01), Doolittle et al.
patent: 7051330 (2006-05-01), Kaler et al.
patent: 7080378 (2006-07-01), Noland et al.
patent: 2002/0065816 (2002-05-01), Tsusaka et al.
patent: 2002/0194251 (2002-12-01), Richter et al.
patent: 07-152590 (1995-06-01), None
patent: 07-152590 (1995-06-01), None
patent: 07-152700 (1995-06-01), None
Ling, Yibei et al. “Analysis of Optimal Thread Pool Size.” ACM Press. Feb. 14, 2000.
Calcote, John. “Thread Pools and Server Performance.” Dr. Dobb's Journal. Jul. 1997.
Welsh, Matt et al. “SEDA: An Architecture for Well-Conditioned Scalable Internet Services.” ACM. 2001.
Pyarali, Irfan et al. “Evaluating and Optimizing Thread Pool Strategies for Real-Time CORBA.” 2002.
Jen-Yao Chung, et al. “Goal-oriented dynamic buffer pool management for data base systems”,IEEE, Aug. 1995: 191-198.

Affiliated with

Also associated with

Rating

Dynamic thread pool tuning techniques does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Dynamic thread pool tuning techniques, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Dynamic thread pool tuning techniques will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3851788