Data processing: measuring – calibrating – or testing – Measurement system – Performance or efficiency evaluation
Reexamination Certificate
2002-08-06
2004-02-17
Hoff, Marc S (Department: 2857)
Data processing: measuring, calibrating, or testing
Measurement system
Performance or efficiency evaluation
C702S176000, C709S224000, C714S047300
Reexamination Certificate
active
06694288
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to software tools for testing the performance of network applications, and more specifically to software tools for automating the analysis of the results of performance testing of networked applications.
2. Description of the Related Art
With the ever increasing availability of internet access, businesses have come to rely upon network communications, such as the internet, as a means of distributing information about their businesses, as a means of advertising, and in many cases, as a means of providing services to customers and potential customers. For certain businesses, for example those in the field of retail sales via the internet, internet presence is critical to the core operation of the business itself. Businesses which do not rely upon the internet to distribute information about themselves may still use networked systems in order to provide internal access to information within the company and in order to allow efficient cooperation between co-workers located at different sites.
In setting up networked systems, whether for internal use, or for availability via the internet, it is important to test the operation of the system and the applications which run upon it. Not only must the system respond properly to individual requests for information, but any network-available resource should also be capable of operating properly when being subjected to many simultaneous requests. In addition to operating correctly when subjected to multiple requests, it is desirable to determine the speed with which the system, such as a web server, responds to requests as the load upon the system increases. Such testing to determine the ability of such a system to respond under increasing amounts of traffic is referred to as load testing.
A variety of commercial systems exist to assist companies to perform both functionality and load testing of networked systems. Because of the importance of such networked systems, there is a continued need for improved tools for testing such systems, as well as for improved tools for analyzing the results of such testing.
SUMMARY OF THE INVENTION
Accordingly, one aspect of the system and methods described herein is to provide a system for monitoring various parameters of a network-accessible server over a period of time during which the server receives requests from one or more client applications, storing values representing these measured parameters in a location accessible to an analysis module, sending these values to the analysis module, identifying statistically significant patterns between various groups of values of these parameters, and using these patterns to suggest to a user likely causes for the identified patterns in the measured parameter values.
In another aspect, a method for automated load testing of a server is disclosed. A series of requests is made of the server by a client process or system, the series of requests and the number of requests being determined according to a testing profile. The performance of the server is measured during the time when the requests are sent to the server, and at least two different metrics associated with the performance of the server are measured during this time. The data representing the measured values of the performance metrics is stored along with an index indicating the time at which the measured performance metric value was taken. The data for each performance metric is analyzed in order to determine at least one significant portion of the data for each performance metric whose value is measured. The data from these significant portions is then compared for each pair of metrics measured, and a degree of correlation is determined for each pair of metrics. The data representing the correlation between the pair of metrics is then presented.
In a different aspect of the method disclosed herein, a method for analyzing the load on a server is described in which at least one client is configured to send a series of requests to a server, and a plurality of parameters of the server are measured during the period of time when the server receives the requests from the client. These values are stored in a series, and the time at which each value was measured is associated with each value. Correlations between the parameters are then identified based upon the stored series of values for the parameters, and those parameters which may be related to one another are selected based upon the correlation between the series of measured values for the parameters.
In an aspect of a system described herein, a load testing analysis system for identifying correlations between various performance parameters of a server comprises a server which is to be test and a communications medium through which requests may be sent to the server, and through which the server may reply to these requests. At least one client process sends a plurality of requests to the server through the communications medium, and a control console receives performance data from the server, the performance data corresponding to a plurality of performance metrics associated with the operation of the server. An analysis module is configured to correlate the data corresponding to the plurality of performance metrics in order to determine any relationship between any pair of the plurality of performance metrics.
REFERENCES:
patent: 5303166 (1994-04-01), Amalfitano et al.
patent: 5446874 (1995-08-01), Waclawsky et al.
patent: 5812780 (1998-09-01), Chen et al.
patent: 5964891 (1999-10-01), Caswell et al.
patent: 6108700 (2000-08-01), Maccabee et al.
patent: 6138157 (2000-10-01), Welter et al.
patent: 6157618 (2000-12-01), Boss et al.
patent: 6157940 (2000-12-01), Marullo et al.
patent: 6167534 (2000-12-01), Straathof et al.
patent: 6249886 (2001-06-01), Kalkunte
patent: 6324492 (2001-11-01), Rowe
patent: 6434513 (2002-08-01), Sherman et al.
patent: 6446120 (2002-09-01), Dantressangle
patent: 6449739 (2002-09-01), Landan
patent: 6457142 (2002-09-01), Klemm et al.
patent: 6470464 (2002-10-01), Bertram et al.
patent: 6477483 (2002-11-01), Scarlat et al.
patent: 6505246 (2003-01-01), Land et al.
patent: 6567767 (2003-05-01), Mackey et al.
patent: 2002/0083371 (2002-06-01), Ramanathan et al.
patent: 2002/0138226 (2002-09-01), Doane
patent: 2002/0147942 (2002-10-01), Moe et al.
patent: 2002/0198985 (2002-12-01), Fraenkel et al.
Landan Gideon
Smocha Itzhak
Barbee Manuel
Hoff Marc S
Knobbe Martens Olson & Bear LLP
Mercury Interactive Corporation
LandOfFree
System and method for automated analysis of load testing... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for automated analysis of load testing..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for automated analysis of load testing... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3348241