Network distributed automated testing system

Details Network distributed automated testing system Network distributed automated testing system

1998-07-14

2001-10-16

Wright, Norman M. (Department: 2131)

Error detection/correction and fault detection/recovery

Data processing system error or fault handling

Reliability and availability

C714S026000, C714S045000, C714S046000

Reexamination Certificate

active

06304982

ABSTRACT:

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention generally relates to a system for testing computer programs, and, in particular, to a network distributed automated testing system.
2. Description of the Related Art
As application programs become more complex, there is a need for automated systems to test the application programs before they are released to end users. One technique is to develop one or more test scripts that automate the testing process, wherein the test script stores a series of commands to be executed by the application program to avoid having an operator enter a series of commands. This approach is used because a computer can execute a test script somewhat faster than an operator manually entering the commands, and can do so unattended, freeing the operator for other tasks. Existing software quality assurance (QA) tools such as Segue's Quality Works/QA Partner and Microsoft's Visual Test support the creation and use of scripts for software testing, thereby considerably reducing the operator time required relative to manual testing.
Computer processing time is far cheaper and exists in much greater surplus than human operator time. Therefore, software testing is effectively limited by the amount of operator intervention required per test. Even with automation, there are a number of steps that must be taken by an operator. Even though creation and execution of tests may be automated, the operator must review the results of the execution, correlate the results from multiple machines, document any errors or defects, debug the application program and/or the test script itself, and/or re-execute the test script. These manual efforts are time consuming and costly.
In large-scale use of such automated testing, most users of these tools find it necessary to manually divide their tests into batches, run the batches in parallel on different machines and then manually combine the results. These operations create a significant additional operator overhead for automated testing. Since there is a fixed overhead per machine, this style of testing discourages making testing faster or more comprehensive by using many machines, because the rapidly increasing overhead quickly causes diminishing returns. Further, this style of testing is poorly suited for tests that are randomly or automatically generated, since the division of tests into batches must be done before each testing session instead of just once, further increasing the overhead.
Thus, there is a need in the art for techniques that increase testing efficiency by solving these problems. The present invention solves these problems using a server computer as a central repository for all tests and results, wherein the server computer is connected to any number of client computers that perform the tests.
SUMMARY OF THE INVENTION
To address the requirements described above, the present invention discloses a method, apparatus, and article of manufacture wherein a server computer acts as a central repository for tests performed by any number of connected client computers, as well as the results of these tests returned by the client computers. A test manager executed by the server computer analyzes the results of the tests performed by the client computers, and determines which tests have passed or failed during execution, whether the tests failed because of an application or other error, and which tests should be re-executed by the same or different client computer. A test grouper analyzes the error messages produced by the application being tested, so that tests that reveal the same defect can be grouped together. A test reducer is iteratively applied to selected tests to reduce the test to the smallest subset of the original test that still reveals the defect.


REFERENCES:
patent: 5325530 (1994-06-01), Mohrmann
patent: 5475843 (1995-12-01), Halviatti et al.
patent: 5561763 (1996-10-01), Eto et al.
patent: 5600789 (1997-02-01), Parker et al.
patent: 5745767 (1998-04-01), Rosen et al.
patent: 5748882 (1998-05-01), Huang
patent: 5751941 (1998-05-01), Hinds et al.
patent: 5781720 (1998-07-01), Parker et al.
patent: 5841975 (1998-11-01), Layne et al.
patent: 5905856 (1999-05-01), Ottensooser
patent: 6002871 (1999-12-01), Duggan et al.
patent: 6012152 (2000-01-01), Donik et al.
patent: 6026499 (2000-02-01), Shirakihara et al.
Oshana, R., “Software Testing with Statistical Usage Based Models,” Embedded Systems Programming, Jan. 1997. (8 pages).

Affiliated with

Also associated with

Rating

Network distributed automated testing system does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Network distributed automated testing system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Network distributed automated testing system will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2564860