Data processing: software development – installation – and managem – Software program development tool – Translation of code
Reexamination Certificate
1999-11-10
2001-10-09
Powell, Mark R. (Department: 2122)
Data processing: software development, installation, and managem
Software program development tool
Translation of code
C717S152000, C702S123000, C707S793000, C707S793000
Reexamination Certificate
active
06301701
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to computer programming, and to regression testing of computer software. More particularly, this invention relates to assisted testing of software application components from the development through maintenance phases.
Complex, mission-critical business applications typically contain large numbers of on-line transactions, each of which consists of considerable functionality. The quality of software applications largely depends on extensive testing of the functionality of each of the on-line transactions to ensure completeness and correctness. Software developers recognize that testing of applications software is an ongoing or continuous process that must be integrated into every phase of the application software life cycle including the design phase, development phase, unit testing phase, systems testing and integration phase, quality assurance phase, customer installation and support phases as well as the application maintenance phase.
Present industry trends dictate that approximately eight hours are required to thoroughly test an applications transaction if the individual performing the test both understands the transaction and has data available for testing. Therefore, if an application contains 500 transactions, such an application would require approximately 4000 hours to comprehensively test the application, if there are no errors present. Furthermore, in order to properly test an application, when an error is discovered and fixed, the entire test must be performed again precisely in the same manner using the same data to ensure that the repair for the discovered error did not inadvertently introduce another error into the application.
Additional shortcomings are also present in the traditional manners in which software applications have been tested. For example, due to the large number of hours required for properly testing the transactions of an application, dedicated testing staff have generally been required. It is both impractical and expensive to dedicate large numbers of staff to perform such manual testing processes. Furthermore, in order to properly test software applications transactions, it is important to capture product content knowledge, usually best appreciated by applications experts, for use in selecting test data. To do so ensures a more robust testing of application transactions. However, to transfer such knowledge and skill from the originating entity, such as the applications expert, to a transaction tester requires additional time and resources for such a knowledge transfer. Additionally, manual testing of application transactions by humans may inject additional errors such as the disregarding of a test sequence or the inadvertent overlooking of test results. Furthermore, one of the more overriding issues in software transaction testing occurs when changes are made to transactions thereby obsoleting a substantial portion of the test information.
Traditional automated applications testing strategies have only been partially successful in minimizing the manual nature of transaction testing. For example, one type of automated application testing employs a keystroke-capture technique (
FIG. 1
) wherein the computer memorizes the keystroke and mouse movements performed by the test operator enabling the computer to replay the test at a later time for retesting the application. Such keystroke-capture techniques fall short for many reasons. For example, for testing strategies employing keystroke-capture techniques, any changes, even subtle changes, to the graphical nature of the transactions render the prior tests unusable. Furthermore, the test data generated by a keystroke-capture technique is normally unmaintainable and incomprehensible, and therefore, any changes to the test data require the re-creation of the entire test.
Additionally, keystroke-capture testing techniques typically do not generate output but rather sequentially execute the transaction undergoing test. Therefore, to evaluate the behavior of the test, a test operator must physically observe the test being executed to verify the results. Furthermore, such keystroke-capture techniques yet introduce the human error aspect into transaction testing as the test operator is required to observe and visually verify the integrity of the test. Finally, keystroke-capture testing techniques are difficult and even impossible to document and verify as hard copies of test data are unavailable, or are at least incomprehensible as they are a series of cryptic graphical commands addressed to the graphical user interface of the application undergoing testing.
Preparation of test data is yet another shortcoming of traditional automated testing techniques. Presently, there does not exist an acceptable way to develop test data for traditional testing methods except by using traditional manual techniques for developing such tests. Furthermore, once test data is developed, maintaining such test data is virtually impossible as it has a manually developed origin. Therefore, applications programmers have heretofore invented or created non-meaningful data that often does not actually properly exercise the transaction or application undergoing the testing process. While present testing strategies are lacking in proper discipline, the tools and strategies necessary for improving testing methods and strategies have heretofore been nonexistent.
Yet another shortcoming of traditional software testing techniques includes the inability or at a minimum, the lack of ease available to a transaction designer to test a specific transaction as an individual unit. Prior techniques have required the transaction designer to create a shell program around the target transaction to verify its correct performance. As most software application that access databases are comprised of a substantial number of transactions, the inordinate amount of shell or environment-simulating software that is required to test a software applications associated transactions can easily approach or exceed the quantum of software inherent in the target application. Furthermore, an automated approach for verifying the integrity of specific structures such as menu structures within a software application have also been required to be performed manually. That is to say, the sequential and thorough testing of a menu structure within a software application has heretofore required extensive and manually intensive interaction by the transaction designer or software application tester.
While present industry trends such as the heterogeneity of computer architectures and communication standards exacerbate the testing discipline, other modem trends such as the low-cost and increased speed of computer resources facilitate the economical implementation of an advanced applications testing philosophy. Thus, what is needed is a method for testing a software applications transaction using test data that can be automatically generated by a computer from the analysis of the transaction and remains robust or dynamic through modifications to the transaction. What is yet needed is a method for thoroughly testing hierarchal structures, such as menus, in an automated manner.
SUMMARY AND OBJECTS OF THE INVENTION
The foregoing problems in the prior state of the art have been successfully overcome by the present invention, which is directed to a method for regression testing a transaction in a software application using a test case comprised of test data wherein the test data describes the regression test at a functional or behavior level and executes the regression test at a physical level, and further wherein changes to the transaction do not result in unusable test data.
It is an object of the present invention to provide a method for testing a transaction of a software application using test data that is automatically generated from a definition of the transaction.
It is a further object of the present invention to provide a method for reporting test results from test data executed by a transaction undergoing testing. It
Diab Samer
Slovik Adam
Walker Jeffrey L.
Kirton & McConkie
Krieger Michael F.
Nguyen-Ba Hoang-Vu Antony
Powell Mark R.
TenFold Corporation
LandOfFree
Method for computer-assisted testing of software application... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for computer-assisted testing of software application..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for computer-assisted testing of software application... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2612078