Methodology for testing spreadsheets

Details Methodology for testing spreadsheets Methodology for testing spreadsheets

2005-09-20

2005-09-20

Dam, Tuan (Department: 2122)

Data processing: software development, installation, and managem

Software program development tool

Testing or debugging

C717S131000, C717S133000

Reexamination Certificate

active

06948154

ABSTRACT:
The invention includes a method for testing a spreadsheet cell. Du-associations are collected for the spreadsheet cell. The cell's execution trace is tracked. After the user validates the cell, the du-associations that participated in the execution trace are marked as executed. Du-associations for other cells that are affected by the testing a spreadsheet cell are similarly marking as exercised. If the user changes a cell's contents, the collected du-associations for the cell are discarded and the steps of collecting test elements, tracking execution traces, and marking are repeated. Cells that depend on the changed cell also repeat these steps. After the user marks a cell as validated, a validation symbol is shown on the cell. If the cell's validation status is later brought into question, the validation symbol can change or be removed entirely. The invention also includes a method for providing a user with feedback of the testedness of the spreadsheet cells. The du-associations for each spreadsheet cell are maintained, and the subset of du-associations that have been exercised is identified. Using the numbers of tested and untested du-associations, a testedness measure is calculated for the cell, which is provided to the user.

REFERENCES:
patent: 6496832 (2002-12-01), Chi et al.
Rothermel et al., “What You See Is What You Test: A Methodology for Testing Form-Based Visual Programs”, IEEE, pp. 198-207, 4-1998.
Wilcox et al., “Does continuous visual feedback aid debugging in direct-manipulation programming systems?”, ACM, pp. 258-265, 1997.
A. V. Aho, R. Sethi, and J. D. Ullman. Compilers, Principles, Techniques, and Tools. Addison-Wesley Publishing Company, Reading, MA, 1986. (Aho86).
A. Ambler, M. Burnett, and B. Zimmerman. Operational versus definitional: a perspective on programming paradigms. Computer, 25(9):28-43, Sep. 1992. (Ambler92).
A. Azem, F. Belli, O. Jack, and P. Jedrzejowicz. Testing and reliability of logic programs. In The Fourth International Symposium on Software Reliability Engineering, pp. 318-327, 1993. (Azem93).
F. Belli and O. Jack. A test coverage notion for logic programming. In The 6th International Symposium on Software Reliability Engineering, pp. 133-142, 1995. (Belli95).
P. Brown and J. Gould. Experimental study of people creating spreadsheets. ACM Transactions on Office Information Systems, 5(3):258-272, Jul. 1987. (Brown87).
M. Burnett, J. Atwood, and Z. Welch. Implementing level 4 liveness in declarative visual programming languages. In 1998 IEEE Symposium on Visual Languages, Sep. 1998. (Burnett98a).
M. Burnett and H. Gottfried. Graphical definitions: Expanding spreadhseet languages through direct manipulation and gestures. ACM Transactions on Computer-Human Interaction, 5(1):1-33, Mar. 1998. (Burnett98b).
M. Burnett, R. Hossli, T. Pulliam, B. Van Voorst, and X. Yang. Toward visual programming languages for steering in scientific visualization: a taxonomy. IEEE Comp. Science and Engineering, 1(4), 1994. (Burnett94).
E. H. Chi. P. Barry, J. Riedl, and J. Konstan. A Spreadsheet Approach to Information Visualization. In IEEE Symposium on Information Visualization, Oct. 1997. (Chi97).
R. Christ. Review and analysis of color coding research for visual displays. Human Factors, 17(6):542-570, 1975. (Christ75).
L. Clarke. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering, 2(3), Sep. 1976. (Clarke76).
L Clarke, A. Podgurski, D. Richardson, and S. Zeil. A formal evaluation of data flow path selection criteria. IEEE Transactions on Software Engineering, SE-15(11):1318-1332, Nov. 1989. (Clarke89).
C. Cook, K. Rothermel, M. Burnett, T. Adams, G. Rothermel, A. Sheretov, F. Cort, J. Reichwein. Does immediate visual feedback about testing aid debugging in spreadsheet language? TR 99-60-07, Oregon State University, Mar. 1999. (Cook99).
E. Duesterwald, R. Gupta, and M. L. Soffa. Rigorous data flow testing through output influences. In Proceedings of the 2nd Irvine Software Symposium, Mar. 1992. (Duesterwald92)
P. Frankl and S. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering, 19(8):774-787, Aug. 1993. (Frankl93).
P. Frankl and E. Weyuker. An applicable family of data flow criteria. IEEE Transactions on Software Engineering, 14(10):1483-1498, Oct. 1988. (Frankl88).
T. Green and M. Petre. Usability analysis of visual programming environments: A ‘cognitive dimensions’ framework. Journal of Visual Languages and Computing, 7(2):131-174, Jun. 1996. (Green96).
R. Gupta, M. J. Harrold, and M. L. Soffa. Program slicing-based regression testing techniques. Journal of Software Testing, Verification, and Reliability, 6(2):83-112, Jun. 1996. (Gupta93).
M. J. Harrold and M. L. Soffa. An incremental approach to unit testing during maintenance. In Proceedings of the Conference on Software Maintenance, pp. 362-367, Oct. 1988. (Harrold88).
S. Hudson. Incremental attribute evaluation: a flexible algorithm for lazy update. ACM Transactions Programming Languages and Systems, 13(3), Jul. 1991. (Hudson91).
M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In 16th International Conference on Software Engineering, pp. 191-200, May 1994. (Huitchins94).
W. Kuhn and A. U. Frank. The use of functional programming in the specification and testing process. In International Conference and Workshop on Interoperating Geographic Information Systems, Dec. 1997. (Kuhn97).
J. Laski and B. Korel. A data flow oriented program testing strategy. IEEE Transactions on Software Engineering, 9(3):347-354, May 1993. (Laski83).
J. Leopold and A. Ambler. Keyboardless visual programming using voice, handwriting, and gesture. In 1997 IEEE Symposium on Visual Languages, pp. 28-35, Sep. 1997. (Leopold97).
G. Luo, G. Bochmann, B. Sarikaya, and M. Boyer. Control-flow based testing of Prolog programs. In The 3rd International Symposium on Software Reliability Engineering, pp. 104-113, 1992. (Luo92).
T. Marlowe and B Ryder. An efficient hybrid algorithm for incremental data flow analysis. In ACM Principles of Programming Languages, pp. 184-196, Jan. 1990. (Marlowe90).
G. Murch. Physiological principles for the effective use of color. IEEE Computer Graphics and Applications, pp. 49-54, Nov. 1984. (Murch84).
B. Myers. Graphical techniques in a spreadsheet for specifying user interface. In ACM Conference on Human Factors in Computing Systems, pp. 243-249, Apr. 1991. (Myers91).
S. C. Ntafos. On required element testing. IEEE Transactions on Software Engineering, 10(6), Nov. 1984. (Ntafos84).
J. Offutt, J. Pan, K. Tewary, and T. Zhang. An experimental evaluation of data flow and mutation testing. Software Practice and Experience, 26(2):165-176, Feb. 1996. (Offutt96).
F. Ouabdesselam and I. Parissis. Testing techniques for data-flow synchronous programs. In AADEBUG'95: Second International Workshop on Automated and Algorithmic Debugging, May 1995. (Ouabd95).
R. Panko and R. Halverson. Spreadsheets on trial: A survey of research on spreadheet risks. In Twenty-Ninth Hawaii International Conference on System Sciences, Jan. 1996. (Panko96).
D. Perry and G. Kaiser. Adequate testing and object-oriented programming. Journal of Object-Oriented Programming, 2, Jan. 1990. (Perry90).
L. Pollock and M. L. Soffa. An incremental version of iterative data flow analysis. IEEE Transactions on Software Engineering, 15(12):1537-1549, Dec. 1989. (Pollock89).
S. Rapps and E. J. Weyuker. Selecting software test data using data flow information. IEEE Transactions on Software Engineering, 11(4):367-375, Apr. 1985. (Rapps85).
G. Rothermel and M. J. Harrold. Selecting tests and identifying test coverage requirements for modified software. In Proceedings of the 1994 International Symposium Software Testing and Analysis, pp. 169-184, Aug. 1994. (Rothermel94).
G. Rothemel and M.J. Harrold. A safe, efficient regression test selection technique. ACM Transactions on Software

Affiliated with

Also associated with

Rating

Methodology for testing spreadsheets does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Methodology for testing spreadsheets, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methodology for testing spreadsheets will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3374680