The browser you are using is not supported by this website. All versions of Internet Explorer are no longer supported, either by us or Microsoft (read more here: https://www.microsoft.com/en-us/microsoft-365/windows/end-of-ie-support).

Please use a modern browser to fully experience our website, such as the newest versions of Edge, Chrome, Firefox or Safari etc.

Are found defects an indicator of software correctness? An investigation in a controlled case study

På svenska

Author

Summary, in English

In quality assurance programs, we want indicators of software quality, especially software correctness. The number of found defects during inspection and testing are often used as the basis for indicators of software correctness. However, there is a paradox in this approach, since the remaining defects is what impacts negatively on software correctness, not the found ones. In order to investigate the validity of using found defects or other product or process metrics as indicators of software correctness, a controlled case study is launched. 57 sets of 10 different programs from the PSP course are assessed using acceptance test suites for each program. In the analysis, the number of defects found during the acceptance test are compared to the number of defects found during development, code size, share of development time spent on testing etc. It is concluded from a correlation analysis that 1) fewer defects remain in larger programs 2) more defects remain when larger share of development effort is spent on testing, and 3) no correlation exist between found defects and correctness. We interpret these observations as 1) the smaller programs do not fulfill the expected requirements 2) that large share effort spent of testing indicates a "hacker" approach to software development, and 3) more research is needed to elaborate this issue.

Publishing year

2004

Language

English

Pages

91-100

Publication/Series

Proceedings - International Symposium on Software Reliability Engineering, ISSRE

Document type

Conference paper

Publisher

IEEE - Institute of Electrical and Electronics Engineers Inc.

Topic

  • Computer Science

Keywords

  • Capture-recapture models (CRC)
  • Software correctness
  • Controlled case study
  • Personal software process (PSP)

Conference name

ISSRE 2004 Proceedings; 15th International Symposium on Software Reliability Engineering

Conference date

2004-11-02 - 2004-11-05

Conference place

Saint-Malo, France

Status

Published

ISBN/ISSN/Other

  • ISSN: 1071-9458
  • CODEN: PSSRFV