PBCOV: a property-based coverage criterion

Verfasser / Beitragende:
[Kassem Fawaz, Fadi Zaraket, Wes Masri, Hamza Harkous]
Ort, Verlag, Jahr:
2015
Enthalten in:
Software Quality Journal, 23/1(2015-03-01), 171-202
Format:
Artikel (online)
ID: 605495572
LEADER caa a22 4500
001 605495572
003 CHVBK
005 20210128100532.0
007 cr unu---uuuuu
008 210128e20150301xx s 000 0 eng
024 7 0 |a 10.1007/s11219-014-9237-3  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s11219-014-9237-3 
245 0 0 |a PBCOV: a property-based coverage criterion  |h [Elektronische Daten]  |c [Kassem Fawaz, Fadi Zaraket, Wes Masri, Hamza Harkous] 
520 3 |a Coverage criteria aim at satisfying test requirements and compute metrics values that quantify the adequacy of test suites at revealing defects in programs. Typically, a test requirement is a structural program element, and the coverage metric value represents the percentage of elements covered by a test suite. Empirical studies show that existing criteria might characterize a test suite as highly adequate, while it does not actually reveal some of the existing defects. In other words, existing structural coverage criteria are not always sensitive to the presence of defects. This paper presents PBCOV, a Property-Based COVerage criterion, and empirically demonstrates its effectiveness. Given a program with properties therein, static analysis techniques, such as model checking, leverage formal properties to find defects. PBCOV is a dynamic analysis technique that also leverages properties and is characterized by the following: (a) It considers the state space of first-order logic properties as the test requirements to be covered; (b) it uses logic synthesis to compute the state space; and (c) it is practical, i.e., computable, because it considers an over-approximation of the reachable state space using a cut-based abstraction.We evaluated PBCOV using programs with test suites comprising passing and failing test cases. First, we computed metrics values for PBCOV and structural coverage using the full test suites. Second, in order to quantify the sensitivity of the metrics to the absence of failing test cases, we computed the values for all considered metrics using only the passing test cases. In most cases, the structural metrics exhibited little or no decrease in their values, while PBCOV showed a considerable decrease. This suggests that PBCOV is more sensitive to the absence of failing test cases, i.e., it is more effective at characterizing test suite adequacy to detect defects, and at revealing deficiencies in test suites. 
540 |a Springer Science+Business Media New York, 2014 
690 7 |a Software testing  |2 nationallicence 
690 7 |a Coverage criteria  |2 nationallicence 
690 7 |a Property-based coverage  |2 nationallicence 
690 7 |a State space coverage  |2 nationallicence 
690 7 |a Specification-based coverage  |2 nationallicence 
690 7 |a Test suite evaluation  |2 nationallicence 
690 7 |a Reachability analysis  |2 nationallicence 
690 7 |a Logic synthesis  |2 nationallicence 
700 1 |a Fawaz  |D Kassem  |u University of Michigan, Ann Arbor, MI, USA  |4 aut 
700 1 |a Zaraket  |D Fadi  |u American University of Beirut, Beirut, Lebanon  |4 aut 
700 1 |a Masri  |D Wes  |u American University of Beirut, Beirut, Lebanon  |4 aut 
700 1 |a Harkous  |D Hamza  |u Swiss Federal Institute of Technology in Lausanne (EPFL), Lausanne, Switzerland  |4 aut 
773 0 |t Software Quality Journal  |d Springer US; http://www.springer-ny.com  |g 23/1(2015-03-01), 171-202  |x 0963-9314  |q 23:1<171  |1 2015  |2 23  |o 11219 
856 4 0 |u https://doi.org/10.1007/s11219-014-9237-3  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s11219-014-9237-3  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Fawaz  |D Kassem  |u University of Michigan, Ann Arbor, MI, USA  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Zaraket  |D Fadi  |u American University of Beirut, Beirut, Lebanon  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Masri  |D Wes  |u American University of Beirut, Beirut, Lebanon  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Harkous  |D Hamza  |u Swiss Federal Institute of Technology in Lausanne (EPFL), Lausanne, Switzerland  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Software Quality Journal  |d Springer US; http://www.springer-ny.com  |g 23/1(2015-03-01), 171-202  |x 0963-9314  |q 23:1<171  |1 2015  |2 23  |o 11219