Differentially Testing Soundness and Precision of Program Analyzers [article]

Christian Klinger, Maria Christakis, Valentin Wüstholz
2018 arXiv   pre-print
In the last decades, numerous program analyzers have been developed both by academia and industry. Despite their abundance however, there is currently no systematic way of comparing the effectiveness of different analyzers on arbitrary code. In this paper, we present the first automated technique for differentially testing soundness and precision of program analyzers. We used our technique to compare six mature, state-of-the art analyzers on tens of thousands of automatically generated
more » ... s. Our technique detected soundness and precision issues in most analyzers, and we evaluated the implications of these issues to both designers and users of program analyzers.
arXiv:1812.05033v2 fatcat:ygujkf4a3ba7jojh2d57gmmd7m