Not logged in.

Contribution Details

Type Journal Article
Scope Contributions to practice
Title How Developers Engage with Static Analysis Tools in Different Contexts
Organization Unit
Authors
  • Carmine Vassallo
  • Sebastiano Panichella
  • Fabio Palomba
  • Sebastian Proksch
  • Harald C Gall
  • Andy Zaidman
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
Journal Title Empirical Software Engineering
Publisher Springer
Geographical Reach international
ISSN 1382-3256
Volume 25
Number 2
Page Range 1419 - 1457
Date 2020
Abstract Text Automatic static analysis tools (ASATs) are instruments that support code quality assessment by automatically detecting defects and design issues. Despite their popularity, they are characterized by (i) a high false positive rate and (ii) the low comprehensibility of the generated warnings. However, no prior studies have investigated the usage of ASATs in different development contexts (e.g., code reviews, regular development), nor how open source projects integrate ASATs into their workflows. These perspectives are paramount to improve the prioritization of the identified warnings. To shed light on the actual ASATs usage practices, in this paper we first survey 56 developers (66% from industry and 34% from open source projects) and interview 11 industrial experts leveraging ASATs in their workflow with the aim of understanding how they use ASATs in different contexts. Furthermore, to investigate how ASATs are being used in the workflows of open source projects, we manually inspect the contribution guidelines of 176 open-source systems and extract the ASATs’ configuration and build files from their corresponding GitHub repositories. Our study highlights that (i) 71% of developers do pay attention to different warning categories depending on the development context; (ii) 63% of our respondents rely on specific factors (e.g., team policies and composition) when prioritizing warnings to fix during their programming; and (iii) 66% of the projects define how to use specific ASATs, but only 37% enforce their usage for new contributions. The perceived relevance of ASATs varies between different projects and domains, which is a sign that ASATs use is still not a common practice. In conclusion, this study confirms previous findings on the unwillingness of developers to configure ASATs and it emphasizes the necessity to improve existing strategies for the selection and prioritization of ASATs warnings that are shown to developers.
Related URLs
Digital Object Identifier 10.1007/s10664-019-09750-5
Other Identification Number merlin-id:20341
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)