Internet Archive Scholar

Using Lightweight Formal Methods to Validate a Key-Value Storage Node in Amazon S3

James Bornholt, Rajeev Joshi, Vytautas Astrauskas, Brendan Cully, Bernhard Kragl, Seth Markle, Kyle Sauri, Drew Schleit, Grant Slatton, Serdar Tasiran, Jacob Van Geffen, Andrew Warfield
2021 Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles CD-ROM  

Preserved Fulltext

fulltext thumbnail
Web Archive Capture PDF (438.6 kB)
https://web.archive.org/web/20220112225937/https://dl.acm.org/doi/pdf/10.1145/3477132.3483540

A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL. The file type is application/pdf.

This paper reports our experience applying lightweight formal methods to validate the correctness of ShardStore, a new key-value storage node implementation for the Amazon S3 cloud object storage service. By "lightweight formal methodsž we mean a pragmatic approach to verifying the correctness of a production storage node that is under ongoing feature development by a full-time engineering team. We do not aim to achieve full formal verification, but instead emphasize automation, usability, and
more » ... he ability to continually ensure correctness as both software and its specification evolve over time. Our approach decomposes correctness into independent properties, each checked by the most appropriate tool, and develops executable reference models as specifications to be checked against the implementation. Our work has prevented 16 issues from reaching production, including subtle crash consistency and concurrency problems, and has been extended by non-formal-methods experts to check new features and properties as ShardStore has evolved. CCS Concepts: • Software and its engineering → Software verification and validation.
doi:10.1145/3477132.3483540 fatcat:gvgkb5wkvrcxvjjfr2pizrnq4u
Citation

James Bornholt, Rajeev Joshi, Vytautas Astrauskas, Brendan Cully, Bernhard Kragl, Seth Markle, Kyle Sauri, Drew Schleit, Grant Slatton, Serdar Tasiran, Jacob Van Geffen, Andrew Warfield. "Using Lightweight Formal Methods to Validate a Key-Value Storage Node in Amazon S3." Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles CD-ROM (2021)