An Empirical Study on the Correctness of Formally Verified Distributed Systems

Proceedings of the Twelfth European Conference on Computer Systems Pub Date : 2017-04-23 DOI:10.1145/3064176.3064183

Pedro Fonseca, Kaiyuan Zhang, Xi Wang, A. Krishnamurthy

{"title":"An Empirical Study on the Correctness of Formally Verified Distributed Systems","authors":"Pedro Fonseca, Kaiyuan Zhang, Xi Wang, A. Krishnamurthy","doi":"10.1145/3064176.3064183","DOIUrl":null,"url":null,"abstract":"Recent advances in formal verification techniques enabled the implementation of distributed systems with machine-checked proofs. While results are encouraging, the importance of distributed systems warrants a large scale evaluation of the results and verification practices. This paper thoroughly analyzes three state-of-the-art, formally verified implementations of distributed systems: Iron-Fleet, Verdi, and Chapar. Through code review and testing, we found a total of 16 bugs, many of which produce serious consequences, including crashing servers, returning incorrect results to clients, and invalidating verification guarantees. These bugs were caused by violations of a wide-range of assumptions on which the verified components relied. Our results revealed that these assumptions referred to a small fraction of the trusted computing base, mostly at the interface of verified and unverified components. Based on our observations, we have built a testing toolkit called PK, which focuses on testing these parts and is able to automate the detection of 13 (out of 16) bugs.","PeriodicalId":262089,"journal":{"name":"Proceedings of the Twelfth European Conference on Computer Systems","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"67","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Twelfth European Conference on Computer Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3064176.3064183","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 67

Abstract

Recent advances in formal verification techniques enabled the implementation of distributed systems with machine-checked proofs. While results are encouraging, the importance of distributed systems warrants a large scale evaluation of the results and verification practices. This paper thoroughly analyzes three state-of-the-art, formally verified implementations of distributed systems: Iron-Fleet, Verdi, and Chapar. Through code review and testing, we found a total of 16 bugs, many of which produce serious consequences, including crashing servers, returning incorrect results to clients, and invalidating verification guarantees. These bugs were caused by violations of a wide-range of assumptions on which the verified components relied. Our results revealed that these assumptions referred to a small fraction of the trusted computing base, mostly at the interface of verified and unverified components. Based on our observations, we have built a testing toolkit called PK, which focuses on testing these parts and is able to automate the detection of 13 (out of 16) bugs.

查看原文本刊更多论文

形式验证分布式系统正确性的实证研究

形式验证技术的最新进展使分布式系统能够实现机器检查的证明。虽然结果令人鼓舞，但分布式系统的重要性保证了对结果和验证实践的大规模评估。本文全面分析了三个最先进的、经过正式验证的分布式系统实现:Iron-Fleet、Verdi和Chapar。通过代码审查和测试，我们总共发现了16个bug，其中许多bug会产生严重的后果，包括服务器崩溃、向客户端返回不正确的结果以及验证保证无效。这些错误是由于违反了经过验证的组件所依赖的广泛假设而引起的。我们的结果表明，这些假设涉及到可信计算基础的一小部分，主要是在已验证和未验证组件的接口上。根据我们的观察，我们建立了一个名为PK的测试工具包，它专注于测试这些部分，并能够自动检测出13个(16个)bug。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the Twelfth European Conference on Computer Systems

自引率

0.00%

发文量