End-to-end regression testing for distributed systems

Abstract

Even with substantial advances in tools and research techniques, distributed systems remain challenging to test. One frustrating aspect of distributed systems development is the resurfacing of old problems due to code changes. Regression test suites replicate previously known bugs and ensure they do not resurface as the code evolves. Conventional unit regression tests miss a substantial amount of distributed system problems; end-to-end testing is almost always required in order to reproduce complex bugs. We describe a framework for regression testing that bridges a gap between local ad-hoc experiments and end-to-end stress testing, potentially lowering the recurrence of critical bugs.