Improved software reliability by application of scorecard reviews

Abstract

To support development of more reliable software, AMSAA has developed a software reliability scorecard offered free of charge to department of defense employees and their contractors. The scorecard methodology provides a structured and transparent approach to assess and improve software reliability practices. AMSAA's new software reliability scorecard assesses seven key areas of software development and sustainment: Program Management, Requirements Management, Design Capabilities, System Design, Design for Reliability, (Customer) Test & Acceptance, and Fielding & Sustainment. Across the categories a total of 57 specific elements are examined. The scorecard evaluates the risk being taken in each of the key areas separately and also assesses the overall risk of the effort. The instrument captures the rationale for the assessment score given and identifies them along with recommendations for reducing individual risks.