Development and Testing of the Protocol Quality Rating Tool (PQRT) to Evaluate Clinical Trial Protocol Document Quality

Abstract

A high-quality protocol document is essential for the successful and efficient implementation of clinical trials, but there is no consensus on how clinical trial protocol document quality should be evaluated. We used a modified Delphi approach and cognitive interviews to develop a new protocol document quality assessment tool, the Protocol Quality Rating Tool (PQRT). We compiled a checklist of elements that should be included in a high-quality trial protocol document and asked experts to rate the importance of each element. We developed the PQRT by describing the expected content of each element and identified essential vs. additional (bonus) content to differentiate high- versus low-quality protocol documents and then organized the elements into 18 sections. We revised the PQRT based on feedback from and cognitive interviews with our protocol quality rating team. We then tested the PQRT using ten protocol documents previously approved by the Institutional Review Board. All the protocol quality raters found the tool easy to use and their scores were highly concordant for eight of ten protocol documents. We have developed and tested a simple tool to measure clinical trial protocol document quality and encourage other researchers to evaluate and validate it.