Methodological Quality Assessment Tools for Diagnosis and Prognosis Research: Overview and Guidance.

Abstract

Background and objective: Multiple tools exist for assessing the methodological quality of diagnosis and prognosis research. It can be challenging to decide on when to use which tool. We aimed to provide an overview of existing methodological quality assessment (QA) tools for diagnosis and prognosis studies, highlight the overlap and differences among these tools, and to provide guidance for choosing the appropriate tool.

Study design and setting: We performed a methodological review of tools designed for assessing risk of bias, applicability, or other aspects related to methodological quality in studies investigating tests/factors/markers/models for classifying or predicting a current (diagnosis) and/or future (prognosis) health state. Tools focusing exclusively on causal research or on reporting quality were excluded. Guidance was subsequently developed to assist in choosing an appropriate QA tool.

Results: We identified 14 QA tools, eight of which were developed for assessment of diagnosis studies, four for prognosis studies, and two addressing both. We propose a set of five questions to help guide the process of choosing a QA tool based on the purpose or question of the user: whether the focus is on (1) diagnosis, prognosis, or another domain; (2) a prediction model versus a test/factor/marker; (3) evaluating simply the performance of a test/factor/marker versus assessing its added value over other variables; (4) comparing two or more tests/factors/markers/models; and (5) whether the user aims to assess only risk of bias or also other quality aspects.

Conclusion: Existing QA tools for appraising diagnosis and prognosis studies vary in purpose, scope, and contents. Our guidance may help researchers, systematic reviewers, health policy makers, and guideline developers in specifying their purpose and question to select the most appropriate QA tool for their assessment.