The Importance of Training and Assessing Quality Control Reviewers in Technology-Enabled Abstraction of Real-World Data: A Case Study.

Accurate cancer registry data is crucial for understanding cancer prevention and treatment strategies. Proper education and training are key for successful quality control (QC) programs and an evaluation process is needed to assess effectiveness. Syapse developed a rigorous QC training program that includes a peer review process to assess data quality and an interrater review (IRR) program to evaluate the consistency of QC reviewers. In reviewing IRR cases, we found high rates of agreement in various cancer types: colon (97.74%), prostate (97.75%), ovarian (96.31%), lung (98.03%), breast (97.86%), and bladder (97.88%). A peer review experience questionnaire was also administered. Results indicated that the program facilitated the acquisition of new skills. Through the implementation of robust QC training and assessment procedures for technology-enabled data curation, our Oncology Data Specialist (ODS)-certified professionals at Syapse ensure data quality in a real-world evidence (RWE) platform. QC reviewers deserve an extensive investment in training and professional development to uphold data quality and support cancer research efforts.