Gennaro Acanfora MD, Antonino Iaccarino CT, PhD, Bruna Cerbelli MD, PhD, Claudio Di Cristofano MD, Claudio Bellevicine MD, PhD, Massimo Barberis MD, Emanuela Bonoldi MD, Lukas Bubendorf MD, Andreas Calaminus MD, MIAC, Severo Campione MD, PhD, Sule Canberk MD, Alberto Cavazza MD, Giorgio Cazzaniga MD, Obinna Chijioke MD, Eduardo Clery MD, Albino Eccher MD, Marianne Engels MD, Fiac, Vincenzo Fiorentino MD, Paolo Graziano MD, Izidor Kern MD, Ivana Kholova MD, PhD, MIAC, Jari Laatta MD, Tania Labiano MD, Martina Leopizzi CT, PhD, Maria D. Lozano MD, Rita Luis MD, Elisabetta Maffei MD, Alessandro Marando MD, Maurizio Martini MD, PhD, Elisabetta Merenda MD, Marco Montella MD, PhD, Allan Argueta Morales MD, Michiya Nishino MD, PhD, Fabio Pagni MD, Paul Hofman MD, PhD, Angelina Pernazza MD, PhD, Sinchita Roy-Chowdhuri MD, PhD, Mauro Saieg MD, PhD, MIAC, Spasenija Savic Prince MD, Momin T. Siddiqui MD, Tajana Stoos-Veic MD, PhD, Margareta Strojan Fležar MD, PhD, MIAC, Dinka Sundov MD, PhD, Paul VanderLaan MD, PhD, Danijela Vrdoljak-Mozetič MD, PhD, Pio Zeppa MD, PhD, Giancarlo Troncone MD, PhD, Elena Vigliar MD, PhD
{"title":"InterobServer AgreeMent in Pd-l1 evaLuatIoN on cytoloGical samples—SAMPLING project: A multi-institutional, international study","authors":"Gennaro Acanfora MD, Antonino Iaccarino CT, PhD, Bruna Cerbelli MD, PhD, Claudio Di Cristofano MD, Claudio Bellevicine MD, PhD, Massimo Barberis MD, Emanuela Bonoldi MD, Lukas Bubendorf MD, Andreas Calaminus MD, MIAC, Severo Campione MD, PhD, Sule Canberk MD, Alberto Cavazza MD, Giorgio Cazzaniga MD, Obinna Chijioke MD, Eduardo Clery MD, Albino Eccher MD, Marianne Engels MD, Fiac, Vincenzo Fiorentino MD, Paolo Graziano MD, Izidor Kern MD, Ivana Kholova MD, PhD, MIAC, Jari Laatta MD, Tania Labiano MD, Martina Leopizzi CT, PhD, Maria D. Lozano MD, Rita Luis MD, Elisabetta Maffei MD, Alessandro Marando MD, Maurizio Martini MD, PhD, Elisabetta Merenda MD, Marco Montella MD, PhD, Allan Argueta Morales MD, Michiya Nishino MD, PhD, Fabio Pagni MD, Paul Hofman MD, PhD, Angelina Pernazza MD, PhD, Sinchita Roy-Chowdhuri MD, PhD, Mauro Saieg MD, PhD, MIAC, Spasenija Savic Prince MD, Momin T. Siddiqui MD, Tajana Stoos-Veic MD, PhD, Margareta Strojan Fležar MD, PhD, MIAC, Dinka Sundov MD, PhD, Paul VanderLaan MD, PhD, Danijela Vrdoljak-Mozetič MD, PhD, Pio Zeppa MD, PhD, Giancarlo Troncone MD, PhD, Elena Vigliar MD, PhD","doi":"10.1002/cncy.70003","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Introduction</h3>\n \n <p>The aim of this project is to assess interobserver agreement for programmed death-ligand 1 (PD-L1) scoring on of non–small cell lung cancer (NSCLC) on cytological specimens in a large-scale multicenter study, by exploiting the cell block-derived tissue microarray (cbTMA) approach.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A total of 65 cell blocks (CB) diagnosed as NSCLC were retrospectively collected and selected for TMA preparation. Hematoxylin–eosin and PD-L1 stained slides were digitized and uploaded on a free web sharing platform. Participants were asked to provide PD-L1 assessment by using the clinically relevant cutoff of tumor proportion score (TPS) (<1%; 1%–49%; >50%). Interobserver agreement was calculated using Fleiss’s κ.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Of 65 CBs, 11 were deemed not suitable; therefore, an overall number of 54 cores were used for the preparation of four TMAs. A total of 1674 evaluations were provided by 31 cytopathologists from 21 different institutions in nine countries. The statistical analysis showed a moderate overall agreement (κ = 0.49). The highest agreement was achieved in the TPS >50% category (κ = 0.57); moderate agreement was observed in TPS <1% category (κ = 0.51) and the lowest κ value was obtained for TPS 1%–49% category (k = 0.32).</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>The overall moderate agreement observed showed that there is still room for improvement in inter-pathologist agreement for PD-L1 evaluation on cytological samples, highlighting the need for standardization in sample preparation, focused training in PD-L1 evaluation on cytological material, and the integration of machine learning tools to improve interobserver consistency.</p>\n </section>\n </div>","PeriodicalId":9410,"journal":{"name":"Cancer Cytopathology","volume":"133 3","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cncy.70003","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cancer Cytopathology","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cncy.70003","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction
The aim of this project is to assess interobserver agreement for programmed death-ligand 1 (PD-L1) scoring on of non–small cell lung cancer (NSCLC) on cytological specimens in a large-scale multicenter study, by exploiting the cell block-derived tissue microarray (cbTMA) approach.
Methods
A total of 65 cell blocks (CB) diagnosed as NSCLC were retrospectively collected and selected for TMA preparation. Hematoxylin–eosin and PD-L1 stained slides were digitized and uploaded on a free web sharing platform. Participants were asked to provide PD-L1 assessment by using the clinically relevant cutoff of tumor proportion score (TPS) (<1%; 1%–49%; >50%). Interobserver agreement was calculated using Fleiss’s κ.
Results
Of 65 CBs, 11 were deemed not suitable; therefore, an overall number of 54 cores were used for the preparation of four TMAs. A total of 1674 evaluations were provided by 31 cytopathologists from 21 different institutions in nine countries. The statistical analysis showed a moderate overall agreement (κ = 0.49). The highest agreement was achieved in the TPS >50% category (κ = 0.57); moderate agreement was observed in TPS <1% category (κ = 0.51) and the lowest κ value was obtained for TPS 1%–49% category (k = 0.32).
Conclusions
The overall moderate agreement observed showed that there is still room for improvement in inter-pathologist agreement for PD-L1 evaluation on cytological samples, highlighting the need for standardization in sample preparation, focused training in PD-L1 evaluation on cytological material, and the integration of machine learning tools to improve interobserver consistency.
期刊介绍:
Cancer Cytopathology provides a unique forum for interaction and dissemination of original research and educational information relevant to the practice of cytopathology and its related oncologic disciplines. The journal strives to have a positive effect on cancer prevention, early detection, diagnosis, and cure by the publication of high-quality content. The mission of Cancer Cytopathology is to present and inform readers of new applications, technological advances, cutting-edge research, novel applications of molecular techniques, and relevant review articles related to cytopathology.