Tessa E Hendriks, Alberto Balduzzi, Susan van Dieren, J Annelie Suurmeijer, Roberto Salvia, Thomas F Stoop, Marco Del Chiaro, Sven D Mieog, Mark Nielen, Sabino Zani, Daniel Nussbaum, Thilo Hackert, Jakob R Izbicki, Ammar A Javed, D Brock Hewitt, Bas Groot Koerkamp, Roeland F de Wilde, Yi Miao, Kuirong Jiang, Kohei Nakata, Masafumi Nakamura, Jin-Young Jang, Mirang Lee, Cristina R Ferrone, Shailesh V Shrikhande, Vikram A Chaudhari, Olivier R Busch, Ajith K Siriwardena, Oliver Strobel, Jens Werner, Bert A Bonsing, Giovanni Marchegiani, Marc G Besselink
{"title":"国际胰腺外科研究小组（ISGPS）定义的胰十二指肠切除术后并发症的观察者间差异：一项国际多中心横断面研究。","authors":"Tessa E Hendriks, Alberto Balduzzi, Susan van Dieren, J Annelie Suurmeijer, Roberto Salvia, Thomas F Stoop, Marco Del Chiaro, Sven D Mieog, Mark Nielen, Sabino Zani, Daniel Nussbaum, Thilo Hackert, Jakob R Izbicki, Ammar A Javed, D Brock Hewitt, Bas Groot Koerkamp, Roeland F de Wilde, Yi Miao, Kuirong Jiang, Kohei Nakata, Masafumi Nakamura, Jin-Young Jang, Mirang Lee, Cristina R Ferrone, Shailesh V Shrikhande, Vikram A Chaudhari, Olivier R Busch, Ajith K Siriwardena, Oliver Strobel, Jens Werner, Bert A Bonsing, Giovanni Marchegiani, Marc G Besselink","doi":"10.1097/SLA.0000000000006473","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To determine the interobserver variability for complications of pancreatoduodenectomy as defined by the International Study Group for Pancreatic Surgery (ISGPS) and others.</p><p><strong>Background: </strong>Good interobserver variability for the definitions of surgical complications is of major importance in comparing surgical outcomes between and within centers. However, data on interobserver variability for pancreatoduodenectomy-specific complications are lacking.</p><p><strong>Methods: </strong>International cross-sectional multicenter study including 52 raters from 13 high-volume pancreatic centers in 8 countries on 3 continents. Per center, 4 experienced raters scored 30 randomly selected patients after pancreatoduodenectomy. In addition, all raters scored 6 standardized case vignettes. This variability and the \"within centers\" variability were calculated for 2-fold scoring (no complication/grade A vs grade B/C) and 3-fold scoring (no complication/grade A vs grade B vs grade C) of postoperative pancreatic fistula, postpancreatoduodenectomy hemorrhage, chyle leak, bile leak, and delayed gastric emptying. Interobserver variability is presented with Gwet AC-1 measure for agreement.</p><p><strong>Results: </strong>Overall, 390 patients after pancreatoduodenectomy were included. The overall agreement rate for the standardized cases vignettes for 2-fold scoring was 68% (95% CI: 55%-81%, AC1 score: moderate agreement), and for 3-fold scoring 55% (49%-62%, AC1 score: fair agreement). The mean \"within centers\" agreement for 2-fold scoring was 84% (80%-87%, AC1 score; substantial agreement).</p><p><strong>Conclusions: </strong>The interobserver variability for the ISGPS-defined complications of pancreatoduodenectomy was too high even though the \"within centers\" agreement was acceptable. Since these findings will decrease the quality and validity of clinical studies, ISGPS has started efforts aimed at reducing the interobserver variability.</p>","PeriodicalId":8017,"journal":{"name":"Annals of surgery","volume":" ","pages":"728-733"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Interobserver Variability in the International Study Group for Pancreatic Surgery (ISGPS)-Defined Complications After Pancreatoduodenectomy: An International Cross-Sectional Multicenter Study.\",\"authors\":\"Tessa E Hendriks, Alberto Balduzzi, Susan van Dieren, J Annelie Suurmeijer, Roberto Salvia, Thomas F Stoop, Marco Del Chiaro, Sven D Mieog, Mark Nielen, Sabino Zani, Daniel Nussbaum, Thilo Hackert, Jakob R Izbicki, Ammar A Javed, D Brock Hewitt, Bas Groot Koerkamp, Roeland F de Wilde, Yi Miao, Kuirong Jiang, Kohei Nakata, Masafumi Nakamura, Jin-Young Jang, Mirang Lee, Cristina R Ferrone, Shailesh V Shrikhande, Vikram A Chaudhari, Olivier R Busch, Ajith K Siriwardena, Oliver Strobel, Jens Werner, Bert A Bonsing, Giovanni Marchegiani, Marc G Besselink\",\"doi\":\"10.1097/SLA.0000000000006473\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>To determine the interobserver variability for complications of pancreatoduodenectomy as defined by the International Study Group for Pancreatic Surgery (ISGPS) and others.</p><p><strong>Background: </strong>Good interobserver variability for the definitions of surgical complications is of major importance in comparing surgical outcomes between and within centers. However, data on interobserver variability for pancreatoduodenectomy-specific complications are lacking.</p><p><strong>Methods: </strong>International cross-sectional multicenter study including 52 raters from 13 high-volume pancreatic centers in 8 countries on 3 continents. Per center, 4 experienced raters scored 30 randomly selected patients after pancreatoduodenectomy. In addition, all raters scored 6 standardized case vignettes. This variability and the \\\"within centers\\\" variability were calculated for 2-fold scoring (no complication/grade A vs grade B/C) and 3-fold scoring (no complication/grade A vs grade B vs grade C) of postoperative pancreatic fistula, postpancreatoduodenectomy hemorrhage, chyle leak, bile leak, and delayed gastric emptying. Interobserver variability is presented with Gwet AC-1 measure for agreement.</p><p><strong>Results: </strong>Overall, 390 patients after pancreatoduodenectomy were included. The overall agreement rate for the standardized cases vignettes for 2-fold scoring was 68% (95% CI: 55%-81%, AC1 score: moderate agreement), and for 3-fold scoring 55% (49%-62%, AC1 score: fair agreement). The mean \\\"within centers\\\" agreement for 2-fold scoring was 84% (80%-87%, AC1 score; substantial agreement).</p><p><strong>Conclusions: </strong>The interobserver variability for the ISGPS-defined complications of pancreatoduodenectomy was too high even though the \\\"within centers\\\" agreement was acceptable. Since these findings will decrease the quality and validity of clinical studies, ISGPS has started efforts aimed at reducing the interobserver variability.</p>\",\"PeriodicalId\":8017,\"journal\":{\"name\":\"Annals of surgery\",\"volume\":\" \",\"pages\":\"728-733\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1097/SLA.0000000000006473\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/8/1 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/SLA.0000000000006473","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/1 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}
Interobserver Variability in the International Study Group for Pancreatic Surgery (ISGPS)-Defined Complications After Pancreatoduodenectomy: An International Cross-Sectional Multicenter Study.
Objective: To determine the interobserver variability for complications of pancreatoduodenectomy as defined by the International Study Group for Pancreatic Surgery (ISGPS) and others.
Background: Good interobserver variability for the definitions of surgical complications is of major importance in comparing surgical outcomes between and within centers. However, data on interobserver variability for pancreatoduodenectomy-specific complications are lacking.
Methods: International cross-sectional multicenter study including 52 raters from 13 high-volume pancreatic centers in 8 countries on 3 continents. Per center, 4 experienced raters scored 30 randomly selected patients after pancreatoduodenectomy. In addition, all raters scored 6 standardized case vignettes. This variability and the "within centers" variability were calculated for 2-fold scoring (no complication/grade A vs grade B/C) and 3-fold scoring (no complication/grade A vs grade B vs grade C) of postoperative pancreatic fistula, postpancreatoduodenectomy hemorrhage, chyle leak, bile leak, and delayed gastric emptying. Interobserver variability is presented with Gwet AC-1 measure for agreement.
Results: Overall, 390 patients after pancreatoduodenectomy were included. The overall agreement rate for the standardized cases vignettes for 2-fold scoring was 68% (95% CI: 55%-81%, AC1 score: moderate agreement), and for 3-fold scoring 55% (49%-62%, AC1 score: fair agreement). The mean "within centers" agreement for 2-fold scoring was 84% (80%-87%, AC1 score; substantial agreement).
Conclusions: The interobserver variability for the ISGPS-defined complications of pancreatoduodenectomy was too high even though the "within centers" agreement was acceptable. Since these findings will decrease the quality and validity of clinical studies, ISGPS has started efforts aimed at reducing the interobserver variability.
期刊介绍：
The Annals of Surgery is a renowned surgery journal, recognized globally for its extensive scholarly references. It serves as a valuable resource for the international medical community by disseminating knowledge regarding important developments in surgical science and practice. Surgeons regularly turn to the Annals of Surgery to stay updated on innovative practices and techniques. The journal also offers special editorial features such as "Advances in Surgical Technique," offering timely coverage of ongoing clinical issues. Additionally, the journal publishes monthly review articles that address the latest concerns in surgical practice.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
