Sandra Sinno-Tellier, Dorian Délepine, Dominique Vodovar, Coralie Bragança, Marie Sponga, Emmanuel Puskarczyk, Ingrid Blanc-Brisset, Fanny Pelissier, Ismaïl Ahmed, Jacques Manel, Juliette Bloch, Alexis Descatha
{"title":"评价法国中毒控制中心设计和应用的中毒因果关系评估方法的可重复性和有效性。","authors":"Sandra Sinno-Tellier, Dorian Délepine, Dominique Vodovar, Coralie Bragança, Marie Sponga, Emmanuel Puskarczyk, Ingrid Blanc-Brisset, Fanny Pelissier, Ismaïl Ahmed, Jacques Manel, Juliette Bloch, Alexis Descatha","doi":"10.1080/15563650.2025.2515239","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>French poison control centres have developed and use a standardised causality assessment method based on a decision tree for poisoning cases involving a wide range of xenobiotics, which includes five ascending levels (I0-I4) and six determinants. This study was designed to evaluate inter-rater reliability and the validity of using this method.</p><p><strong>Methods: </strong>A reference group of toxicologists identified five categories of cases - based on the route of exposure with two circumstances for the oral route - recorded in the French National Database of Poisonings. The reference group assessed by consensus the level of causality of each randomly selected case as the reference level. Toxicologists from poison centres, not belonging to the reference group, were selected as raters. Inter-rater reliability was assessed using weighted Light's kappa. The results of raters were compared against the reference to test the validity of the method. A subgroup analysis of inter-rater reliability was also performed according to rater experience, case category, and causality determinant.</p><p><strong>Results: </strong>Nineteen raters reviewed the 86 cases selected by the reference group. Kappa was equal to 0.55 (moderate agreement). Sensitivity was 0.90 and specificity was 0.62 when comparing I0 versus I1-I4 classes. The agreement between raters increased with experience except for the most experienced group. Ocular route of exposure had the highest kappa (0.70) among the five case categories. Kappa for the causality determinants varied from 0.31 (exposure) to 0.54 (bibliographical references).</p><p><strong>Discussion: </strong>The causality assessment of poisonings was carried out on real-life cases. Our results are close to those of studies on causality methods in pharmacovigilance and nutrivigilance, despite a wider scope of application.</p><p><strong>Conclusion: </strong>Causality assessment method employed by French poison control centres is useful, although coding of some determinants should be improved. Further refinement of the causality assessment method will also further enhance its utility.</p>","PeriodicalId":520593,"journal":{"name":"Clinical toxicology (Philadelphia, Pa.)","volume":" ","pages":"570-578"},"PeriodicalIF":3.3000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluation of the reproducibility and validity of the use of the causality assessment method for poisonings designed and applied by the French poison control centres.\",\"authors\":\"Sandra Sinno-Tellier, Dorian Délepine, Dominique Vodovar, Coralie Bragança, Marie Sponga, Emmanuel Puskarczyk, Ingrid Blanc-Brisset, Fanny Pelissier, Ismaïl Ahmed, Jacques Manel, Juliette Bloch, Alexis Descatha\",\"doi\":\"10.1080/15563650.2025.2515239\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>French poison control centres have developed and use a standardised causality assessment method based on a decision tree for poisoning cases involving a wide range of xenobiotics, which includes five ascending levels (I0-I4) and six determinants. This study was designed to evaluate inter-rater reliability and the validity of using this method.</p><p><strong>Methods: </strong>A reference group of toxicologists identified five categories of cases - based on the route of exposure with two circumstances for the oral route - recorded in the French National Database of Poisonings. The reference group assessed by consensus the level of causality of each randomly selected case as the reference level. Toxicologists from poison centres, not belonging to the reference group, were selected as raters. Inter-rater reliability was assessed using weighted Light's kappa. The results of raters were compared against the reference to test the validity of the method. A subgroup analysis of inter-rater reliability was also performed according to rater experience, case category, and causality determinant.</p><p><strong>Results: </strong>Nineteen raters reviewed the 86 cases selected by the reference group. Kappa was equal to 0.55 (moderate agreement). Sensitivity was 0.90 and specificity was 0.62 when comparing I0 versus I1-I4 classes. The agreement between raters increased with experience except for the most experienced group. Ocular route of exposure had the highest kappa (0.70) among the five case categories. Kappa for the causality determinants varied from 0.31 (exposure) to 0.54 (bibliographical references).</p><p><strong>Discussion: </strong>The causality assessment of poisonings was carried out on real-life cases. Our results are close to those of studies on causality methods in pharmacovigilance and nutrivigilance, despite a wider scope of application.</p><p><strong>Conclusion: </strong>Causality assessment method employed by French poison control centres is useful, although coding of some determinants should be improved. Further refinement of the causality assessment method will also further enhance its utility.</p>\",\"PeriodicalId\":520593,\"journal\":{\"name\":\"Clinical toxicology (Philadelphia, Pa.)\",\"volume\":\" \",\"pages\":\"570-578\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical toxicology (Philadelphia, Pa.)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/15563650.2025.2515239\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/7/14 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical toxicology (Philadelphia, Pa.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/15563650.2025.2515239","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/7/14 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
Evaluation of the reproducibility and validity of the use of the causality assessment method for poisonings designed and applied by the French poison control centres.
Introduction: French poison control centres have developed and use a standardised causality assessment method based on a decision tree for poisoning cases involving a wide range of xenobiotics, which includes five ascending levels (I0-I4) and six determinants. This study was designed to evaluate inter-rater reliability and the validity of using this method.
Methods: A reference group of toxicologists identified five categories of cases - based on the route of exposure with two circumstances for the oral route - recorded in the French National Database of Poisonings. The reference group assessed by consensus the level of causality of each randomly selected case as the reference level. Toxicologists from poison centres, not belonging to the reference group, were selected as raters. Inter-rater reliability was assessed using weighted Light's kappa. The results of raters were compared against the reference to test the validity of the method. A subgroup analysis of inter-rater reliability was also performed according to rater experience, case category, and causality determinant.
Results: Nineteen raters reviewed the 86 cases selected by the reference group. Kappa was equal to 0.55 (moderate agreement). Sensitivity was 0.90 and specificity was 0.62 when comparing I0 versus I1-I4 classes. The agreement between raters increased with experience except for the most experienced group. Ocular route of exposure had the highest kappa (0.70) among the five case categories. Kappa for the causality determinants varied from 0.31 (exposure) to 0.54 (bibliographical references).
Discussion: The causality assessment of poisonings was carried out on real-life cases. Our results are close to those of studies on causality methods in pharmacovigilance and nutrivigilance, despite a wider scope of application.
Conclusion: Causality assessment method employed by French poison control centres is useful, although coding of some determinants should be improved. Further refinement of the causality assessment method will also further enhance its utility.