Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group
{"title":"开发 CAMELOT,用于评估定性研究的方法论局限性,以便纳入定性证据综述","authors":"Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group","doi":"10.1002/cesm.12058","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Introduction</h3>\n \n <p>Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four <i>Meta domains</i> that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight <i>Method domains</i> which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the <i>Meta</i> and <i>Method domains</i>.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between <i>Meta</i> and <i>Method domains</i>. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.</p>\n </section>\n </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12058","citationCount":"0","resultStr":"{\"title\":\"Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses\",\"authors\":\"Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group\",\"doi\":\"10.1002/cesm.12058\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Introduction</h3>\\n \\n <p>Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Methods</h3>\\n \\n <p>We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four <i>Meta domains</i> that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight <i>Method domains</i> which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the <i>Meta</i> and <i>Method domains</i>.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusion</h3>\\n \\n <p>CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between <i>Meta</i> and <i>Method domains</i>. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.</p>\\n </section>\\n </div>\",\"PeriodicalId\":100286,\"journal\":{\"name\":\"Cochrane Evidence Synthesis and Methods\",\"volume\":\"2 6\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12058\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cochrane Evidence Synthesis and Methods\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/cesm.12058\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cochrane Evidence Synthesis and Methods","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cesm.12058","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses
Introduction
Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.
Methods
We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.
Results
CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four Meta domains that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight Method domains which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the Meta and Method domains.
Conclusion
CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between Meta and Method domains. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.