Vicente Wielandt, Juan Fernando Oyarzo, Manolis Jusakos, Giuliana Lunecke, Diana Biscay, Claudia Bosio, Paula Zambrano-Achig, Sebastián Pinto, Magdalena Bignon, Gabriel Rada, Francisca Verdugo-Paiva
{"title":"检索颞下颌疾病研究的搜索策略和自动分类器的开发和验证。","authors":"Vicente Wielandt, Juan Fernando Oyarzo, Manolis Jusakos, Giuliana Lunecke, Diana Biscay, Claudia Bosio, Paula Zambrano-Achig, Sebastián Pinto, Magdalena Bignon, Gabriel Rada, Francisca Verdugo-Paiva","doi":"10.22514/jofph.2024.015","DOIUrl":null,"url":null,"abstract":"<p><p>The objective was to develop and evaluate a comprehensive search strategy (SS) and automated classifier (AC) for retrieving temporomandibular disorders (TMD) research articles. An initial version of SS and AC was created by compiling terms from various sources, including previous systematic reviews (SRs) and consulting with TMD specialists. Performance was assessed using the relative recall (RR) method against a sample of all the primary studies (PS) included in 100 TMD-related SRs, with RR calculated for both SS and AC based on their ability to capture/classify TMD PSs. Adjustments were made iteratively. A validation was performed against PSs included in all TMD-relevant SRs published from January to April 2023. The analysis included 1271 PSs from 100 SRs published between 2002-2022. The initial SS had a relative recall of 89.34%, while the AC detected 70.05% of the studies. After adjustments, the fifth version reached 99.5% and 89.5% relative recall, respectively. Validation with 28 SRs from 2023 showed a search strategy sensitivity of 99.67% and AC sensitivity of 88.04%. In conclusion, the proposed SS demonstrated excellent performance in retrieving TMD-related research articles, with only a small percentage not correctly classified by the AC. The SS can effectively support evidence synthesis related to TMD, while the AC can aid in creating an open-access, continuously updated digital repository for all relevant TMD evidence.</p>","PeriodicalId":48800,"journal":{"name":"Journal of Oral & Facial Pain and Headache","volume":"38 2","pages":"74-81"},"PeriodicalIF":1.9000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and validation of a search strategy and an automated classifier for retrieving temporomandibular disorders studies.\",\"authors\":\"Vicente Wielandt, Juan Fernando Oyarzo, Manolis Jusakos, Giuliana Lunecke, Diana Biscay, Claudia Bosio, Paula Zambrano-Achig, Sebastián Pinto, Magdalena Bignon, Gabriel Rada, Francisca Verdugo-Paiva\",\"doi\":\"10.22514/jofph.2024.015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The objective was to develop and evaluate a comprehensive search strategy (SS) and automated classifier (AC) for retrieving temporomandibular disorders (TMD) research articles. An initial version of SS and AC was created by compiling terms from various sources, including previous systematic reviews (SRs) and consulting with TMD specialists. Performance was assessed using the relative recall (RR) method against a sample of all the primary studies (PS) included in 100 TMD-related SRs, with RR calculated for both SS and AC based on their ability to capture/classify TMD PSs. Adjustments were made iteratively. A validation was performed against PSs included in all TMD-relevant SRs published from January to April 2023. The analysis included 1271 PSs from 100 SRs published between 2002-2022. The initial SS had a relative recall of 89.34%, while the AC detected 70.05% of the studies. After adjustments, the fifth version reached 99.5% and 89.5% relative recall, respectively. Validation with 28 SRs from 2023 showed a search strategy sensitivity of 99.67% and AC sensitivity of 88.04%. In conclusion, the proposed SS demonstrated excellent performance in retrieving TMD-related research articles, with only a small percentage not correctly classified by the AC. The SS can effectively support evidence synthesis related to TMD, while the AC can aid in creating an open-access, continuously updated digital repository for all relevant TMD evidence.</p>\",\"PeriodicalId\":48800,\"journal\":{\"name\":\"Journal of Oral & Facial Pain and Headache\",\"volume\":\"38 2\",\"pages\":\"74-81\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Oral & Facial Pain and Headache\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.22514/jofph.2024.015\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Oral & Facial Pain and Headache","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.22514/jofph.2024.015","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/12 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
Development and validation of a search strategy and an automated classifier for retrieving temporomandibular disorders studies.
The objective was to develop and evaluate a comprehensive search strategy (SS) and automated classifier (AC) for retrieving temporomandibular disorders (TMD) research articles. An initial version of SS and AC was created by compiling terms from various sources, including previous systematic reviews (SRs) and consulting with TMD specialists. Performance was assessed using the relative recall (RR) method against a sample of all the primary studies (PS) included in 100 TMD-related SRs, with RR calculated for both SS and AC based on their ability to capture/classify TMD PSs. Adjustments were made iteratively. A validation was performed against PSs included in all TMD-relevant SRs published from January to April 2023. The analysis included 1271 PSs from 100 SRs published between 2002-2022. The initial SS had a relative recall of 89.34%, while the AC detected 70.05% of the studies. After adjustments, the fifth version reached 99.5% and 89.5% relative recall, respectively. Validation with 28 SRs from 2023 showed a search strategy sensitivity of 99.67% and AC sensitivity of 88.04%. In conclusion, the proposed SS demonstrated excellent performance in retrieving TMD-related research articles, with only a small percentage not correctly classified by the AC. The SS can effectively support evidence synthesis related to TMD, while the AC can aid in creating an open-access, continuously updated digital repository for all relevant TMD evidence.
期刊介绍:
Founded upon sound scientific principles, this journal continues to make important contributions that strongly influence the work of dental and medical professionals involved in treating oral and facial pain, including temporomandibular disorders, and headache. In addition to providing timely scientific research and clinical articles, the journal presents diagnostic techniques and treatment therapies for oral and facial pain, headache, mandibular dysfunction, and occlusion and covers pharmacology, physical therapy, surgery, and other pain-management methods.