Bodhi Beroukhim, Skyler McComas, Julie M. Joyce, Luisa S. Schuhmacher, Inga Koerte, Zhou Lan, Alexander Lin
{"title":"A novel automated pipeline to assess MR spectroscopy quality control: Comparing current standards and manual assessment","authors":"Bodhi Beroukhim, Skyler McComas, Julie M. Joyce, Luisa S. Schuhmacher, Inga Koerte, Zhou Lan, Alexander Lin","doi":"10.1111/jon.13246","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background and Purpose</h3>\n \n <p>The absence of a consensus data quality control (DQC) process inhibits the widespread adoption of MR spectroscopy. Poor DQC can lead to unreliable clinical diagnosis and irreproducible research conclusions. Currently, manual visual assessment or the standard quantitative metrics of signal-to-noise, linewidth, and model fit are used as classifiers, but these measures may not be sufficient. To supplement standard metrics, this paper proposes a novel automated DQC pipeline named Visual Evaluative Control Technology Of Resonance Spectroscopy (VECTORS).</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>Manual DQC ratings were conducted on 7180 spectra obtained from 110 young adults using short-echo chemical shift imaging at 3 Tesla. Four reviewers conducted manual ratings on the presence of artifacts and location of metabolites. The ratings were labor intensive, taking over 180 hours. VECTORS was developed to quantify their DQC criteria, detecting artifacts that present as duplicate peaks, vertical shifts, and glutamine + glutamate and myoinositol peak shapes. Run on the same data using a standard laptop, VECTORS only took 2 hours.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The manual ratings were not monotonic to the standard quantitative metrics. VECTORS correctly flagged spectra that the manual ratings missed. VECTORS accurately flagged an additional 126 poor DQ spectra that consensus cutoffs of the standard quantitative metrics deemed good DQ.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Standard quantitative metrics may not account for all DQC artifacts as they are not monotonic to the manual ratings. However, manual ratings are labor intensive, subjective, and irreproducible. VECTORS addresses these issues and should be used in conjunction with standard quantitative metrics.</p>\n </section>\n </div>","PeriodicalId":16399,"journal":{"name":"Journal of Neuroimaging","volume":"35 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Neuroimaging","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jon.13246","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background and Purpose
The absence of a consensus data quality control (DQC) process inhibits the widespread adoption of MR spectroscopy. Poor DQC can lead to unreliable clinical diagnosis and irreproducible research conclusions. Currently, manual visual assessment or the standard quantitative metrics of signal-to-noise, linewidth, and model fit are used as classifiers, but these measures may not be sufficient. To supplement standard metrics, this paper proposes a novel automated DQC pipeline named Visual Evaluative Control Technology Of Resonance Spectroscopy (VECTORS).
Methods
Manual DQC ratings were conducted on 7180 spectra obtained from 110 young adults using short-echo chemical shift imaging at 3 Tesla. Four reviewers conducted manual ratings on the presence of artifacts and location of metabolites. The ratings were labor intensive, taking over 180 hours. VECTORS was developed to quantify their DQC criteria, detecting artifacts that present as duplicate peaks, vertical shifts, and glutamine + glutamate and myoinositol peak shapes. Run on the same data using a standard laptop, VECTORS only took 2 hours.
Results
The manual ratings were not monotonic to the standard quantitative metrics. VECTORS correctly flagged spectra that the manual ratings missed. VECTORS accurately flagged an additional 126 poor DQ spectra that consensus cutoffs of the standard quantitative metrics deemed good DQ.
Conclusion
Standard quantitative metrics may not account for all DQC artifacts as they are not monotonic to the manual ratings. However, manual ratings are labor intensive, subjective, and irreproducible. VECTORS addresses these issues and should be used in conjunction with standard quantitative metrics.
期刊介绍:
Start reading the Journal of Neuroimaging to learn the latest neurological imaging techniques. The peer-reviewed research is written in a practical clinical context, giving you the information you need on:
MRI
CT
Carotid Ultrasound and TCD
SPECT
PET
Endovascular Surgical Neuroradiology
Functional MRI
Xenon CT
and other new and upcoming neuroscientific modalities.The Journal of Neuroimaging addresses the full spectrum of human nervous system disease, including stroke, neoplasia, degenerating and demyelinating disease, epilepsy, tumors, lesions, infectious disease, cerebral vascular arterial diseases, toxic-metabolic disease, psychoses, dementias, heredo-familial disease, and trauma.Offering original research, review articles, case reports, neuroimaging CPCs, and evaluations of instruments and technology relevant to the nervous system, the Journal of Neuroimaging focuses on useful clinical developments and applications, tested techniques and interpretations, patient care, diagnostics, and therapeutics. Start reading today!