Persuasion with Precision: Using Natural Language Processing to Improve Instrument Fidelity for Risk Communication Experimental Treatments.

IF 3.8 1区社会学 Q1 SOCIAL SCIENCES, INTERDISCIPLINARY

Journal of Mixed Methods Research Pub Date : 2023-10-01 Epub Date: 2022-05-09 DOI:10.1177/15586898221096934

Ann Marie Reinhold, Eric D Raile, Clemente Izurieta, Jamie McEvoy, Henry W King, Geoffrey C Poole, Richard C Ready, Nicolas T Bergmann, Elizabeth A Shanahan

{"title":"Persuasion with Precision: Using Natural Language Processing to Improve Instrument Fidelity for Risk Communication Experimental Treatments.","authors":"Ann Marie Reinhold, Eric D Raile, Clemente Izurieta, Jamie McEvoy, Henry W King, Geoffrey C Poole, Richard C Ready, Nicolas T Bergmann, Elizabeth A Shanahan","doi":"10.1177/15586898221096934","DOIUrl":null,"url":null,"abstract":"Instrument fidelity in message testing research hinges upon how precisely messages operationalize treatment conditions. However, numerous message-testing studies have unmitigated threats to validity and reliability because no established procedures exist to guide construction of message treatments. Their construction typically occurs in a black box, resulting in suspect inferential conclusions about treatment effects. Because a mixed methods approach is needed to enhance instrument fidelity in message testing research, this article contributes to the field of mixed methods research by presenting an integrated multistage procedure for constructing precise message treatments using an exploratory sequential mixed methods design. This work harnesses the power of integration through crossover analysis to improve instrument fidelity in message testing research through the use of natural language processing.","PeriodicalId":47844,"journal":{"name":"Journal of Mixed Methods Research","volume":"17 1","pages":"373-395"},"PeriodicalIF":3.8000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11349321/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Mixed Methods Research","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/15586898221096934","RegionNum":1,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/5/9 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

Instrument fidelity in message testing research hinges upon how precisely messages operationalize treatment conditions. However, numerous message-testing studies have unmitigated threats to validity and reliability because no established procedures exist to guide construction of message treatments. Their construction typically occurs in a black box, resulting in suspect inferential conclusions about treatment effects. Because a mixed methods approach is needed to enhance instrument fidelity in message testing research, this article contributes to the field of mixed methods research by presenting an integrated multistage procedure for constructing precise message treatments using an exploratory sequential mixed methods design. This work harnesses the power of integration through crossover analysis to improve instrument fidelity in message testing research through the use of natural language processing.

查看原文本刊更多论文

精确说服:使用自然语言处理来提高风险沟通实验处理的仪器保真度

信息测试研究中的仪器保真度取决于信息如何准确地操作治疗条件。然而，许多消息测试研究都没有减轻对有效性和可靠性的威胁，因为没有既定的程序来指导消息处理的构建。它们的构建通常发生在一个黑盒中，导致关于治疗效果的可疑推断结论。由于在消息测试研究中需要一种混合方法来提高仪器的保真度，本文通过探索性的顺序混合方法设计，提出了一种构建精确消息处理的集成多阶段程序，为混合方法研究领域做出了贡献。这项工作通过交叉分析利用集成的力量，通过使用自然语言处理（NLP）来提高消息测试研究中的仪器保真度。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Mixed Methods Research SOCIAL SCIENCES, INTERDISCIPLINARY-

CiteScore

10.40

自引率

28.20%

发文量

期刊介绍： The Journal of Mixed Methods Research serves as a premiere outlet for ground-breaking and seminal work in the field of mixed methods research. Of primary importance will be building an international and multidisciplinary community of mixed methods researchers. The journal''s scope includes exploring a global terminology and nomenclature for mixed methods research, delineating where mixed methods research may be used most effectively, creating the paradigmatic and philosophical foundations for mixed methods research, illuminating design and procedure issues, and determining the logistics of conducting mixed methods research. JMMR invites articles from a wide variety of international perspectives, including academics and practitioners from psychology, sociology, education, evaluation, health sciences, geography, communication, management, family studies, marketing, social work, and other related disciplines across the social, behavioral, and human sciences.