Behind the Scenes: A Qualitative Investigation of Interviewers' Performance in EQ-5D Valuation Studies.

IF 2 Q2 ECONOMICS
PharmacoEconomics Open Pub Date : 2024-05-01 Epub Date: 2024-04-09 DOI:10.1007/s41669-024-00486-7
Carlotta Varriale, Giovanni Andrulli, Michela Meregaglia, Fanni Rencz, Aureliano Paolo Finch
{"title":"Behind the Scenes: A Qualitative Investigation of Interviewers' Performance in EQ-5D Valuation Studies.","authors":"Carlotta Varriale, Giovanni Andrulli, Michela Meregaglia, Fanni Rencz, Aureliano Paolo Finch","doi":"10.1007/s41669-024-00486-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The EuroQol Valuation Technology (EQ-VT) protocol is currently employed by the valuation studies of the EQ family of instruments worldwide. To date, all the evidence in support of the quality control (QC) originates from quantitative indicators.</p><p><strong>Objective: </strong>We aimed to explore interviewers' conversational patterns in EQ-VT interviews, beyond quantitative QC indicators, and to provide a preliminary exploration of how the interaction between interviewer and respondent impacts data quality.</p><p><strong>Methods: </strong>Two researchers transcribed and independently coded 24 video-recorded interviews from the Italian EQ-5D-5L valuation study, adopting the conversational analysis framework. The analysis identified positive and negative 'patterns' of conversational practice. These were categorized into themes and sub-themes and were used to score a random sample of 42 video-recorded interviews conducted at different time points by seven interviewers.</p><p><strong>Results: </strong>The conversational analysis identified 20 positive and 14 negative interview patterns, which were grouped into two main themes (i.e., task execution and communication skills). Positive items included appending questions that stimulated respondents' engagement, providing different explanations for an unclear aspect, supporting the participant with useful information for completing the tasks, and increasing the interview's coherence by confirming the respondent answers. Negative patterns included moving forward in the exercise without making sure that the respondent understood, trying to force an answer from the respondent, speaking too fast, and providing incomplete or incorrect explanations of the task. Most interviewers exhibited a moderate increase in positive patterns or a decrease in negative patterns over time. A certain degree of consistency between the quantitative QC results and the qualitative scoring deriving from the interviewer-respondent interaction was observed, with the best and worst performers of the qualitative scoring showing good and bad scores on key QC items, respectively.</p><p><strong>Conclusions: </strong>The identified positive and negative patterns may be useful to inform the training material of EQ-VT studies worldwide and complement the existing QC process.</p>","PeriodicalId":19770,"journal":{"name":"PharmacoEconomics Open","volume":"8 3","pages":"389-401"},"PeriodicalIF":2.0000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11058132/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PharmacoEconomics Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s41669-024-00486-7","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/4/9 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ECONOMICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background: The EuroQol Valuation Technology (EQ-VT) protocol is currently employed by the valuation studies of the EQ family of instruments worldwide. To date, all the evidence in support of the quality control (QC) originates from quantitative indicators.

Objective: We aimed to explore interviewers' conversational patterns in EQ-VT interviews, beyond quantitative QC indicators, and to provide a preliminary exploration of how the interaction between interviewer and respondent impacts data quality.

Methods: Two researchers transcribed and independently coded 24 video-recorded interviews from the Italian EQ-5D-5L valuation study, adopting the conversational analysis framework. The analysis identified positive and negative 'patterns' of conversational practice. These were categorized into themes and sub-themes and were used to score a random sample of 42 video-recorded interviews conducted at different time points by seven interviewers.

Results: The conversational analysis identified 20 positive and 14 negative interview patterns, which were grouped into two main themes (i.e., task execution and communication skills). Positive items included appending questions that stimulated respondents' engagement, providing different explanations for an unclear aspect, supporting the participant with useful information for completing the tasks, and increasing the interview's coherence by confirming the respondent answers. Negative patterns included moving forward in the exercise without making sure that the respondent understood, trying to force an answer from the respondent, speaking too fast, and providing incomplete or incorrect explanations of the task. Most interviewers exhibited a moderate increase in positive patterns or a decrease in negative patterns over time. A certain degree of consistency between the quantitative QC results and the qualitative scoring deriving from the interviewer-respondent interaction was observed, with the best and worst performers of the qualitative scoring showing good and bad scores on key QC items, respectively.

Conclusions: The identified positive and negative patterns may be useful to inform the training material of EQ-VT studies worldwide and complement the existing QC process.

幕后:对 EQ-5D 估值研究中受访者表现的定性调查。
背景:目前,世界各地的 EQ 系列工具估值研究都采用了 EuroQol Valuation Technology (EQ-VT) 协议。迄今为止,所有支持质量控制(QC)的证据都来自量化指标:我们旨在探索 EQ-VT 访谈中访谈者的对话模式,而非定量质量控制指标,并初步探讨访谈者与受访者之间的互动如何影响数据质量:两名研究人员采用会话分析框架,对意大利 EQ-5D-5L 估值研究中的 24 个视频录像访谈进行了转录和独立编码。分析确定了会话实践的积极和消极 "模式"。这些 "模式 "被归类为主题和次主题,并用于对七位访谈者在不同时间点进行的 42 个视频录像访谈进行随机抽样评分:会话分析确定了 20 种积极的面试模式和 14 种消极的面试模式,并将其归纳为两大主题(即任务执行和沟通技巧)。积极模式包括附加问题以激发受访者的参与热情、对不明确的方面提供不同的解释、为受访者提供完成任务所需的有用信息,以及通过确认受访者的回答来增强访谈的连贯性。负面模式包括:在没有确认受访者是否理解的情况下继续进行练习、试图强迫受访者回答问题、语速过快、对任务的解释不完整或不正确。随着时间的推移,大多数面试官的积极模式会适度增加,而消极模式则会有所减少。定量质量控制结果与从面试官与受访者互动中得出的定性评分之间存在一定程度的一致性,定性评分中表现最好和最差的面试官在关键质量控制项目上的得分分别为好和差:所发现的积极和消极模式可能有助于为全球 EQ-VT 研究的培训材料提供信息,并对现有的质量控制流程进行补充。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
3.50
自引率
0.00%
发文量
64
审稿时长
8 weeks
期刊介绍: PharmacoEconomics - Open focuses on applied research on the economic implications and health outcomes associated with drugs, devices and other healthcare interventions. The journal includes, but is not limited to, the following research areas:Economic analysis of healthcare interventionsHealth outcomes researchCost-of-illness studiesQuality-of-life studiesAdditional digital features (including animated abstracts, video abstracts, slide decks, audio slides, instructional videos, infographics, podcasts and animations) can be published with articles; these are designed to increase the visibility, readership and educational value of the journal’s content. In addition, articles published in PharmacoEconomics -Open may be accompanied by plain language summaries to assist readers who have some knowledge of, but not in-depth expertise in, the area to understand important medical advances.All manuscripts are subject to peer review by international experts. Letters to the Editor are welcomed and will be considered for publication.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信