ESM-Q: A consensus-based quality assessment tool for experience sampling method items.

IF 4.6 2区 心理学 Q1 PSYCHOLOGY, EXPERIMENTAL
Gudrun Eisele, Anu Hiekkaranta, Yoram K Kunkels, Marije Aan Het Rot, Wouter van Ballegooijen, Sara Laureen Bartels, Jojanneke A Bastiaansen, Patrick N Beymer, Lauren M Bylsma, Ryan W Carpenter, William D Ellison, Aaron J Fisher, Thomas Forkmann, Madelyn R Frumkin, Daniel Fulford, Kristin Naragon-Gainey, Talya Greene, Vera E Heininga, Andrew Jones, Elise K Kalokerinos, Peter Kuppens, Kathryn L Modecki, Fabiola Müller, Andreas B Neubauer, Vanessa Panaite, Maude Schneider, Jessie Sun, Stephen J Wilson, Caroline Zygar-Hoffmann, Inez Myin-Germeys, Olivia J Kirtley
{"title":"ESM-Q: A consensus-based quality assessment tool for experience sampling method items.","authors":"Gudrun Eisele, Anu Hiekkaranta, Yoram K Kunkels, Marije Aan Het Rot, Wouter van Ballegooijen, Sara Laureen Bartels, Jojanneke A Bastiaansen, Patrick N Beymer, Lauren M Bylsma, Ryan W Carpenter, William D Ellison, Aaron J Fisher, Thomas Forkmann, Madelyn R Frumkin, Daniel Fulford, Kristin Naragon-Gainey, Talya Greene, Vera E Heininga, Andrew Jones, Elise K Kalokerinos, Peter Kuppens, Kathryn L Modecki, Fabiola Müller, Andreas B Neubauer, Vanessa Panaite, Maude Schneider, Jessie Sun, Stephen J Wilson, Caroline Zygar-Hoffmann, Inez Myin-Germeys, Olivia J Kirtley","doi":"10.3758/s13428-025-02626-1","DOIUrl":null,"url":null,"abstract":"<p><p>The experience sampling method (ESM) is increasingly used by researchers from various disciplines to answer novel questions about individuals' daily lives. Measurement best practices have long been overlooked in ESM research, and recent reviews show that item quality is often not reported in ESM studies. The absence of information about item quality may be partly explained by the lack of consensus on how ESM item quality should be evaluated. As part of the ESM Item Repository project (esmitemrepository.com)-an international open science initiative that collects ESM items in an open item bank and evaluates their quality-we brought together 42 international ESM experts to develop an ESM item quality assessment tool. In four Delphi phases, experts suggested 57 item quality criteria, rated the criteria, provided arguments for and against the criteria, and rated the criteria again, considering reflections from other experts. The result of the Delphi process is ESM-Q: a quality assessment tool consisting of 10 core criteria, as well as an additional 15 supplementary criteria, to be used depending on the type of items being rated and the availability of supplementary information. The criteria cover topics ranging from construct validity to the optimal wording of items. ESM-Q can aid ESM researchers in selecting existing ESM items, developing new high-quality ESM items, and evaluating the quality of ESM items in systematic reviews. Expert reflections also highlight open research questions surrounding ESM item design that form a research agenda for ESM measurement.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 4","pages":"124"},"PeriodicalIF":4.6000,"publicationDate":"2025-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02626-1","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0

Abstract

The experience sampling method (ESM) is increasingly used by researchers from various disciplines to answer novel questions about individuals' daily lives. Measurement best practices have long been overlooked in ESM research, and recent reviews show that item quality is often not reported in ESM studies. The absence of information about item quality may be partly explained by the lack of consensus on how ESM item quality should be evaluated. As part of the ESM Item Repository project (esmitemrepository.com)-an international open science initiative that collects ESM items in an open item bank and evaluates their quality-we brought together 42 international ESM experts to develop an ESM item quality assessment tool. In four Delphi phases, experts suggested 57 item quality criteria, rated the criteria, provided arguments for and against the criteria, and rated the criteria again, considering reflections from other experts. The result of the Delphi process is ESM-Q: a quality assessment tool consisting of 10 core criteria, as well as an additional 15 supplementary criteria, to be used depending on the type of items being rated and the availability of supplementary information. The criteria cover topics ranging from construct validity to the optimal wording of items. ESM-Q can aid ESM researchers in selecting existing ESM items, developing new high-quality ESM items, and evaluating the quality of ESM items in systematic reviews. Expert reflections also highlight open research questions surrounding ESM item design that form a research agenda for ESM measurement.

ESM-Q:基于共识的经验抽样方法项目质量评估工具。
经验抽样法(ESM)越来越多地被不同学科的研究人员用于回答有关个人日常生活的新问题。长期以来,测量最佳实践在ESM研究中一直被忽视,最近的评论表明,项目质量通常没有在ESM研究中报告。缺乏项目质量信息的部分原因可能是对如何评估ESM项目质量缺乏共识。作为ESM项目存储库项目(esmitemrepository.com)的一部分,我们汇集了42位国际ESM专家,开发了一个ESM项目质量评估工具。ESM项目存储库是一个国际开放科学倡议,收集ESM项目并评估其质量。在四个德尔菲阶段,专家们提出了57个项目的质量标准,对标准进行了评级,提出了支持和反对标准的论据,并考虑了其他专家的意见,对标准进行了再次评级。德尔菲过程的结果是ESM-Q:一种质量评估工具,由10个核心标准和另外15个补充标准组成,根据被评级项目的类型和补充信息的可用性来使用。这些标准涵盖了从结构效度到项目最佳措辞的主题。ESM- q可以帮助ESM研究人员选择现有的ESM项目,开发新的高质量的ESM项目,并在系统评价中评估ESM项目的质量。专家的反思还突出了围绕ESM项目设计的开放式研究问题,这些问题形成了ESM测量的研究议程。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
10.30
自引率
9.30%
发文量
266
期刊介绍: Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信