Piet van Tuijl, Peter Verboon, Jacques van Lankveld
{"title":"A short note on cue validity","authors":"Piet van Tuijl, Peter Verboon, Jacques van Lankveld","doi":"10.1016/j.metip.2025.100180","DOIUrl":"10.1016/j.metip.2025.100180","url":null,"abstract":"<div><div>In questionnaire development, content validity is usually operationalized by using items that comprehensively express all aspects of the object of measurement. We argue that this often leads to content coverage that is too broad, and that content validity needs pruning down when the intention is to measure conditions or constructs that should be discerned from other conditions or constructs – which is almost always the case. This pruned-down version of content validity we name “cue validity”, signifying the uniqueness of indicators for a construct. We show what negative consequences have been of ignoring cue validity in previously developed questionnaires and illustrate how taking cue validity into account can guide the validation of new questionnaires.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100180"},"PeriodicalIF":0.0,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144297942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Structural barriers to the formation of theories about the mind: A proposal for a model-based paradigm for psychology","authors":"Daniel Kerschke","doi":"10.1016/j.metip.2025.100186","DOIUrl":"10.1016/j.metip.2025.100186","url":null,"abstract":"<div><div>Psychology wields advanced empirical tools yet still resembles Kuhn's pre-paradigmatic science. I argue that progress is blocked by two ontological obstacles: the crud factor, in which variables are cross-linked, and the intrinsic opacity of subjective experience. Variable-isolation experiments or law-seeking programs struggle in such terrain. I propose a holistic gears-based framework that articulates mid-range, interrelated qualitative mechanisms and effectively orients subsequent empirical investigation. The approach decomposes contested constructs into empirically anchored parts, traces their context-bound interactions, and invites indirect tests through carefully chosen proxies. Finally, I examine institutional incentives that currently sideline heavy theoretical work and thereby sustain persistent fragmentation.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100186"},"PeriodicalIF":0.0,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144189508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andréanne Simard B.A. , Isabelle F.-Dufour Ph. D , Rose Malchelosse-Fournier M. Ps. éd , Jérémy Perreault B. Éd , Carol Hudon Ph. D
{"title":"Compatibility, integration, and epistemology: Contemporary issues from a mixed methods research experiment","authors":"Andréanne Simard B.A. , Isabelle F.-Dufour Ph. D , Rose Malchelosse-Fournier M. Ps. éd , Jérémy Perreault B. Éd , Carol Hudon Ph. D","doi":"10.1016/j.metip.2025.100187","DOIUrl":"10.1016/j.metip.2025.100187","url":null,"abstract":"<div><div>Combining quantitative and qualitative methods in Mixed Methods Research (MMR) makes it possible to benefit from the different strengths of each method. However, achieving a successful combination is not always easy. This article discusses the use of MMR in a study of clinical intervention, detailing the challenges, some insurmountable, encountered in designing the methodology, integrating the results, and preparing for the work for publication. These challenges are contextualized by reference to the current literature on MMR. The authors conclude by discussing the evolution of MMR and call for further critical reflection on compatibility, theory, and epistemology, and the resources and skills required to use the method effectively.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100187"},"PeriodicalIF":0.0,"publicationDate":"2025-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144195314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sarah Jenner , Dimitris Raidos , Emma Anderson , Stella Fleetwood , Ben Ainsworth , Kerry Fox , Jana Kreppner , Mary Barker
{"title":"Using large language models for narrative analysis: a novel application of generative AI","authors":"Sarah Jenner , Dimitris Raidos , Emma Anderson , Stella Fleetwood , Ben Ainsworth , Kerry Fox , Jana Kreppner , Mary Barker","doi":"10.1016/j.metip.2025.100183","DOIUrl":"10.1016/j.metip.2025.100183","url":null,"abstract":"<div><div>This study, a collaboration between the University of Southampton and Ipsos UK, aimed to develop and test a novel method for analysing qualitative data using generative artificial intelligence (AI). It compared large language model (LLM)-conducted analysis with human analysis of the same qualitative data, explored optimisation of LLMs for narrative analysis and evaluated their benefits and drawbacks. Using existing data, 138 short stories written by young people (aged 13–25 years) about social media, identity formation and food choices were analysed separately three times: by human researchers, and by two different LLMs (Claude and GPT-o1). The method was developed iteratively, combining Ipsos' artificial intelligence (AI) expertise and tools with researchers’ qualitative analysis expertise. Claude and GPT-o1 each conducted a narrative analysis of all 138 stories using the same analytic steps as the human researchers. Findings between the humans and both LLMs were then compared. Both LLMs quickly and successfully conducted a narrative analysis of the stories. Their findings were comparable to those of the human researchers and were judged by the researchers to be credible and thorough. Beyond replication, the LLMs provided additional insights into the data that enhanced the human analysis. This study highlights the significant potential benefits of LLMs to the field of qualitative research and proposes that LLMs could one day be seen as valuable tools for strengthening research quality and increasing efficiency. Additionally, this study discusses ethical concerns surrounding responsible AI use in research and proposes a framework for using LLMs in qualitative analysis.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100183"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143903681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Transformative multilevel mixed methods design: A worked example for researching and advocating for the bereaved at work","authors":"Leesa Taylor, Roslyn Cameron","doi":"10.1016/j.metip.2025.100181","DOIUrl":"10.1016/j.metip.2025.100181","url":null,"abstract":"<div><div>The purpose of this paper is to present a transformative mixed methods research design. This design advances the use of transformative paradigms and multilevel empirical research in mixed methods research. This design incorporates a set of key features. Firstly, it enacts the transformative worldview approach and its strong alignment to social justice, human rights and inclusivity of marginalized groups. Secondly, the design embeds quality criteria for a transformative methodology. This creates a transposing effect from the transformative paradigm to the methodology. This is also referred to as one of the dimensions of integration coherence, which means a consistent philosophical stance underpins the entire study. Thirdly, the design combines this with the stages for designing a multilevel mixed methods research design (ML-MMRD). These three key features combine to create an innovative design that is then demonstrated through the presentation of the worked example of a study which has adopted this design. The worked example draws upon two critical theories – thanatology and organizational support theory - to examine the organizational support required for bereaved employees and to expose the multifaceted impacts and vulnerabilities caused by bereavement for employees in the workplace. Additionally, the example also applies the new and more advanced mixed methods research notation system, the tailored approach to data integration and interpretation, and demonstrates advances in addressing the dynamic interdependence of the dimensions of integration in mixed methods research designs.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100181"},"PeriodicalIF":0.0,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143824268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Research opportunities to contribute to increased justice using a transformative approach","authors":"Donna M. Mertens","doi":"10.1016/j.metip.2025.100182","DOIUrl":"10.1016/j.metip.2025.100182","url":null,"abstract":"","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100182"},"PeriodicalIF":0.0,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143768709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marie Stadel , Anna M. Langener , Katie Hoemann , Laura F. Bringmann
{"title":"Assessing daily life activities with experience sampling methodology (ESM): Scoring predefined categories or qualitative analysis of open-ended responses?","authors":"Marie Stadel , Anna M. Langener , Katie Hoemann , Laura F. Bringmann","doi":"10.1016/j.metip.2025.100177","DOIUrl":"10.1016/j.metip.2025.100177","url":null,"abstract":"<div><div>One domain frequently assessed in Experience Sampling Methodology (ESM) studies is that of daily activities. This is often done with predefined (and unvalidated) categorical items, but can also be done using open-ended items. ESM researchers, however, lack tools and guidance in analyzing the obtained open-ended data. In the first part of this paper, we use data from a 28-day ESM study in which students reported their activities both categorically and open-endedly to compare these two assessment approaches. We additionally present participant preferences and reflections captured in exit interviews. In the second part, we illustrate the qualitative analysis process for open-ended ESM responses. All code and tools we used (including a newly developed Shiny App facilitating the coding of responses to open-ended ESM items) are shared for use in future research. Our results highlight the advantages and limitations of both assessment approaches: while categorical items offer simplicity, they often lack specificity. Conversely, open-ended responses provide richer, more personalized data, making them particularly valuable in idiographic clinical applications and exploratory research. A combination of both formats may enable the most effective assessment. We hope the tools we provide encourage the further use and exploration of open-ended ESM assessments.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100177"},"PeriodicalIF":0.0,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143445725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Critical dialectical pluralism as a transformative multidimensional metaparadigm and metaphilosophy for mixed methods research","authors":"Anthony J. Onwuegbuzie , Sandra Schamroth Abrams","doi":"10.1016/j.metip.2025.100178","DOIUrl":"10.1016/j.metip.2025.100178","url":null,"abstract":"<div><div>Critical Dialectical Pluralism (CDP), a mixed methods research-based metaparadigm and metaphilosophy that hinges on a synthesis of diverse methodological and philosophical perspectives, substantially has influenced mixed methods research. The core tenets of CDP—<strong><u>s</u></strong>ocial justice, <strong><u>i</u></strong>nclusion, <strong><u>d</u></strong>iversity, <strong><u>e</u></strong>quity, and <strong><u>s</u></strong>ocial responsibility (i.e., SIDES)—which represent the five pillars of CDP, intricately are woven into each phase of the research process, from conceptualization to dissemination, promoting an egalitarian approach that values participant empowerment and ethical considerations. After discussing the fundamentals of mixed methods research-based philosophies and addressing their respective assumptions and stances, we address how CDP redefines traditional roles within research by engaging participants as co-researchers and transforming researchers into facilitators, thereby democratizing the research process, enriching the data collection and analysis stages, and ensuring that findings are both methodologically robust and culturally pertinent. Through its application in various research settings, CDP has demonstrated significant contributions to the fields of psychology, education, health, and social sciences, among others. It has enabled researchers to tackle complex and multifaceted issues by employing mixed methods research approaches grounded in ethical practices and aimed at fostering positive social change. Therefore, CDP stands out as a critical framework for contemporary research endeavors that seek to transcend traditional academic boundaries and to make a tangible impact on society. This article highlights the pivotal role of CDP in advancing mixed methods research and underscores its potential for shaping future research paradigms/philosophies.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100178"},"PeriodicalIF":0.0,"publicationDate":"2025-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143549932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The role of sampling in an explanatory sequential mixed methods study: General applications of the transformative paradigm","authors":"Tashane K. Haynes-Brown","doi":"10.1016/j.metip.2025.100176","DOIUrl":"10.1016/j.metip.2025.100176","url":null,"abstract":"<div><div>The purpose of this article is to illustrate how considerations from the transformative paradigm were integrated broadly in the sampling decisions in an explanatory sequential mixed methods study. The study sought to explore the complex relationship between teachers’ beliefs and classroom practices. Data were collected from 248 teachers using a questionnaire, semi-structured interviews, lesson observations, an observation checklist, video recordings and video elicitation interviews. By employing transformative considerations generally in making the sampling decisions a more rigorous and transparent sampling design emerged that yielded more comprehensive inferences. This article contributes to mixed methods research by providing a practical example and analytical insights into how the principles of the transformative paradigm can be applied broadly in the sampling design.</div></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"12 ","pages":"Article 100176"},"PeriodicalIF":0.0,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143174669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}