Rabab Mukred , Anusha Kassan , Maryam Qureshi , José F. Domene , Tanya Mudry
{"title":"Weaving many threads: Reflections on data analysis and rigour in arts-based engagement ethnography","authors":"Rabab Mukred , Anusha Kassan , Maryam Qureshi , José F. Domene , Tanya Mudry","doi":"10.1016/j.metip.2024.100138","DOIUrl":"https://doi.org/10.1016/j.metip.2024.100138","url":null,"abstract":"<div><p>This paper explores the value of Arts Based Engagement Ethnography (ABEE) when working with people from vulnerable or minoritized communities. ABEE is situated at the juncture of social justice theory, arts-based methods, and critical ethnography. Through a worked example of a study with newcomer youth, we demonstrate how artistic probes, interviews, and group discussions can be combined in a rich multimodal analysis. In addition, we bring attention to aspects of rigour and ethics throughout the analysis. We conclude by reflecting on our process of maintaining rigour, and invite readers into contending with questions of rigour that we encountered.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"10 ","pages":"Article 100138"},"PeriodicalIF":0.0,"publicationDate":"2024-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2590260124000043/pdfft?md5=7ce41b78ed3703bbc6a35e21b8f7f486&pid=1-s2.0-S2590260124000043-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140191436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Combining collaging, phenomenology and photographs to meaningfully interact with participants’ creative self-representations","authors":"William Day, Michael Larkin, Rachel Shaw","doi":"10.1016/j.metip.2024.100135","DOIUrl":"https://doi.org/10.1016/j.metip.2024.100135","url":null,"abstract":"<div><p>This study advances the integration of creative and visual methods within phenomenological psychology research. Photovoice is a common visual research methodology used in health research. In studies that combine photovoice with Interpretative Phenomenological Analysis, images often only serve to illustrate the analysis of the interview data, despite being powerful illustrations of participants capturing their altered ways of being-in-the-world. As researchers, how can we engage more meaningfully with participants' self-representations?</p><p>This paper explores the analysis of visual materials created by participants by treating their photographs as interpretable data, separate from their interview data. Further innovations are present in the communication of qualitative findings. In a continued commitment to the visual, analytical findings are shown through collages of participants’ photographs. These novel approaches are demonstrated through an exploration of how participants employ photographs to depict their day-to-day experiences of living with 'unseen' chronic health conditions whilst navigating UK health-based welfare systems. Collaging is used within a phenomenological analysis to visually illustrate the features of these experiences.</p><p>While delving into the differing ways of understanding made possible through creative methods, we argue that visual displays of analyses offer new avenues for demonstrating and creating impact in qualitative research.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"10 ","pages":"Article 100135"},"PeriodicalIF":0.0,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2590260124000018/pdfft?md5=c80e7774771d3ae1d17cfea6ea7df89b&pid=1-s2.0-S2590260124000018-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140052822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christine V. Wood , Ida Salusky , Remi F. Jones , Robin Remich , Anne E. Caliendo , Richard McGee
{"title":"Using longitudinal qualitative research to understand the experiences of minoritized people","authors":"Christine V. Wood , Ida Salusky , Remi F. Jones , Robin Remich , Anne E. Caliendo , Richard McGee","doi":"10.1016/j.metip.2023.100130","DOIUrl":"https://doi.org/10.1016/j.metip.2023.100130","url":null,"abstract":"<div><p>This paper demonstrates how Longitudinal Qualitative Research (LQR) is an innovative method to understand the lived experiences of members of minoritized groups when temporality is a structuring element of their experiences. Most qualitative research in psychology is cross-sectional, which limits our understanding of individuals whose experiences are context-dependent and linked to the temporal norms of specific social environments. LQR is unique for allowing researchers to compare change and stability over time and reveal how social challenges and barriers impact perspective shifts and long-term decision-making. To demonstrate the usefulness of LQR as an inclusive methodology, we discuss an ongoing study of career decision-making among a diverse cohort of biomedical scientists. We have used annual interviews to follow biomedical science trainees from the beginning of their PhD into the initial stages of their careers. We present case studies of minoritized scientists to illustrate the methods for long-term engagement used to elicit sensitive and critical information during their training. We show how LQR is a viable methodology for a variety of research questions and can be accomplished using large or small sample sizes and limited resources. Our primary goal is to show how LQR is useful to understand the experiences of minoritized individuals in contexts that have historically excluded them.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"10 ","pages":"Article 100130"},"PeriodicalIF":0.0,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2590260123000218/pdfft?md5=0344f7b5a9c311b65495788178bc32fd&pid=1-s2.0-S2590260123000218-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138678486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Applying qualitative youth and adult perspectives to investigate quantitative survey components with a novel “crosswalk” analysis","authors":"Isabella Fante, Colette Daiute","doi":"10.1016/j.metip.2023.100121","DOIUrl":"https://doi.org/10.1016/j.metip.2023.100121","url":null,"abstract":"<div><p>This paper presents an innovative qualitative “crosswalk” analysis that extends sociocultural narrative theory and method to evaluate data obtained from survey measures in a mixed methods approach. This offers a unique method, centered within an activity-meaning system, to apply qualitative narrative analytic techniques to questions posed by quantitative survey measures, coding survey questions by using values that emerged from participants’ narratives of experience. In this way, this novel technique allows for interpretation of surveys via a lens that privileges participant-generated qualitative data. This research is situated in a broader study that sought to examine the intersection of social-emotional learning and school climate constructs in lived experiences. Results of this analysis extend the complexity of relational understandings of human development by including surveys as institutional narratives, with theoretical and methodological implications for future research.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100121"},"PeriodicalIF":0.0,"publicationDate":"2023-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49799984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Applying qualitative youth and adult perspectives to investigate quantitative survey components with a novel “crosswalk” analysis","authors":"Isabella Fante, C. Daiute","doi":"10.1016/j.metip.2023.100121","DOIUrl":"https://doi.org/10.1016/j.metip.2023.100121","url":null,"abstract":"","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54827893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Use and misuse of corrections for multiple testing","authors":"Miguel A. García-Pérez","doi":"10.1016/j.metip.2023.100120","DOIUrl":"10.1016/j.metip.2023.100120","url":null,"abstract":"<div><p>Current psychological research addresses multifaceted questions demanding multiple analyses of data. Statistical analyses regarded as instances of multiple testing are often subjected to alpha adjustments to guard against inflation of Type-I errors. A review of papers published in the last two years in two major psychology journals shows inconsistent and discretionary use of alpha adjustments in a broad diversity of statistical analyses that are formally identical across papers. Authoritative sources also do not clarify the circumstances in which alpha adjustments should or should not be used. This paper describes the workings of Bonferroni and false-discovery-rate adjustments, showing that they only control the Type-I error rate for an (omnibus) hypothesis stating that all its individual (surrogate) nulls are true. For individual nulls, alpha adjustment only has the trivial consequences of the use of a lower alpha level, without reducing the occurrence of Type-I errors or Type-II errors below their expected rates. In practice, then, corrections for multiple testing only come down to testing individual hypotheses at a lower alpha level without preventing the rejection of true nulls and without favoring the rejection of false nulls. Thus, use of alpha adjustments is only justifiable for inferences about an omnibus null for which a one-shot statistical test does not exist and which must instead be tested piecewise via several surrogates that collectively speak about the omnibus null. Recommendations for the use and reporting of alpha adjustments are given for a variety of statistical analyses with which they are often implemented.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100120"},"PeriodicalIF":0.0,"publicationDate":"2023-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46464311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
F.L. Truijens , M.M. De Smet , M. Vandevoorde , M. Desmet , R. Meganck
{"title":"What is it like to be the object of research? On meaning making in self-report measurement and validity of data in psychotherapy research","authors":"F.L. Truijens , M.M. De Smet , M. Vandevoorde , M. Desmet , R. Meganck","doi":"10.1016/j.metip.2023.100118","DOIUrl":"10.1016/j.metip.2023.100118","url":null,"abstract":"<div><p>In this paper, we argue (1) that self-report measurement is meaningful. ‘John’, a patient-participant in psychotherapy research, is presented to illustrate meaning-making processes in self-report measurement. We show that neglecting individual scoring processes might lead to invalidation of data. Therefore, (2) we argue that it is vital to actively validate data collected by validated measures. As numerical data themselves do not ‘show’ whether they are valid, the story of data collection must be taken into account. Therefore, we argue that mixing qualitative and quantitative methods is necessary for <em>meaningful measurement</em>, which is paramount to progress in psychological science and practice.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100118"},"PeriodicalIF":0.0,"publicationDate":"2023-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47461063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas E. Malloy , Charles F. Bond Jr. , Sarit Pery , Avraham N. Kluger
{"title":"Key person designs: Logic and statistical modeling","authors":"Thomas E. Malloy , Charles F. Bond Jr. , Sarit Pery , Avraham N. Kluger","doi":"10.1016/j.metip.2023.100119","DOIUrl":"10.1016/j.metip.2023.100119","url":null,"abstract":"<div><p>A key person (KP) is an individual embedded in dyadic relationships in the core groups of life. Introduced are three research designs: the nomothetic, idiographic, and fixed-role Key Person Designs (KPD). Leveraging social relations modeling (SRM) of dyadic data, we introduce hypotheses and statistical methods for testing them with KPD. We developed a Monte Carlo simulation to determine if a KP is, in fact, statistically unusual vis-à-vis nonspecial others. We provide an empirical example. Hypotheses specified and modeling of KPD data are very general, and we discuss implications for inclusive methodology.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100119"},"PeriodicalIF":0.0,"publicationDate":"2023-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45005065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kristin L.K. Koskey , Toni A. May , Yiyun “Kate” Fan , Dara Bright , Gregory Stone , Gabriel Matney , Jonathan D. Bostic
{"title":"Flip it: An exploratory (versus explanatory) sequential mixed methods design using Delphi and differential item functioning to evaluate item bias","authors":"Kristin L.K. Koskey , Toni A. May , Yiyun “Kate” Fan , Dara Bright , Gregory Stone , Gabriel Matney , Jonathan D. Bostic","doi":"10.1016/j.metip.2023.100117","DOIUrl":"10.1016/j.metip.2023.100117","url":null,"abstract":"<div><p>The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicating <em>potential</em> item bias. Use of Delphi <em>before</em> quantitative field testing to screen for potential sources leading to item bias is lacking in the literature. An exploratory sequential design is illustrated as an additional approach using a Delphi technique in Phase I and Rasch DIF analyses in Phase II. We introduce the 2 × 2 Concordance Integration Typology as a systematic way to examine agreement and disagreement across the qualitative and quantitative findings using a concordance joint display table. A worked example from the development of the Problem-Solving Measures Grades 6–8 Computer Adaptive Tests supported using an exploratory sequential design to inform item refinement. The 2 × 2 Concordance Integration Typology (a) crystallized instances where additional refinements were potentially needed and (b) provided for evaluating the distribution of bias across the set of items as a whole. Implications are discussed for advancing data integration techniques and using mixed methods to improve instrument development.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100117"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46036153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A software feature for mixed methods analysis: The MAXQDA Interactive Quote Matrix","authors":"Timothy C. Guetterman, Tyler G. James","doi":"10.1016/j.metip.2023.100116","DOIUrl":"10.1016/j.metip.2023.100116","url":null,"abstract":"<div><p>Mixed methods research relies on the integration of quantitative and qualitative data to develop meta-inferences. Despite an increase in techniques to facilitate integration at the methods and reporting levels, there is less practical guidance on how to conduct mixed methods integrative data analysis. Qualitative data analysis software is rapidly advancing to facilitate integrative analysis in mixed methods research studies. However, examples on how these features support analysis are relatively limited. The purpose of this article is to promote the use of qualitative data analysis software for integrative analysis in mixed methods research by describing the value of the major features available in software (i.e., code queries, crosstabulations, and quote matrices). In addition to a brief overview of these features, this article demonstrates the use of MAXQDA's Interactive Quote Matrix with a real-life example of a completed mixed methods study and delineates the step-by-step process on how to use this feature to develop meta-inferences.</p></div>","PeriodicalId":93338,"journal":{"name":"Methods in Psychology (Online)","volume":"8 ","pages":"Article 100116"},"PeriodicalIF":0.0,"publicationDate":"2023-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45863789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}