Examining the psychometric properties of the sport psychology professional quality of life scale using item response theory

IF 3.1 2区心理学 Q2 HOSPITALITY, LEISURE, SPORT & TOURISM

Psychology of Sport and Exercise Pub Date : 2025-04-19 DOI:10.1016/j.psychsport.2025.102862

Alessandro Quartiroli , Christopher R.D. Wagstaff , Daniel J. Brown

{"title":"Examining the psychometric properties of the sport psychology professional quality of life scale using item response theory","authors":"Alessandro Quartiroli , Christopher R.D. Wagstaff , Daniel J. Brown","doi":"10.1016/j.psychsport.2025.102862","DOIUrl":null,"url":null,"abstract":"<div><div>Recognizing the importance of the quality of the professional life for sport psychology professionals (SPPs), scholars have developed an initial conceptualization of Sport Psychology-Professional Quality of Life (SP-PQL), which encompass three main factors: the multifaceted nature of SP-PQL, the challenges hindering SP-PQL, and the strategies fostering SP-PQL. To assess this construct, Quartiroli and colleagues (2019) developed via a Delphi study a 42-item multi-dimensional measure. With the present study, we offer an initial examination of the psychometric characteristics of the SP-PQL measure. Cross-sectional survey data were gathered via an online survey from 614 sport psychology professionals (<em>n</em> = 527) and trainees (<em>n</em> = 79). The dataset was analyzed using a novel Item Response Theory approach. Specifically, using a multidimensional graded response model, we evaluated the overall performance of the three-factor SP-PQL measure and the item-response combinations. Our results showed inadequate model fit when evaluated using the M2 statistic and RMSEA, and we identified several poor functioning items as providing low discrimination or low information (<em>n</em> = 9), showing unintended loading (<em>n</em> = 1), or having poor threshold/response option utility (<em>n</em> = 2). After removing these items, the model was re-run to evaluate the impact of the alterations on model fit and total test information provided by the original and modified versions. The analysis suggested very little to no loss of information from the removal of items, and model fit statistics for the modified measure improved, albeit fit remained inadequate. Based on these results, we argue that further refinement of the SP-PQL measure is necessary for psychometric use in research, but that the measure may hold some utility for SPPs wanting to reflect on their PQL. Our analyses also demonstrate the value of using IRT approaches to evaluate the performance of individual items within psychometric measures.</div></div>","PeriodicalId":54536,"journal":{"name":"Psychology of Sport and Exercise","volume":"79 ","pages":"Article 102862"},"PeriodicalIF":3.1000,"publicationDate":"2025-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychology of Sport and Exercise","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1469029225000615","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HOSPITALITY, LEISURE, SPORT & TOURISM","Score":null,"Total":0}

引用次数: 0

Abstract

Recognizing the importance of the quality of the professional life for sport psychology professionals (SPPs), scholars have developed an initial conceptualization of Sport Psychology-Professional Quality of Life (SP-PQL), which encompass three main factors: the multifaceted nature of SP-PQL, the challenges hindering SP-PQL, and the strategies fostering SP-PQL. To assess this construct, Quartiroli and colleagues (2019) developed via a Delphi study a 42-item multi-dimensional measure. With the present study, we offer an initial examination of the psychometric characteristics of the SP-PQL measure. Cross-sectional survey data were gathered via an online survey from 614 sport psychology professionals (n = 527) and trainees (n = 79). The dataset was analyzed using a novel Item Response Theory approach. Specifically, using a multidimensional graded response model, we evaluated the overall performance of the three-factor SP-PQL measure and the item-response combinations. Our results showed inadequate model fit when evaluated using the M2 statistic and RMSEA, and we identified several poor functioning items as providing low discrimination or low information (n = 9), showing unintended loading (n = 1), or having poor threshold/response option utility (n = 2). After removing these items, the model was re-run to evaluate the impact of the alterations on model fit and total test information provided by the original and modified versions. The analysis suggested very little to no loss of information from the removal of items, and model fit statistics for the modified measure improved, albeit fit remained inadequate. Based on these results, we argue that further refinement of the SP-PQL measure is necessary for psychometric use in research, but that the measure may hold some utility for SPPs wanting to reflect on their PQL. Our analyses also demonstrate the value of using IRT approaches to evaluate the performance of individual items within psychometric measures.

查看原文本刊更多论文

运用项目反应理论考察运动心理学职业生活质量量表的心理测量特性

认识到职业生活质量对运动心理学专业人员（SPPs）的重要性，学者们初步提出了运动心理学-职业生活质量（SP-PQL）的概念，其中包括三个主要因素：SP-PQL的多面性、阻碍SP-PQL的挑战和促进SP-PQL的策略。为了评估这一结构，Quartiroli及其同事（2019）通过德尔菲研究开发了一个42项多维测量。在目前的研究中，我们提供了SP-PQL测量的心理测量特征的初步检查。横断面调查数据通过在线调查从614名运动心理学专业人员（n = 527）和受训人员（n = 79）中收集。使用一种新颖的项目反应理论方法对数据集进行分析。具体来说，我们使用一个多维的分级反应模型，评估了三因素SP-PQL测量和项目-反应组合的整体表现。当使用M2统计量和RMSEA进行评估时，我们的结果显示模型拟合不足，并且我们确定了几个功能差的项目，如提供低辨别或低信息（n = 9），显示意外加载（n = 1），或具有较差的阈值/响应选项效用（n = 2）。在删除这些项目后，重新运行模型以评估更改对模型拟合和原始版本和修改版本提供的总测试信息的影响。分析表明，删除项目几乎没有信息损失，并且改进措施的模型拟合统计数据有所改善，尽管拟合仍然不足。基于这些结果，我们认为进一步完善SP-PQL测量是必要的心理测量在研究中使用，但该措施可能持有一些实用的spp想要反映他们的PQL。我们的分析也证明了使用IRT方法在心理测量中评估单个项目表现的价值。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Psychology of Sport and Exercise 医学-心理学

CiteScore

6.40

自引率

5.90%

发文量

172

审稿时长

69 days

期刊介绍： Psychology of Sport and Exercise is an international forum for scholarly reports in the psychology of sport and exercise, broadly defined. The journal is open to the use of diverse methodological approaches. Manuscripts that will be considered for publication will present results from high quality empirical research, systematic reviews, meta-analyses, commentaries concerning already published PSE papers or topics of general interest for PSE readers, protocol papers for trials, and reports of professional practice (which will need to demonstrate academic rigour and go beyond mere description). The CONSORT guidelines consort-statement need to be followed for protocol papers for trials; authors should present a flow diagramme and attach with their cover letter the CONSORT checklist. For meta-analysis, the PRISMA prisma-statement guidelines should be followed; authors should present a flow diagramme and attach with their cover letter the PRISMA checklist. For systematic reviews it is recommended that the PRISMA guidelines are followed, although it is not compulsory. Authors interested in submitting replications of published studies need to contact the Editors-in-Chief before they start their replication. We are not interested in manuscripts that aim to test the psychometric properties of an existing scale from English to another language, unless new validation methods are used which address previously unanswered research questions.