Testing importance weighting: Lessons from the quality of life literature

Abstract

Abstract Marsh and Scalas (2018) proposed a taxonomic structural equation modelling approach to test the individually importance weighted‐average models (IWAMs) in their article published in Structural Equation Modeling: A Multidisciplinary Journal 25 : 137–158. As Marsh and Scalas (2018) pointed out, IWAMs could be found in many research areas, including self‐concept, job satisfaction and quality of life (QOL) research. Based on the findings of their proposed approach, Marsh and Scalas (2018) argued that importance weights do not make a difference. The purpose of this paper is to assess the applicability of the approach developed by Marsh and Scalas (2018) and their conclusion that importance weights do not make a difference in the area of QOL, specifically subjective well‐being, research. In the research area of QOL, IWAMs have been discussed often under the topic of domain importance weighting. Findings from an analysis of the Panel Study of Income Dynamics’ Wellbeing and Daily Life Supplement data show that different domain importance weighting methods, based on different underlying (within‐domain vs between/across‐domain) perspectives, produced different results leading to different conclusions. Although the approach for testing IWAMs developed by Marsh and Scalas (2018) offered several methodological advances and strengths, its applicability to the evaluation of domain importance weighting in QOL studies is limited by its underlying (within‐domain) perspective, its assumption that domain importance can be accurately and precisely measured, and the possibility of the small effect size of domain importance. Marsh and Scalas’ (2018) findings that importance weights do not make a difference should be interpreted with caution.