J. Schüler, B. Anderson, Charles Y. Murnieks, Matthias Baum, A. Küsshauer
{"title":"Test-Retest Reliability in Metric Conjoint Experiments: A New Workflow to Evaluate Confidence in Model Results","authors":"J. Schüler, B. Anderson, Charles Y. Murnieks, Matthias Baum, A. Küsshauer","doi":"10.1177/10422587231184071","DOIUrl":null,"url":null,"abstract":"Metric conjoint studies are a popular research design in the entrepreneurship domain. For these studies, test-retest reliabilities of ρ > .70 or higher are an often-cited reliability criterion. Despite their widespread use, however, there is little rigorous analysis of whether test-retest reliability in metric conjoint studies relates to model efficacy. Informed by a systematic literature review, we conducted two Monte Carlo simulations to evaluate the effects of various determinants of test-retest reliability in conjoint experiments. We then illustrate a workflow for entrepreneurship researchers employing conjoint designs to better evaluate—and communicate—confidence in statistical models estimated from conjoint data.","PeriodicalId":48443,"journal":{"name":"Entrepreneurship Theory and Practice","volume":"75 1","pages":""},"PeriodicalIF":7.8000,"publicationDate":"2023-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Entrepreneurship Theory and Practice","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1177/10422587231184071","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BUSINESS","Score":null,"Total":0}
引用次数: 0
Abstract
Metric conjoint studies are a popular research design in the entrepreneurship domain. For these studies, test-retest reliabilities of ρ > .70 or higher are an often-cited reliability criterion. Despite their widespread use, however, there is little rigorous analysis of whether test-retest reliability in metric conjoint studies relates to model efficacy. Informed by a systematic literature review, we conducted two Monte Carlo simulations to evaluate the effects of various determinants of test-retest reliability in conjoint experiments. We then illustrate a workflow for entrepreneurship researchers employing conjoint designs to better evaluate—and communicate—confidence in statistical models estimated from conjoint data.
期刊介绍:
Entrepreneurship Theory and Practice (ETP) is an interdisciplinary scholarly journal dedicated to conceptual and empirical research that advances, tests, or extends theory relating to entrepreneurship in its broadest sense.
Article Topics:
Topics covered in ETP include, but are not limited to:
New Venture Creation, Development, Growth, and Performance
Characteristics, Behaviors, and Types of Entrepreneurs
Small Business Management
Family-Owned Businesses
Corporate, Social, and Sustainable Entrepreneurship
National and International Studies of Enterprise Creation
Research Methods in Entrepreneurship
Venture Financing
Content:
The journal publishes articles that explore these topics through rigorous theoretical development, empirical analysis, and methodological innovation. ETP serves as a platform for advancing our understanding of entrepreneurship and its implications for individuals, organizations, and society.