Organizational Research Methods最新文献_第2页

Simulating Virtual Organizations for Research: A Comparative Empirical Evaluation of Text-Based, Video, and Virtual Reality Video Vignettes 为研究模拟虚拟组织：基于文本、视频和虚拟现实视频小故事的比较实证评估

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2024-04-17 DOI: 10.1177/10944281241246770

Anand P. A. van Zelderen, Theodore C. Masters-Waage, Nicky Dries, Jochen I. Menges, Diana R. Sanchez

{"title":"Simulating Virtual Organizations for Research: A Comparative Empirical Evaluation of Text-Based, Video, and Virtual Reality Video Vignettes","authors":"Anand P. A. van Zelderen, Theodore C. Masters-Waage, Nicky Dries, Jochen I. Menges, Diana R. Sanchez","doi":"10.1177/10944281241246770","DOIUrl":"https://doi.org/10.1177/10944281241246770","url":null,"abstract":"Due to recent technological developments, vignette studies that have traditionally been done in text or video formats can now be done in immersive formats using virtual reality—but are such virtual reality video vignettes superior to traditional vignettes? To address this question, we examine participants’ experiences within a fictitious organization by comparing their responses to a relevant and particularly sensitive organizational phenomenon presented either through written text, a video recording, or a virtual reality experience. The results indicate that participants prefer more immersive methods, and that these increase their attention to critical study details. Moreover, this augments the effect sizes of several measured employee reactions—particularly those with high emotional content—suggesting that virtual reality technology offers a promising avenue for developing ecologically valid vignette studies to measure employee affect. To facilitate and expediate the use of virtual reality video vignettes in organizational research, we provide organizational scholars with a step-by-step instructional guide to develop immersive vignette studies.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"78 1","pages":""},"PeriodicalIF":9.5,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140608136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments 在多维强制选择测评中检测主效应和交互式 DIF 的框架

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2024-04-13 DOI: 10.1177/10944281241244760

Kai Liu, Yi Zheng, Daxun Wang, Yan Cai, Yuanyuan Shi, Chongqin Xi, Dongbo Tu

{"title":"A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments","authors":"Kai Liu, Yi Zheng, Daxun Wang, Yan Cai, Yuanyuan Shi, Chongqin Xi, Dongbo Tu","doi":"10.1177/10944281241244760","DOIUrl":"https://doi.org/10.1177/10944281241244760","url":null,"abstract":"In recent decades, multidimensional forced-choice (MFC) tests have gained widespread popularity in organizational settings due to their effectiveness in reducing response biases. Detecting differential item functioning (DIF) is crucial in developing MFC tests, as it relates to test fairness and validity. However, existing methods appear insufficient for detecting DIF induced by the interaction between multiple covariates. Furthermore, for multi-category, ordered or continuous covariates, existing approaches often dichotomize them using a-priori cutoffs, commonly using the median of the covariates. This may lead to information loss and reduced power in detecting MFC DIF. To address these limitations, we propose a method to identify both main effect DIF and interactive DIF. This method can automatically search for the optimal cutoffs for ordered or continuous covariates without pre-defined cutoffs. We introduce the rationale behind the proposed method and evaluate its performance through three Monte Carlo simulation studies. Results demonstrate that the proposed method effectively identifies various DIF forms in MFC tests, thereby increasing detection power. Finally, we provide an empirical application to illustrate the practical applicability of the proposed method.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"9 1","pages":""},"PeriodicalIF":9.5,"publicationDate":"2024-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140551921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

From Textual Data to Theoretical Insights: Introducing and Applying the Word-Text-Topic Extraction Approach 从文本数据到理论见解：单词-文本-主题提取方法的介绍和应用

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2024-01-31 DOI: 10.1177/10944281241228186

Jaewoo Jung, Wenjun Zhou, Anne D. Smith

{"title":"From Textual Data to Theoretical Insights: Introducing and Applying the Word-Text-Topic Extraction Approach","authors":"Jaewoo Jung, Wenjun Zhou, Anne D. Smith","doi":"10.1177/10944281241228186","DOIUrl":"https://doi.org/10.1177/10944281241228186","url":null,"abstract":"Text analysis, particularly custom dictionaries and topic modeling, has helped advance management and organization theory. Custom dictionaries involve creating word lists to quantify patterns and infer constructs, while topic modeling extracts themes from textual documents to help understand a theoretical domain. Building on these two approaches, we propose another text analysis approach called word-text-topic extraction (WTT), which enhances the efficiency and relevance of text analysis for the sake of theoretical advancement. Specifically, we first identify relevant words for a researcher's theoretical area of interest using word-embedding algorithms. That step is followed by extracting text segments from the textual corpus using a collocation process. Finally, topic modeling is applied to capture themes relevant to the specific theoretical area of interest. To illustrate the WTT approach, we explored one research area needing further theory development—innovation. Using 841 CEOs’ letters to shareholders, we found that our WTT approach provides nuanced features of innovation that differ across industry contexts. We guide researchers on decisions and considerations related to the WTT approach in order to facilitate its use in future studies.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"99 1","pages":""},"PeriodicalIF":9.5,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139938974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews 五是最亮的星。但有多亮？测试在线评论中星级评定的等距性

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2024-01-08 DOI: 10.1177/10944281231223412

Balázs Kovács

{"title":"Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews","authors":"Balázs Kovács","doi":"10.1177/10944281231223412","DOIUrl":"https://doi.org/10.1177/10944281231223412","url":null,"abstract":"Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics, ratings are implicitly assumed to be equidistant. We test whether star ratings are equidistant using reviews from two large-scale online review platforms: Amazon.com and Yelp.com. We develop a deep learning framework to analyze the text of the reviews in order to assess their overall valuation. We find that 4 and 5-star ratings, as well as 1 and 2-star ratings, are closer to each other than 3-star ratings are to 2 and 4-star ratings. An additional online experiment corroborates this pattern. Using simulations, we show that the distortion by non-equidistant ratings is especially harmful in cases when organizations receive only a few reviews and when researchers are interested in estimating variance effects. We discuss potential solutions to solve the issue with rating non-equidistance.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"22 12","pages":""},"PeriodicalIF":9.5,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139446588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The VIF Score. What is it Good For? Absolutely Nothing VIF 分数。有什么用？没什么用

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2023-12-13 DOI: 10.1177/10944281231216381

Arturs Kalnins, Kendall Praitis Hill

{"title":"The VIF Score. What is it Good For? Absolutely Nothing","authors":"Arturs Kalnins, Kendall Praitis Hill","doi":"10.1177/10944281231216381","DOIUrl":"https://doi.org/10.1177/10944281231216381","url":null,"abstract":"Variance inflation factors (VIF scores) are regression diagnostics commonly invoked throughout the social sciences. Researchers typically take the perspective that VIF scores below a numerical rule-of-thumb threshold act as a “silver bullet” to dismiss any and all multicollinearity concerns. Yet, no valid logical basis exists for using VIF thresholds to reject the possibility of multicollinearity-induced type 1 errors. Reporting VIF scores below a threshold does not in any way add to the credibility of statistically significant results among correlated variables. In contrast to this “threshold perspective,” our analysis expands the scope of a perspective that has considered multicollinearity and misspecification. We demonstrate analytically that a regression omitting a relevant variable correlated with included variables that exhibit multicollinearity is susceptible to endogeneity-induced bias inflation and beta polarization, leading to the possible co-existence of type 1 errors and low VIF scores. Further, omitting variables explicitly reduces VIF scores. We conclude that the threshold perspective not only lacks any logical basis but also is fundamentally misleading as a rule-of-thumb. Instrumental variables represent one clear remedy for endogeneity-induced bias inflation. If exogenous instruments are unavailable, we encourage researchers to test only straightforward, unambiguous theory when using variables that exhibit multicollinearity, and to ensure that correlated co-variates exhibit the expected signs.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 4","pages":""},"PeriodicalIF":9.5,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139005307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Qualitative Restudies: Research Designs for Retheorizing 定性再研究：重新理论化的研究设计

IF 9.5 2区管理学

Organizational Research Methods Pub Date : 2023-12-03 DOI: 10.1177/10944281231216323

T. Köhler, Maria N. Rumyantseva, Catherine Welch

{"title":"Qualitative Restudies: Research Designs for Retheorizing","authors":"T. Köhler, Maria N. Rumyantseva, Catherine Welch","doi":"10.1177/10944281231216323","DOIUrl":"https://doi.org/10.1177/10944281231216323","url":null,"abstract":"Qualitative research methods are deemed best suited to exploring novel phenomena and generating new concepts. Their potential to reevaluate existing theorizing, however, is underestimated. Qualitative restudies that return to the data and settings on which the original theories were built are a well-established tradition in other disciplines (e.g., history, sociology, and anthropology), but have received little recognition in management and organization studies. We introduce qualitative restudies as a powerful means to improve theorizing by revising or challenging theories that have become outdated or obsolete and establishing transferability and longevity of findings and interpretations. We provide a typology of qualitative restudy designs drawing on an integrative review of literature in management, strategy, and the social sciences and humanities. We highlight the main design and ethical considerations for researchers in undertaking a restudy. We argue for the strengths of restudies as lying in their possibilities for retheorizing, above and beyond verifying or updating prior studies. Restudies draw on the strengths of in-depth qualitative work to uncover how interpretations and theorizing are shaped by methodological traditions, historical contexts, existing societal structures, and researcher backgrounds.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"36 23","pages":""},"PeriodicalIF":9.5,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138605211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections 基于向量空间的大型文本集意义相关性和多维度度量方法

2区管理学

Organizational Research Methods Pub Date : 2023-11-13 DOI: 10.1177/10944281231213068

Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn

{"title":"A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections","authors":"Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn","doi":"10.1177/10944281231213068","DOIUrl":"https://doi.org/10.1177/10944281231213068","url":null,"abstract":"In this article, we develop a methodological approach for organizational research regarding the construction of multidimensional and relational similarity measures by using the vector space model in natural language processing (NLP). Our vector space approach draws on the well-established premise in organizational research that texts provide a window into social reality and allow measuring theory-based constructs ( e.g., organizations’ self-representations). Using a vector space approach allows capturing the multidimensionality of these theory-based constructs and computing relational similarities between organizational entities ( e.g., organizations, their members, and subunits) in social spaces and with their environments, such as the organization itself, industries, or countries. Thus, our methodological approach contributes to the recent trend in organizational research to use the potential inherent in big (textual) data by using NLP. In an example, we provide guidance for organizational scholars by illustrating how they can ensure validity when applying our methodological contribution in concrete research practice.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"131 17","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136351297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using Quotes to Present Claims: Practices for the Writing Stages of Qualitative Research 使用引用来表达主张:定性研究写作阶段的实践

2区管理学

Organizational Research Methods Pub Date : 2023-11-09 DOI: 10.1177/10944281231210558

Kevin W. Rockmann, Heather C. Vough

引用次数: 0

Publishing Registered Reports in Management and Applied Psychology: Common Beliefs and Best Practices 出版注册报告管理和应用心理学:共同信念和最佳实践

2区管理学

Organizational Research Methods Pub Date : 2023-11-07 DOI: 10.1177/10944281231210309

Roman Briker, Fabiola H. Gerpott

{"title":"Publishing Registered Reports in Management and Applied Psychology: Common Beliefs and Best Practices","authors":"Roman Briker, Fabiola H. Gerpott","doi":"10.1177/10944281231210309","DOIUrl":"https://doi.org/10.1177/10944281231210309","url":null,"abstract":"Management and applied psychology scholars are confronted with a crisis undermining trust in their findings. One solution to this crisis is the publication format Registered Reports (RRs). Here, authors submit the frontend of their paper for peer review before data collection. While this format can help increase the trustworthiness of research, authors’ usage of RRs—although emerging—has been scarce and scattered. Eventually, common beliefs regarding the (dis)advantages of RRs and a lack of best practices can limit the broad implementation of this approach. To address these issues, we utilized a systematic review process to identify 50 RRs in management and applied psychology and surveyed authors with ( N = 86) and without experience ( N = 161) in publishing RRs and reviewers/editors who have handled RRs ( N = 59). On this basis, we (a) scrutinize prevalent beliefs surrounding the RR format in the fields of management and applied psychology and (b) derive hands-on best practices. In sum, we provide a fact check and guidelines for authors interested in writing RRs, which can also be used by reviewers to evaluate such submissions.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135480381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

The Generalized Thurstonian Unfolding Model (GTUM): Advancing the Modeling of Forced-Choice Data 广义瑟斯顿展开模型(GTUM):推进强迫选择数据的建模

2区管理学

Organizational Research Methods Pub Date : 2023-11-01 DOI: 10.1177/10944281231210481

Bo Zhang, Naidan Tu, Lawrence Angrave, Susu Zhang, Tianjun Sun, Louis Tay, Jian Li

{"title":"The Generalized Thurstonian Unfolding Model (GTUM): Advancing the Modeling of Forced-Choice Data","authors":"Bo Zhang, Naidan Tu, Lawrence Angrave, Susu Zhang, Tianjun Sun, Louis Tay, Jian Li","doi":"10.1177/10944281231210481","DOIUrl":"https://doi.org/10.1177/10944281231210481","url":null,"abstract":"Forced-choice (FC) measurement has become increasingly popular due to its robustness to various response biases and reduced susceptibility to faking. Although several current Item Response Theory (IRT) models can extract normative person scores from FC responses, each has its limitations. This study proposes the Generalized Thurstonian Unfolding Model (GTUM) as a more flexible IRT model for FC measures to overcome these limitations. The GTUM (1) adheres to the unfolding response process, (2) accommodates FC scales of any block size, and (3) manages both dichotomous and graded responses. Monte Carlo simulation studies consistently demonstrated that the GTUM exhibited good statistical properties under most realistic conditions. Particularly noteworthy findings include (1) the GTUM's ability to handle FC scales with or without intermediate statements, (2) the consistently superior performance of graded responses over dichotomous responses in person score recovery, and (3) the sufficiency of 10 mixed pairs to ensure robust psychometric performance. Two empirical examples, one with 1,033 responses to a static version of the Tailored Adaptative Personality Assessment System and the other with 759 responses to a graded version of the Forced-Choice Five-Factor Markers, demonstrated the feasibility of the GTUM to handle different types of FC scales. To aid in the practical use of the GTUM, we also developed the R package “ fcscoring.”","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"29 9-10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135272455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0