J. Clarke, Nick Llewellyn, J. Cornelissen, R. Viney
{"title":"Gesture Analysis and Organizational Research: The Development and Application of a Protocol for Naturalistic Settings","authors":"J. Clarke, Nick Llewellyn, J. Cornelissen, R. Viney","doi":"10.1177/1094428119877450","DOIUrl":"https://doi.org/10.1177/1094428119877450","url":null,"abstract":"Gestures are an underresearched but potentially significant aspect of organizational conduct that is relevant to researchers across a range of theoretical and empirical domains. In engaging the cross-disciplinary field of gesture studies, we develop and apply a protocol for analyzing gestures produced in naturalistic settings during ongoing streams of talk and embodied activity. Analyzing video recordings of entrepreneurial investor pitches, we work through this protocol and demonstrate its usefulness. While doing so, we also explore methodological tensions in gesture studies and draw out methodological arguments as they relate to the analysis of these fleeting and often intricate bodily movements. The article contributes a generally applicable protocol for the analysis of gestures in naturalistic settings, and it assesses the methodological implications of this protocol both for research on entrepreneurship and new venture creation and management and organization research more generally.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 1","pages":"140 - 171"},"PeriodicalIF":9.5,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428119877450","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43387032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using Electronic Confederates for Experimental Research in Organizational Science","authors":"Keith Leavitt, Feng Qiu, Debra L. Shapiro","doi":"10.1177/1094428119889136","DOIUrl":"https://doi.org/10.1177/1094428119889136","url":null,"abstract":"Organizational scholars frequently rely on experiments using human confederates or descriptions of vignette characters to study a range of phenomena. Although experiments with confederates allow for realism and rigor, human confederates have several critical limitations. We present a novel and efficient alternative: the use of responsive electronic confederates for manipulating constructs in dyadic, group, and team contexts. Specifically, we (a) define electronic confederates in an organizational research context, identify their optimal qualities, and review studies that have used them; (b) discuss challenges of utilizing human confederates and how electronic confederates may address these; (c) identify boundary conditions around using electronic confederates and, within these conditions, identify the many types of inquiry that can be aided by electronic confederates; (d) discuss validation strategies for electronic confederates, while increasing their believability to study participants; (e) provide materials for two versions of an adaptable research platform involving electronic confederates; and (f) identify future opportunities for developing novel tools for behavioral research. Our article thus provides a toolkit for organizational researchers that empowers them to utilize electronic confederates in their own research.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 1","pages":"3 - 25"},"PeriodicalIF":9.5,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428119889136","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43778800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rethinking the Gold Standard With Multi-armed Bandits: Machine Learning Allocation Algorithms for Experiments","authors":"Chris Kaibel, Torsten Biemann","doi":"10.1177/1094428119854153","DOIUrl":"https://doi.org/10.1177/1094428119854153","url":null,"abstract":"In experiments, researchers commonly allocate subjects randomly and equally to the different treatment conditions before the experiment starts. While this approach is intuitive, it means that new information gathered during the experiment is not utilized until after the experiment has ended. Based on methodological approaches from other scientific disciplines such as computer science and medicine, we suggest machine learning algorithms for subject allocation in experiments. Specifically, we discuss a Bayesian multi-armed bandit algorithm for randomized controlled trials and use Monte Carlo simulations to compare its efficiency with randomized controlled trials that have a fixed and balanced subject allocation. Our findings indicate that a randomized allocation based on Bayesian multi-armed bandits is more efficient and ethical in most settings. We develop recommendations for researchers and discuss the limitations of our approach.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 1","pages":"78 - 103"},"PeriodicalIF":9.5,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428119854153","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41983757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Cortina, Hannah M. Markell-Goldstein, Jennifer P. Green, Yingyi Chang
{"title":"How Are We Testing Interactions in Latent Variable Models? Surging Forward or Fighting Shy?","authors":"J. Cortina, Hannah M. Markell-Goldstein, Jennifer P. Green, Yingyi Chang","doi":"10.1177/1094428119872531","DOIUrl":"https://doi.org/10.1177/1094428119872531","url":null,"abstract":"Latent variable models and interaction effects have both been common in the organizational sciences for some time. Methods for incorporating interactions into latent variable models have existed since at least Kenny and Judd, and a great many articles and books have developed these methods further. In the present article, we present an empirical review of the methods that organizational science investigators use to test their interaction hypotheses. We show that it is very common for investigators to use fully latent methods to test additive portions of their models, but to abandon such methods when testing the multiplicative portions of their models. By contrast, investigators whose models do not contain interactions tend to stick with fully latent methods throughout. As there is little rational basis for this pattern, it is likely due to continued discomfort regarding the proper application of existing fully latent methods. Thus, we end by offering R code that implements some of the more sophisticated fully latent approaches, and by offering a sequence of decisions that investigators can follow in order to choose the best analytic approach.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 1","pages":"26 - 54"},"PeriodicalIF":9.5,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428119872531","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42487641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Methodological Socialization and Identity: A Bricolage Study of Pathways Toward Qualitative Research in Doctoral Education","authors":"Sebnem Cilesiz, Thomas Greckhamer","doi":"10.1177/1094428120980047","DOIUrl":"https://doi.org/10.1177/1094428120980047","url":null,"abstract":"Trends toward convergence on common methodologies and standardized templates restrict the diversity of qualitative methods in organizational research. Considering that graduate education is a critical process in the socialization of researchers into the norms and dominant practices of their discipline, graduate students’ socialization into research methodologies is vital for understanding methodological convergence. The purpose of our study was to understand how graduate students’ socialization shapes their methodological and paradigmatic preferences. Showcasing methodological bricolage as an alternative to qualitative templates, we constructed a research design that combined thematic, discourse, and narrative analyses to investigate graduate students’ reflections throughout a qualitative methods course introducing alternative research paradigms. Our findings highlight the role of institutional, disciplinary, and personal influences as well as identity work in researchers’ socialization and trace alternative trajectories by which socialization and methodological identity construction processes may unfold. We offer a sketch of methodological socialization and suggest that its understanding should be central to nurturing paradigmatic and methodological plurality in qualitative research. We conclude with implications for future research and for research methods training.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"337 - 370"},"PeriodicalIF":9.5,"publicationDate":"2020-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120980047","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41650099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Corrigendum to Nonlinear Transformations in Organizational Research: Possible Problems and Potential Solutions","authors":"","doi":"10.1177/1094428120982699","DOIUrl":"https://doi.org/10.1177/1094428120982699","url":null,"abstract":"","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 1","pages":"484 - 484"},"PeriodicalIF":9.5,"publicationDate":"2020-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120982699","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45185625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Citation Context Analysis as a Method for Conducting Rigorous and Impactful Literature Reviews","authors":"Marc H. Anderson, Russell Lemken","doi":"10.1177/1094428120969905","DOIUrl":"https://doi.org/10.1177/1094428120969905","url":null,"abstract":"Citation context analysis is a detailed and rigorous form of literature review that goes beyond traditional narrative and systematic reviews to better understand the impact of seminal works and influential authors. We discuss the types of questions citation context analyses can answer and provide a set of guidelines for how to effectively conduct them. Citation context analysis holds promise for enabling a more systematic assessment of how theories are used, empirically tested, and critiqued by subsequent citing authors. This has implications for both theory development and testing, and for the improvement of citation practices within the field of organizational studies and the social and physical sciences more broadly.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"77 - 106"},"PeriodicalIF":9.5,"publicationDate":"2020-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120969905","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43865033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jacqueline Mees-Buss, Catherine Welch, R. Piekkari
{"title":"From Templates to Heuristics: How and Why to Move Beyond the Gioia Methodology","authors":"Jacqueline Mees-Buss, Catherine Welch, R. Piekkari","doi":"10.1177/1094428120967716","DOIUrl":"https://doi.org/10.1177/1094428120967716","url":null,"abstract":"Researchers are exposed to multiple interpretive challenges in the journey from field data to theoretical understanding. A common response to these challenges is to turn to the guidance of templates such as the Gioia methodology—currently a preferred template for interpretive management research. Given its popularity, we examine how this methodology approaches the interpretive process of fieldwork. We find that the inductive route to theory that it offers does not address the challenges of interpretation. As an alternative, we propose a return to the epistemological tradition of hermeneutics. We argue that fieldwork informed by a hermeneutic orientation is able to generate credible and novel theory by confronting the challenges of interpretation head on. This process cannot be represented by the orderly steps of a template. We argue that a return to a hermeneutic orientation opens the way to more plausible and insightful theories based on interpretive rather than procedural rigor, and we offer a set of heuristics to guide both researchers and reviewers along this path.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"405 - 429"},"PeriodicalIF":9.5,"publicationDate":"2020-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120967716","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48192384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Louis Hickman, Stuti Thapa, L. Tay, Mengyang Cao, P. Srinivasan
{"title":"Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations","authors":"Louis Hickman, Stuti Thapa, L. Tay, Mengyang Cao, P. Srinivasan","doi":"10.1177/1094428120971683","DOIUrl":"https://doi.org/10.1177/1094428120971683","url":null,"abstract":"Recent advances in text mining have provided new methods for capitalizing on the voluminous natural language text data created by organizations, their employees, and their customers. Although often overlooked, decisions made during text preprocessing affect whether the content and/or style of language are captured, the statistical power of subsequent analyses, and the validity of insights derived from text mining. Past methodological articles have described the general process of obtaining and analyzing text data, but recommendations for preprocessing text data were inconsistent. Furthermore, primary studies use and report different preprocessing techniques. To address this, we conduct two complementary reviews of computational linguistics and organizational text mining research to provide empirically grounded text preprocessing decision-making recommendations that account for the type of text mining conducted (i.e., open or closed vocabulary), the research question under investigation, and the data set’s characteristics (i.e., corpus size and average document length). Notably, deviations from these recommendations will be appropriate and, at times, necessary due to the unique characteristics of one’s text data. We also provide recommendations for reporting text mining to promote transparency and reproducibility.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"114 - 146"},"PeriodicalIF":9.5,"publicationDate":"2020-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120971683","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47377036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Updated Guideline for Assessing Discriminant Validity","authors":"Mikko Rönkkö, Eunseong Cho","doi":"10.1177/1094428120968614","DOIUrl":"https://doi.org/10.1177/1094428120968614","url":null,"abstract":"Discriminant validity was originally presented as a set of empirical criteria that can be assessed from multitrait-multimethod (MTMM) matrices. Because datasets used by applied researchers rarely lend themselves to MTMM analysis, the need to assess discriminant validity in empirical research has led to the introduction of numerous techniques, some of which have been introduced in an ad hoc manner and without rigorous methodological support. We review various definitions of and techniques for assessing discriminant validity and provide a generalized definition of discriminant validity based on the correlation between two measures after measurement error has been considered. We then review techniques that have been proposed for discriminant validity assessment, demonstrating some problems and equivalencies of these techniques that have gone unnoticed by prior research. After conducting Monte Carlo simulations that compare the techniques, we present techniques called CICFA(sys) and χ 2 (sys) that applied researchers can use to assess discriminant validity.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"6 - 14"},"PeriodicalIF":9.5,"publicationDate":"2020-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428120968614","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47529510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}