Juan M. Madera , Christiane Spitzmueller , Heyao Yu , Ebenezer Edema-Sillo , Mark S.F. Clarke
{"title":"学术晋升和终身教职决定中的外部评审书反映了评审人的特点","authors":"Juan M. Madera , Christiane Spitzmueller , Heyao Yu , Ebenezer Edema-Sillo , Mark S.F. Clarke","doi":"10.1016/j.respol.2023.104939","DOIUrl":null,"url":null,"abstract":"<div><p>We examine validity and bias in external review letters (ERLs) in academic settings. ERLs play a critical role in promotion and tenure (P&T) decisions across the globe, ending careers in some cases while allowing other scientists' careers to flourish. We coded and analyzed 995 ERLs submitted by letter writers at various institutions as part of the P&T portfolios of 195 candidates at an R1 university. We examined their relationship with P&T committees' percent of positive votes by department, college, and university committees. We investigated how ERL linguistic features, letter writer characteristics, and candidate characteristics (productivity and gender) relate to P&T decision-making. Results show writer characteristics are more strongly related than candidate characteristics to ERL linguistic features associated with P&T decisions at the department and university levels. We develop recommendations for policymakers, including changes in the use of ERLs for the P&T process.</p></div>","PeriodicalId":48466,"journal":{"name":"Research Policy","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"External review letters in academic promotion and tenure decisions are reflective of reviewer characteristics\",\"authors\":\"Juan M. Madera , Christiane Spitzmueller , Heyao Yu , Ebenezer Edema-Sillo , Mark S.F. Clarke\",\"doi\":\"10.1016/j.respol.2023.104939\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>We examine validity and bias in external review letters (ERLs) in academic settings. ERLs play a critical role in promotion and tenure (P&T) decisions across the globe, ending careers in some cases while allowing other scientists' careers to flourish. We coded and analyzed 995 ERLs submitted by letter writers at various institutions as part of the P&T portfolios of 195 candidates at an R1 university. We examined their relationship with P&T committees' percent of positive votes by department, college, and university committees. We investigated how ERL linguistic features, letter writer characteristics, and candidate characteristics (productivity and gender) relate to P&T decision-making. Results show writer characteristics are more strongly related than candidate characteristics to ERL linguistic features associated with P&T decisions at the department and university levels. We develop recommendations for policymakers, including changes in the use of ERLs for the P&T process.</p></div>\",\"PeriodicalId\":48466,\"journal\":{\"name\":\"Research Policy\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2023-12-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research Policy\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0048733323002238\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Policy","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0048733323002238","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
External review letters in academic promotion and tenure decisions are reflective of reviewer characteristics
We examine validity and bias in external review letters (ERLs) in academic settings. ERLs play a critical role in promotion and tenure (P&T) decisions across the globe, ending careers in some cases while allowing other scientists' careers to flourish. We coded and analyzed 995 ERLs submitted by letter writers at various institutions as part of the P&T portfolios of 195 candidates at an R1 university. We examined their relationship with P&T committees' percent of positive votes by department, college, and university committees. We investigated how ERL linguistic features, letter writer characteristics, and candidate characteristics (productivity and gender) relate to P&T decision-making. Results show writer characteristics are more strongly related than candidate characteristics to ERL linguistic features associated with P&T decisions at the department and university levels. We develop recommendations for policymakers, including changes in the use of ERLs for the P&T process.
期刊介绍:
Research Policy (RP) articles explore the interaction between innovation, technology, or research, and economic, social, political, and organizational processes, both empirically and theoretically. All RP papers are expected to provide insights with implications for policy or management.
Research Policy (RP) is a multidisciplinary journal focused on analyzing, understanding, and effectively addressing the challenges posed by innovation, technology, R&D, and science. This includes activities related to knowledge creation, diffusion, acquisition, and exploitation in the form of new or improved products, processes, or services, across economic, policy, management, organizational, and environmental dimensions.