D. Jackson, G. Michaelides, C. Dewberry, Benjamin Schwencke, S. Toms
{"title":"无混淆的多源性能评级的含义。","authors":"D. Jackson, G. Michaelides, C. Dewberry, Benjamin Schwencke, S. Toms","doi":"10.1037/apl0000434","DOIUrl":null,"url":null,"abstract":"The multifaceted structure of multisource job performance ratings has been a subject of research and debate for over 30 years. However, progress in the field has been hampered by the confounding of effects relevant to the measurement design of multisource ratings and, as a consequence, the impact of ratee-, rater-, source-, and dimension-related effects on the reliability of multisource ratings remains unclear. In separate samples obtained from 2 different applications and measurement designs (N₁ [ratees] = 392, N₁ [raters] = 1,495; N₂ [ratees] = 342, N₂ [raters] = 2,636), we, for the first time, unconfounded all systematic effects commonly cited as being relevant to multisource ratings using a Bayesian generalizability theory approach. Our results suggest that the main contributors to the reliability of multisource ratings are source-related and general performance effects that are independent of dimension-related effects. In light of our findings, we discuss the interpretation and application of multisource ratings in organizational contexts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).","PeriodicalId":169654,"journal":{"name":"The Journal of applied psychology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"The implications of unconfounding multisource performance ratings.\",\"authors\":\"D. Jackson, G. Michaelides, C. Dewberry, Benjamin Schwencke, S. Toms\",\"doi\":\"10.1037/apl0000434\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The multifaceted structure of multisource job performance ratings has been a subject of research and debate for over 30 years. However, progress in the field has been hampered by the confounding of effects relevant to the measurement design of multisource ratings and, as a consequence, the impact of ratee-, rater-, source-, and dimension-related effects on the reliability of multisource ratings remains unclear. In separate samples obtained from 2 different applications and measurement designs (N₁ [ratees] = 392, N₁ [raters] = 1,495; N₂ [ratees] = 342, N₂ [raters] = 2,636), we, for the first time, unconfounded all systematic effects commonly cited as being relevant to multisource ratings using a Bayesian generalizability theory approach. Our results suggest that the main contributors to the reliability of multisource ratings are source-related and general performance effects that are independent of dimension-related effects. In light of our findings, we discuss the interpretation and application of multisource ratings in organizational contexts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).\",\"PeriodicalId\":169654,\"journal\":{\"name\":\"The Journal of applied psychology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Journal of applied psychology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1037/apl0000434\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of applied psychology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1037/apl0000434","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The implications of unconfounding multisource performance ratings.
The multifaceted structure of multisource job performance ratings has been a subject of research and debate for over 30 years. However, progress in the field has been hampered by the confounding of effects relevant to the measurement design of multisource ratings and, as a consequence, the impact of ratee-, rater-, source-, and dimension-related effects on the reliability of multisource ratings remains unclear. In separate samples obtained from 2 different applications and measurement designs (N₁ [ratees] = 392, N₁ [raters] = 1,495; N₂ [ratees] = 342, N₂ [raters] = 2,636), we, for the first time, unconfounded all systematic effects commonly cited as being relevant to multisource ratings using a Bayesian generalizability theory approach. Our results suggest that the main contributors to the reliability of multisource ratings are source-related and general performance effects that are independent of dimension-related effects. In light of our findings, we discuss the interpretation and application of multisource ratings in organizational contexts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
