Belinda M. Craig, Suzanne M. Cosh, Camilla C. Luck
{"title":"研究澳大利亚心理学学者的生产力、质量和影响力指标","authors":"Belinda M. Craig, Suzanne M. Cosh, Camilla C. Luck","doi":"10.1080/00049530.2021.1883407","DOIUrl":null,"url":null,"abstract":"ABSTRACT Objective: This project aimed to provide normative data from SciVal on the research outputs of Australian psychology academics. Normative data are presented by academic level, university network, and estimated career stage. Additional analyses identify which SciVal metrics (measured over a short time window) predict lifetime performance indicators. Method: Data from 749 psychology academics across 24 universities belonging to the various Australian university networks were extracted from Scopus and SciVal (a tool including metrics of recent research quantity, quality, and impact). Metrics included number of outputs and citations, citations per output, Field Weighted Citation Impact, percentage of outputs in the top 10% by citations or journal rank, and percentage of outputs with international or corporate collaborators. Results: Metrics related to quantity of outputs and citations increased with academic level and career stage. For other SciVal metrics, academics at the more senior levels (D and/or E) often outperformed Level B academics. Academics at Group of Eight universities tended to outperform academics affiliated with other networks by overall outputs and citations. These differences were less consistent for other SciVal metrics. A range of SciVal metrics predicted lifetime metrics. Conclusion: These data provide up-to-date norms to facilitate evaluation of Australian psychology academics using SciVal. KEY POINTS What is already known about this topic: Metrics of research quantity, quality, and impact are increasingly influential in research evaluation. Recent norms for Australian psychology academics stratified by academic level and university affiliation were published by Mazzucchelli et al. (2019). These norms documented significant differences in publications, citations, and h-index for staff at different academic levels and across academics affiliated with different university networks. What this topic adds: This study provides up-to-date norms broken down by academic level, university network, and estimated career stage for a range of new metrics of research quantity, quality, and impact available from SciVal. Analyses are also conducted to identify which SciVal metrics (which are based on publications in the recent past) predict lifetime performance indicators. Senior academics generally outperformed junior academics on most metrics. Group of Eight academics outperformed academics affiliated with other university networks on metrics of raw outputs and citations, but not as consistently for other metrics. A number of SciVal metrics predict lifetime performance indicators.","PeriodicalId":8871,"journal":{"name":"Australian Journal of Psychology","volume":"73 1","pages":"144 - 156"},"PeriodicalIF":3.6000,"publicationDate":"2021-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/00049530.2021.1883407","citationCount":"6","resultStr":"{\"title\":\"Research productivity, quality, and impact metrics of Australian psychology academics\",\"authors\":\"Belinda M. Craig, Suzanne M. Cosh, Camilla C. Luck\",\"doi\":\"10.1080/00049530.2021.1883407\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Objective: This project aimed to provide normative data from SciVal on the research outputs of Australian psychology academics. Normative data are presented by academic level, university network, and estimated career stage. Additional analyses identify which SciVal metrics (measured over a short time window) predict lifetime performance indicators. Method: Data from 749 psychology academics across 24 universities belonging to the various Australian university networks were extracted from Scopus and SciVal (a tool including metrics of recent research quantity, quality, and impact). Metrics included number of outputs and citations, citations per output, Field Weighted Citation Impact, percentage of outputs in the top 10% by citations or journal rank, and percentage of outputs with international or corporate collaborators. Results: Metrics related to quantity of outputs and citations increased with academic level and career stage. For other SciVal metrics, academics at the more senior levels (D and/or E) often outperformed Level B academics. Academics at Group of Eight universities tended to outperform academics affiliated with other networks by overall outputs and citations. These differences were less consistent for other SciVal metrics. A range of SciVal metrics predicted lifetime metrics. Conclusion: These data provide up-to-date norms to facilitate evaluation of Australian psychology academics using SciVal. KEY POINTS What is already known about this topic: Metrics of research quantity, quality, and impact are increasingly influential in research evaluation. Recent norms for Australian psychology academics stratified by academic level and university affiliation were published by Mazzucchelli et al. (2019). These norms documented significant differences in publications, citations, and h-index for staff at different academic levels and across academics affiliated with different university networks. What this topic adds: This study provides up-to-date norms broken down by academic level, university network, and estimated career stage for a range of new metrics of research quantity, quality, and impact available from SciVal. Analyses are also conducted to identify which SciVal metrics (which are based on publications in the recent past) predict lifetime performance indicators. Senior academics generally outperformed junior academics on most metrics. Group of Eight academics outperformed academics affiliated with other university networks on metrics of raw outputs and citations, but not as consistently for other metrics. A number of SciVal metrics predict lifetime performance indicators.\",\"PeriodicalId\":8871,\"journal\":{\"name\":\"Australian Journal of Psychology\",\"volume\":\"73 1\",\"pages\":\"144 - 156\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2021-02-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1080/00049530.2021.1883407\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Australian Journal of Psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/00049530.2021.1883407\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australian Journal of Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/00049530.2021.1883407","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
Research productivity, quality, and impact metrics of Australian psychology academics
ABSTRACT Objective: This project aimed to provide normative data from SciVal on the research outputs of Australian psychology academics. Normative data are presented by academic level, university network, and estimated career stage. Additional analyses identify which SciVal metrics (measured over a short time window) predict lifetime performance indicators. Method: Data from 749 psychology academics across 24 universities belonging to the various Australian university networks were extracted from Scopus and SciVal (a tool including metrics of recent research quantity, quality, and impact). Metrics included number of outputs and citations, citations per output, Field Weighted Citation Impact, percentage of outputs in the top 10% by citations or journal rank, and percentage of outputs with international or corporate collaborators. Results: Metrics related to quantity of outputs and citations increased with academic level and career stage. For other SciVal metrics, academics at the more senior levels (D and/or E) often outperformed Level B academics. Academics at Group of Eight universities tended to outperform academics affiliated with other networks by overall outputs and citations. These differences were less consistent for other SciVal metrics. A range of SciVal metrics predicted lifetime metrics. Conclusion: These data provide up-to-date norms to facilitate evaluation of Australian psychology academics using SciVal. KEY POINTS What is already known about this topic: Metrics of research quantity, quality, and impact are increasingly influential in research evaluation. Recent norms for Australian psychology academics stratified by academic level and university affiliation were published by Mazzucchelli et al. (2019). These norms documented significant differences in publications, citations, and h-index for staff at different academic levels and across academics affiliated with different university networks. What this topic adds: This study provides up-to-date norms broken down by academic level, university network, and estimated career stage for a range of new metrics of research quantity, quality, and impact available from SciVal. Analyses are also conducted to identify which SciVal metrics (which are based on publications in the recent past) predict lifetime performance indicators. Senior academics generally outperformed junior academics on most metrics. Group of Eight academics outperformed academics affiliated with other university networks on metrics of raw outputs and citations, but not as consistently for other metrics. A number of SciVal metrics predict lifetime performance indicators.
期刊介绍:
Australian Journal of Psychology is the premier scientific journal of the Australian Psychological Society. It covers the entire spectrum of psychological research and receives articles on all topics within the broad scope of the discipline. The journal publishes high quality peer-reviewed articles with reviewers and associate editors providing detailed assistance to authors to reach publication. The journal publishes reports of experimental and survey studies, including reports of qualitative investigations, on pure and applied topics in the field of psychology. Articles on clinical psychology or on the professional concerns of applied psychology should be submitted to our sister journals, Australian Psychologist or Clinical Psychologist. The journal publishes occasional reviews of specific topics, theoretical pieces and commentaries on methodological issues. There are also solicited book reviews and comments Annual special issues devoted to a single topic, and guest edited by a specialist editor, are published. The journal regards itself as international in vision and will accept submissions from psychologists in all countries.