{"title":"研究团队工作的科学计量评估方法","authors":"K. Horiacheva, Yuliia Titomyr","doi":"10.33813/2224-1213.29.2022.1","DOIUrl":null,"url":null,"abstract":"Abstract. Personality assessments are administered for a variety of purposes\namong different groups of qualified personnel in a wide range of practice settings,\nincluding the educational and scientific fields. There is strong evidence of the\nusefulness of specific personality tests in these settings, especially using a multiparameter assessment system. However, there are no unified guidelines that form\nthe basis for current personality assessment practice. The absence of these guidelines\nmay contribute to increased inconsistencies in the formation of work teams for\nresearch projects by research managers.\nThe aim of the article is to form the main methods for assessing the results\nof scientific activity of scientific teams, used in Ukraine, with identifying their\nadvantages and disadvantages. Adequate assessment of the effectiveness of\nscientific teams and individual scientists is a key task for building a rating of\nboth the scientist himself and the scientific institution in which he has\naffiliation.\nThe methodology of the research is based on the principle of systematicity, a\ncomparative analysis of evaluation criteria has been carried out.\nScientific novelty. The article considers the principles, methods and indicators\nof scientometric evaluation of information processes in science and evaluation\nof publication activity of individuals and scientific teams; analyzes the main\ncriteria for assessing the prospects of scientific directions, evaluation of the\neffectiveness of scientific organizations, their departments and individual\nemployees; shows the means of accounting additional information; proposes\ncriteria for evaluating the work of scientific teams and methods of assessing\neach of the criteria.\nConclusions. It has been determined that the transition to specific quantitative\nassessments will require a clearer formalization of the above criteria, as well as\nthe formation of unambiguous algorithms for their application. A proposal has\nbeen made to evaluate the work of a scientific unit as a scientific team, the\ncomposition of which can be interdepartmental or international, and possible criteria\nfor evaluating its work have been considered. A proposal has been made to introduce\ndifferent scales of evaluation for theoretical and applied areas of science. This\napproach is a generalization of the global and domestic experience of evaluating\nthe work of scientific teams.\nKeywords: research team, evaluation criteria, scientometrics, citation index,\nh-index, expertise.","PeriodicalId":206442,"journal":{"name":"Problems of Innovation and Investment Development","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Approaches to scientometric evaluation\\nof the work of reasearch teams\",\"authors\":\"K. Horiacheva, Yuliia Titomyr\",\"doi\":\"10.33813/2224-1213.29.2022.1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract. Personality assessments are administered for a variety of purposes\\namong different groups of qualified personnel in a wide range of practice settings,\\nincluding the educational and scientific fields. There is strong evidence of the\\nusefulness of specific personality tests in these settings, especially using a multiparameter assessment system. However, there are no unified guidelines that form\\nthe basis for current personality assessment practice. The absence of these guidelines\\nmay contribute to increased inconsistencies in the formation of work teams for\\nresearch projects by research managers.\\nThe aim of the article is to form the main methods for assessing the results\\nof scientific activity of scientific teams, used in Ukraine, with identifying their\\nadvantages and disadvantages. Adequate assessment of the effectiveness of\\nscientific teams and individual scientists is a key task for building a rating of\\nboth the scientist himself and the scientific institution in which he has\\naffiliation.\\nThe methodology of the research is based on the principle of systematicity, a\\ncomparative analysis of evaluation criteria has been carried out.\\nScientific novelty. The article considers the principles, methods and indicators\\nof scientometric evaluation of information processes in science and evaluation\\nof publication activity of individuals and scientific teams; analyzes the main\\ncriteria for assessing the prospects of scientific directions, evaluation of the\\neffectiveness of scientific organizations, their departments and individual\\nemployees; shows the means of accounting additional information; proposes\\ncriteria for evaluating the work of scientific teams and methods of assessing\\neach of the criteria.\\nConclusions. It has been determined that the transition to specific quantitative\\nassessments will require a clearer formalization of the above criteria, as well as\\nthe formation of unambiguous algorithms for their application. A proposal has\\nbeen made to evaluate the work of a scientific unit as a scientific team, the\\ncomposition of which can be interdepartmental or international, and possible criteria\\nfor evaluating its work have been considered. A proposal has been made to introduce\\ndifferent scales of evaluation for theoretical and applied areas of science. This\\napproach is a generalization of the global and domestic experience of evaluating\\nthe work of scientific teams.\\nKeywords: research team, evaluation criteria, scientometrics, citation index,\\nh-index, expertise.\",\"PeriodicalId\":206442,\"journal\":{\"name\":\"Problems of Innovation and Investment Development\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Problems of Innovation and Investment Development\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.33813/2224-1213.29.2022.1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Problems of Innovation and Investment Development","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.33813/2224-1213.29.2022.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Approaches to scientometric evaluation
of the work of reasearch teams
Abstract. Personality assessments are administered for a variety of purposes
among different groups of qualified personnel in a wide range of practice settings,
including the educational and scientific fields. There is strong evidence of the
usefulness of specific personality tests in these settings, especially using a multiparameter assessment system. However, there are no unified guidelines that form
the basis for current personality assessment practice. The absence of these guidelines
may contribute to increased inconsistencies in the formation of work teams for
research projects by research managers.
The aim of the article is to form the main methods for assessing the results
of scientific activity of scientific teams, used in Ukraine, with identifying their
advantages and disadvantages. Adequate assessment of the effectiveness of
scientific teams and individual scientists is a key task for building a rating of
both the scientist himself and the scientific institution in which he has
affiliation.
The methodology of the research is based on the principle of systematicity, a
comparative analysis of evaluation criteria has been carried out.
Scientific novelty. The article considers the principles, methods and indicators
of scientometric evaluation of information processes in science and evaluation
of publication activity of individuals and scientific teams; analyzes the main
criteria for assessing the prospects of scientific directions, evaluation of the
effectiveness of scientific organizations, their departments and individual
employees; shows the means of accounting additional information; proposes
criteria for evaluating the work of scientific teams and methods of assessing
each of the criteria.
Conclusions. It has been determined that the transition to specific quantitative
assessments will require a clearer formalization of the above criteria, as well as
the formation of unambiguous algorithms for their application. A proposal has
been made to evaluate the work of a scientific unit as a scientific team, the
composition of which can be interdepartmental or international, and possible criteria
for evaluating its work have been considered. A proposal has been made to introduce
different scales of evaluation for theoretical and applied areas of science. This
approach is a generalization of the global and domestic experience of evaluating
the work of scientific teams.
Keywords: research team, evaluation criteria, scientometrics, citation index,
h-index, expertise.