开发方法支持,以提高业务流程专家评估的质量

Vitalii Antoshchuk, V. Filippov, V. Kuvaieva
{"title":"开发方法支持,以提高业务流程专家评估的质量","authors":"Vitalii Antoshchuk, V. Filippov, V. Kuvaieva","doi":"10.15587/2706-5448.2021.225336","DOIUrl":null,"url":null,"abstract":"The object of research is the process of forming a collective expert assessment with increased reliability in making management decisions in business structures by an expanded team of experts. One of the most problematic places in the expert assessment of management decisions is the complexity of forming a competent expert team and the rather high cost of the expertise. In recent years, there has been a tendency for expert assessment with an expanded team of experts. In this case, not only professional experts are involved in the examination, but also all persons wishing to take part in solving the problem. In this case, the reliability of the examination raises doubts. In connection with the participation in expert assessment of persons who do not have experience in expert work, a wide range of expert assessments is possible. The analysis of the current state of the methods of expert assessment in business is carried out. It has been established that the Delphi method, which was most used until recently, does not meet modern requirements. More progressive methods are based on mathematical consensus theory. Consensus is understood as the degree of correlation of individual expert assessments performed in rank scales. In the course of the study, formalized mathematical approaches to the organization of collective expertise were used. A method for processing the results of an examination with an expanded composition of experts was developed. The developed methodology is focused on identifying experts with insufficient qualifications. The methodology allows for a step-by-step assessment of the reliability of the collective expert decision by assessing the Kendall concordance coefficient. It is shown that the phased exclusion of assessments by experts with insufficient qualifications allows increasing the level of consensus, the quality and reliability of the collective expert assessment. The developed methodology has been tested in a really functioning enterprise to make a decision on the exit strategy of the enterprise from their crisis. The use of the developed methodology has made it possible to significantly increase the reliability of the examination results, assessed by the concordance coefficient. The results are useful for practical application in business structures when conducting expert examinations involving a wide range of participants.","PeriodicalId":300961,"journal":{"name":"ERN: Other Organizations & Markets: Policies & Processes (Topic)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of Methodological Support for Improving the Quality of Expert Assessment of Business Processes\",\"authors\":\"Vitalii Antoshchuk, V. Filippov, V. Kuvaieva\",\"doi\":\"10.15587/2706-5448.2021.225336\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The object of research is the process of forming a collective expert assessment with increased reliability in making management decisions in business structures by an expanded team of experts. One of the most problematic places in the expert assessment of management decisions is the complexity of forming a competent expert team and the rather high cost of the expertise. In recent years, there has been a tendency for expert assessment with an expanded team of experts. In this case, not only professional experts are involved in the examination, but also all persons wishing to take part in solving the problem. In this case, the reliability of the examination raises doubts. In connection with the participation in expert assessment of persons who do not have experience in expert work, a wide range of expert assessments is possible. The analysis of the current state of the methods of expert assessment in business is carried out. It has been established that the Delphi method, which was most used until recently, does not meet modern requirements. More progressive methods are based on mathematical consensus theory. Consensus is understood as the degree of correlation of individual expert assessments performed in rank scales. In the course of the study, formalized mathematical approaches to the organization of collective expertise were used. A method for processing the results of an examination with an expanded composition of experts was developed. The developed methodology is focused on identifying experts with insufficient qualifications. The methodology allows for a step-by-step assessment of the reliability of the collective expert decision by assessing the Kendall concordance coefficient. It is shown that the phased exclusion of assessments by experts with insufficient qualifications allows increasing the level of consensus, the quality and reliability of the collective expert assessment. The developed methodology has been tested in a really functioning enterprise to make a decision on the exit strategy of the enterprise from their crisis. The use of the developed methodology has made it possible to significantly increase the reliability of the examination results, assessed by the concordance coefficient. The results are useful for practical application in business structures when conducting expert examinations involving a wide range of participants.\",\"PeriodicalId\":300961,\"journal\":{\"name\":\"ERN: Other Organizations & Markets: Policies & Processes (Topic)\",\"volume\":\"23 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ERN: Other Organizations & Markets: Policies & Processes (Topic)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.15587/2706-5448.2021.225336\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ERN: Other Organizations & Markets: Policies & Processes (Topic)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.15587/2706-5448.2021.225336","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

研究的目的是通过扩大的专家团队,在业务结构的管理决策中形成具有更高可靠性的集体专家评估的过程。管理决策的专家评估中最成问题的地方之一是组建一个有能力的专家团队的复杂性和相当高的专业知识成本。近年来,专家评估有扩大专家团队的趋势。在这种情况下,不仅专业专家参与了考试,而且所有希望参与解决问题的人都参与了考试。在这种情况下,检查的可靠性引起了怀疑。关于没有专家工作经验的人参与专家评估,可以进行范围广泛的专家评估。对企业专家评估方法的现状进行了分析。已经确定,德尔菲法,这是最常用的,直到最近,不符合现代要求。更先进的方法是基于数学共识理论。共识被理解为在等级量表中进行的个别专家评估的相关程度。在研究过程中,使用了形式化的数学方法来组织集体专业知识。提出了一种扩大专家组成来处理检查结果的方法。开发的方法侧重于确定资格不足的专家。该方法允许通过评估肯德尔一致性系数逐步评估集体专家决策的可靠性。结果表明,分阶段排除资历不足的专家的评估,可以提高集体专家评估的共识水平、质量和可靠性。所开发的方法已在一个实际运行的企业中进行了测试,以确定企业从危机中退出的策略。所开发的方法的使用,使其有可能显著提高检查结果的可靠性,由一致性系数评估。在进行涉及广泛参与者的专家考试时,这些结果对商业结构的实际应用很有用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Development of Methodological Support for Improving the Quality of Expert Assessment of Business Processes
The object of research is the process of forming a collective expert assessment with increased reliability in making management decisions in business structures by an expanded team of experts. One of the most problematic places in the expert assessment of management decisions is the complexity of forming a competent expert team and the rather high cost of the expertise. In recent years, there has been a tendency for expert assessment with an expanded team of experts. In this case, not only professional experts are involved in the examination, but also all persons wishing to take part in solving the problem. In this case, the reliability of the examination raises doubts. In connection with the participation in expert assessment of persons who do not have experience in expert work, a wide range of expert assessments is possible. The analysis of the current state of the methods of expert assessment in business is carried out. It has been established that the Delphi method, which was most used until recently, does not meet modern requirements. More progressive methods are based on mathematical consensus theory. Consensus is understood as the degree of correlation of individual expert assessments performed in rank scales. In the course of the study, formalized mathematical approaches to the organization of collective expertise were used. A method for processing the results of an examination with an expanded composition of experts was developed. The developed methodology is focused on identifying experts with insufficient qualifications. The methodology allows for a step-by-step assessment of the reliability of the collective expert decision by assessing the Kendall concordance coefficient. It is shown that the phased exclusion of assessments by experts with insufficient qualifications allows increasing the level of consensus, the quality and reliability of the collective expert assessment. The developed methodology has been tested in a really functioning enterprise to make a decision on the exit strategy of the enterprise from their crisis. The use of the developed methodology has made it possible to significantly increase the reliability of the examination results, assessed by the concordance coefficient. The results are useful for practical application in business structures when conducting expert examinations involving a wide range of participants.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信