Xiyang Lei , Weiyan Qiu , Jianping Li , Qianzhi Dai
{"title":"稳健的性能评估与改进:打开权重空间的黑盒子","authors":"Xiyang Lei , Weiyan Qiu , Jianping Li , Qianzhi Dai","doi":"10.1016/j.omega.2025.103409","DOIUrl":null,"url":null,"abstract":"<div><div>Data envelopment analysis (DEA) may fall into the extreme weights during the performance evaluation process. To obtain robust evaluation results, a possible way is opening the black-box of weight space. In this scenario, there are two main challenges: i) how to ensure the repeatability of performance evaluation, and ii) how to find the optimal performance improvement path. In this paper, we first propose a grid generation algorithm that can sample the input-output weights non-randomly, which means the sampling result can be reproducible. Based on this, we can approach the efficiency ratio distribution curve of each decision-making unit (DMU), which reveals more detailed insights into efficiency assessment. To describe the evaluation result, we replace the concept of efficiency dominance by dominance efficiency probability (DEP), and analyze the ranking interval by employing ranking expectation and ranking variance. Several important properties are further proved. Moreover, we propose a step-by-step performance improvement algorithm based on the principle of efficiency elasticity maximization. Finally, we illustrate the availability of our method by a real-world case study. The main contributions include that i) we propose a weight sampling algorithm to open the black-box of weight space, which can ensure the evaluation result is reproducible; ii) we extend the performance evaluation indicator to the framework of DEP, ranking expectation and ranking variance, which can provide evaluation information for decision makers more comprehensively and robustly; iii) we propose a performance improvement algorithm from the new perspective of efficiency elasticity.</div></div>","PeriodicalId":19529,"journal":{"name":"Omega-international Journal of Management Science","volume":"138 ","pages":"Article 103409"},"PeriodicalIF":7.2000,"publicationDate":"2025-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust performance evaluation and improvement: Opening the black-box of weight space\",\"authors\":\"Xiyang Lei , Weiyan Qiu , Jianping Li , Qianzhi Dai\",\"doi\":\"10.1016/j.omega.2025.103409\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Data envelopment analysis (DEA) may fall into the extreme weights during the performance evaluation process. To obtain robust evaluation results, a possible way is opening the black-box of weight space. In this scenario, there are two main challenges: i) how to ensure the repeatability of performance evaluation, and ii) how to find the optimal performance improvement path. In this paper, we first propose a grid generation algorithm that can sample the input-output weights non-randomly, which means the sampling result can be reproducible. Based on this, we can approach the efficiency ratio distribution curve of each decision-making unit (DMU), which reveals more detailed insights into efficiency assessment. To describe the evaluation result, we replace the concept of efficiency dominance by dominance efficiency probability (DEP), and analyze the ranking interval by employing ranking expectation and ranking variance. Several important properties are further proved. Moreover, we propose a step-by-step performance improvement algorithm based on the principle of efficiency elasticity maximization. Finally, we illustrate the availability of our method by a real-world case study. The main contributions include that i) we propose a weight sampling algorithm to open the black-box of weight space, which can ensure the evaluation result is reproducible; ii) we extend the performance evaluation indicator to the framework of DEP, ranking expectation and ranking variance, which can provide evaluation information for decision makers more comprehensively and robustly; iii) we propose a performance improvement algorithm from the new perspective of efficiency elasticity.</div></div>\",\"PeriodicalId\":19529,\"journal\":{\"name\":\"Omega-international Journal of Management Science\",\"volume\":\"138 \",\"pages\":\"Article 103409\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2025-08-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Omega-international Journal of Management Science\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0305048325001355\",\"RegionNum\":2,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Omega-international Journal of Management Science","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0305048325001355","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
Robust performance evaluation and improvement: Opening the black-box of weight space
Data envelopment analysis (DEA) may fall into the extreme weights during the performance evaluation process. To obtain robust evaluation results, a possible way is opening the black-box of weight space. In this scenario, there are two main challenges: i) how to ensure the repeatability of performance evaluation, and ii) how to find the optimal performance improvement path. In this paper, we first propose a grid generation algorithm that can sample the input-output weights non-randomly, which means the sampling result can be reproducible. Based on this, we can approach the efficiency ratio distribution curve of each decision-making unit (DMU), which reveals more detailed insights into efficiency assessment. To describe the evaluation result, we replace the concept of efficiency dominance by dominance efficiency probability (DEP), and analyze the ranking interval by employing ranking expectation and ranking variance. Several important properties are further proved. Moreover, we propose a step-by-step performance improvement algorithm based on the principle of efficiency elasticity maximization. Finally, we illustrate the availability of our method by a real-world case study. The main contributions include that i) we propose a weight sampling algorithm to open the black-box of weight space, which can ensure the evaluation result is reproducible; ii) we extend the performance evaluation indicator to the framework of DEP, ranking expectation and ranking variance, which can provide evaluation information for decision makers more comprehensively and robustly; iii) we propose a performance improvement algorithm from the new perspective of efficiency elasticity.
期刊介绍:
Omega reports on developments in management, including the latest research results and applications. Original contributions and review articles describe the state of the art in specific fields or functions of management, while there are shorter critical assessments of particular management techniques. Other features of the journal are the "Memoranda" section for short communications and "Feedback", a correspondence column. Omega is both stimulating reading and an important source for practising managers, specialists in management services, operational research workers and management scientists, management consultants, academics, students and research personnel throughout the world. The material published is of high quality and relevance, written in a manner which makes it accessible to all of this wide-ranging readership. Preference will be given to papers with implications to the practice of management. Submissions of purely theoretical papers are discouraged. The review of material for publication in the journal reflects this aim.