Quintin P. McGrath;Alan R. Hevner;Gert-Jan de Vreede
{"title":"设计一个增强的企业风险管理系统来降低人工智能应用的伦理风险","authors":"Quintin P. McGrath;Alan R. Hevner;Gert-Jan de Vreede","doi":"10.1109/TEM.2025.3565221","DOIUrl":null,"url":null,"abstract":"The introduction of artificial intelligence (AI) capabilities in business applications provides substantial benefits but requires organizations to manage critical AI ethical risks. We survey a range of large organizations on their use of enterprise risk management (ERM) systems to predict and mitigate the ethical risks of AI. Four serious gaps in current ERM systems are identified: AI ethical principles do not translate effectively to ethical practices; real-time monitoring of AI ethical risks is needed; ERM systems emphasize economic, not ethical risks; and when ethical risks are identified, no ready solutions are available for remedy. To address these gaps, we propose a proactive approach to managing ethical risks by extending the capabilities of current ERM systems. An enhanced ERM system framework is designed and evaluated by subject matter expert focus groups. We conclude with observations and future research directions on the need for more aggressive proethical management oversight as organizations move to ubiquitous use of AI-driven business applications.","PeriodicalId":55009,"journal":{"name":"IEEE Transactions on Engineering Management","volume":"72 ","pages":"1813-1830"},"PeriodicalIF":4.6000,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Designing an Enhanced Enterprise Risk Management System to Mitigate Ethical Risks of Artificial Intelligence Applications\",\"authors\":\"Quintin P. McGrath;Alan R. Hevner;Gert-Jan de Vreede\",\"doi\":\"10.1109/TEM.2025.3565221\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The introduction of artificial intelligence (AI) capabilities in business applications provides substantial benefits but requires organizations to manage critical AI ethical risks. We survey a range of large organizations on their use of enterprise risk management (ERM) systems to predict and mitigate the ethical risks of AI. Four serious gaps in current ERM systems are identified: AI ethical principles do not translate effectively to ethical practices; real-time monitoring of AI ethical risks is needed; ERM systems emphasize economic, not ethical risks; and when ethical risks are identified, no ready solutions are available for remedy. To address these gaps, we propose a proactive approach to managing ethical risks by extending the capabilities of current ERM systems. An enhanced ERM system framework is designed and evaluated by subject matter expert focus groups. We conclude with observations and future research directions on the need for more aggressive proethical management oversight as organizations move to ubiquitous use of AI-driven business applications.\",\"PeriodicalId\":55009,\"journal\":{\"name\":\"IEEE Transactions on Engineering Management\",\"volume\":\"72 \",\"pages\":\"1813-1830\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2025-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Engineering Management\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10979871/\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"BUSINESS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Engineering Management","FirstCategoryId":"91","ListUrlMain":"https://ieeexplore.ieee.org/document/10979871/","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BUSINESS","Score":null,"Total":0}
Designing an Enhanced Enterprise Risk Management System to Mitigate Ethical Risks of Artificial Intelligence Applications
The introduction of artificial intelligence (AI) capabilities in business applications provides substantial benefits but requires organizations to manage critical AI ethical risks. We survey a range of large organizations on their use of enterprise risk management (ERM) systems to predict and mitigate the ethical risks of AI. Four serious gaps in current ERM systems are identified: AI ethical principles do not translate effectively to ethical practices; real-time monitoring of AI ethical risks is needed; ERM systems emphasize economic, not ethical risks; and when ethical risks are identified, no ready solutions are available for remedy. To address these gaps, we propose a proactive approach to managing ethical risks by extending the capabilities of current ERM systems. An enhanced ERM system framework is designed and evaluated by subject matter expert focus groups. We conclude with observations and future research directions on the need for more aggressive proethical management oversight as organizations move to ubiquitous use of AI-driven business applications.
期刊介绍:
Management of technical functions such as research, development, and engineering in industry, government, university, and other settings. Emphasis is on studies carried on within an organization to help in decision making or policy formation for RD&E.