社论:大型语言模型中的情感估计和认知谬误分析

Q1 Economics, Econometrics and Finance
Daniel E. O'Leary
{"title":"社论:大型语言模型中的情感估计和认知谬误分析","authors":"Daniel E. O'Leary","doi":"10.1002/isaf.70010","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>This paper describes some experimentation with the evolving ability of large language models to generate sentiment estimates. We find that current models seem to equal or even exceed the ability of human annotators in a case study of single sentiment sentences. In addition, using the large language models, we were able to identify a small number of sentences in the data set, where it appears that the annotator made errors in assessing the sentiment. Unfortunately, analysis of the LLM results also illustrates apparent cognitive biases in the LLM behavior. Those effects appear to include an “ostrich effect” and a “no one is good enough” effect cognitive bias in LLM sentiment estimates.</p>\n </div>","PeriodicalId":53473,"journal":{"name":"Intelligent Systems in Accounting, Finance and Management","volume":"32 3","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Editorial: Analysis of Sentiment Estimates and Cognitive Fallacies in Large Language Models\",\"authors\":\"Daniel E. O'Leary\",\"doi\":\"10.1002/isaf.70010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>This paper describes some experimentation with the evolving ability of large language models to generate sentiment estimates. We find that current models seem to equal or even exceed the ability of human annotators in a case study of single sentiment sentences. In addition, using the large language models, we were able to identify a small number of sentences in the data set, where it appears that the annotator made errors in assessing the sentiment. Unfortunately, analysis of the LLM results also illustrates apparent cognitive biases in the LLM behavior. Those effects appear to include an “ostrich effect” and a “no one is good enough” effect cognitive bias in LLM sentiment estimates.</p>\\n </div>\",\"PeriodicalId\":53473,\"journal\":{\"name\":\"Intelligent Systems in Accounting, Finance and Management\",\"volume\":\"32 3\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-07-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligent Systems in Accounting, Finance and Management\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/isaf.70010\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Economics, Econometrics and Finance\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligent Systems in Accounting, Finance and Management","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/isaf.70010","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Economics, Econometrics and Finance","Score":null,"Total":0}
引用次数: 0

摘要

本文描述了一些大型语言模型生成情感估计的进化能力的实验。我们发现,在单个情感句子的案例研究中,当前的模型似乎等于甚至超过了人类注释者的能力。此外,使用大型语言模型,我们能够识别数据集中的少数句子,在这些句子中,注释者在评估情感时似乎犯了错误。不幸的是,对法学硕士结果的分析也说明了法学硕士行为中明显的认知偏差。这些影响似乎包括法学硕士情绪估计中的“鸵鸟效应”和“没有人足够好”效应认知偏差。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Editorial: Analysis of Sentiment Estimates and Cognitive Fallacies in Large Language Models

This paper describes some experimentation with the evolving ability of large language models to generate sentiment estimates. We find that current models seem to equal or even exceed the ability of human annotators in a case study of single sentiment sentences. In addition, using the large language models, we were able to identify a small number of sentences in the data set, where it appears that the annotator made errors in assessing the sentiment. Unfortunately, analysis of the LLM results also illustrates apparent cognitive biases in the LLM behavior. Those effects appear to include an “ostrich effect” and a “no one is good enough” effect cognitive bias in LLM sentiment estimates.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Intelligent Systems in Accounting, Finance and Management
Intelligent Systems in Accounting, Finance and Management Economics, Econometrics and Finance-Finance
CiteScore
6.00
自引率
0.00%
发文量
0
期刊介绍: Intelligent Systems in Accounting, Finance and Management is a quarterly international journal which publishes original, high quality material dealing with all aspects of intelligent systems as they relate to the fields of accounting, economics, finance, marketing and management. In addition, the journal also is concerned with related emerging technologies, including big data, business intelligence, social media and other technologies. It encourages the development of novel technologies, and the embedding of new and existing technologies into applications of real, practical value. Therefore, implementation issues are of as much concern as development issues. The journal is designed to appeal to academics in the intelligent systems, emerging technologies and business fields, as well as to advanced practitioners who wish to improve the effectiveness, efficiency, or economy of their working practices. A special feature of the journal is the use of two groups of reviewers, those who specialize in intelligent systems work, and also those who specialize in applications areas. Reviewers are asked to address issues of originality and actual or potential impact on research, teaching, or practice in the accounting, finance, or management fields. Authors working on conceptual developments or on laboratory-based explorations of data sets therefore need to address the issue of potential impact at some level in submissions to the journal.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信