ArXiv.org最新文献

筛选

英文中文

Beyond Facts: Evaluating Intent Hallucination in Large Language Models 超越事实：评估大型语言模型中的意图幻觉

ArXiv.org Pub Date : 2025-06-06 DOI: 10.48550/arxiv.2506.06539

Yijie Hao, Haofei Yu, Jiaxuan You

{"title":"Beyond Facts: Evaluating Intent Hallucination in Large Language Models","authors":"Yijie Hao, Haofei Yu, Jiaxuan You","doi":"10.48550/arxiv.2506.06539","DOIUrl":"https://doi.org/10.48550/arxiv.2506.06539","url":null,"abstract":"When exposed to complex queries containing multiple conditions, today's large language models (LLMs) tend to produce responses that only partially satisfy the query while neglecting certain conditions. We therefore introduce the concept of Intent Hallucination. In this phenomenon, LLMs either omit (neglecting to address certain parts) or misinterpret (responding to invented query parts) elements of the given query, leading to intent hallucinated generation. To systematically evaluate intent hallucination, we introduce FAITHQA, a novel benchmark for intent hallucination that contains 20,068 problems, covering both query-only and retrieval-augmented generation (RAG) setups with varying topics and difficulty. FAITHQA is the first hallucination benchmark that goes beyond factual verification, tailored to identify the fundamental cause of intent hallucination. By evaluating various LLMs on FAITHQA, we find that (1) intent hallucination is a common issue even for state-of-the-art models, and (2) the phenomenon stems from omission or misinterpretation of LLMs. To facilitate future research, we introduce an automatic LLM generation evaluation metric, CONSTRAINT SCORE, for detecting intent hallucination. Human evaluation results demonstrate that CONSTRAINT SCORE is closer to human performance for intent hallucination compared to baselines.","PeriodicalId":523071,"journal":{"name":"ArXiv.org","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://arxiv.org/pdf/2506.06539","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147909175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0