← 返回时间线

paper

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

arXiv ↗
ID
2610.02999
分类
—
首次捕获
2026-10-06
状态
unread
作者
Huiqiang Rong, Haoran Luo, Hui Feng, Zhonghong Ou, Kaiwen Xue, Guoxin Zhang, Yifan Zhu
信号
🔥 0

信号历史

  • 2026-10-06HF Daily Papers · 🔥0
暂无信号数据

摘要

Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response's evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.02999.md,PR 合并后本页自动更新)