Detecting Hallucinations in SpeechLLMs at Inference Time Using Attention Maps

Researchers propose attention-map-based metrics to detect hallucinations in speech LLMs at inference time without requiring gold-standard outputs. The method, tested on Qwen-2-Audio and Voxtral-3B, uses lightweight classifiers to identify pathological attention patterns specific to audio, outperforming uncertainty-based baselines.

MentionsQwen-2-Audio · Voxtral-3B · SpeechLLMs

Modelwire summarizes — we don’t republish. The full article lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.