PaperScope
LIVE · 2026-09-17 05:40 UTC

HearInContext: A Benchmark for Implicit Context in Speech Recognition

Yifan Gao, Yao Tian, Hongbin Suo

Latestcs.CLcs.LGcs.AIcs.CV
arXiv ID
2609.18680 v1
Category
Submitted
2026-09-16

Abstract

Contextual ASR can benefit from semantic cues or from target words explicitly provided in the context. We introduce HearInContext, a Mandarin--English benchmark that pairs shared synthetic speech with assistant replies supporting different interpretations. The benchmark comprises 3,764 semantic test cases built around homophones. Implicit contexts exclude candidate words; explicit contexts name the target. No-context and unrelated-context controls measure the benefit of relevant history and sensitivity to irrelevant history. Context-capable models benefit from implicit cues but achieve higher target recall with explicit hints. Fine-tuning Qwen3-ASR-1.7B improves implicit-context target recall by 11.0 and 11.5 percentage points in Mandarin and English, respectively, while absolute CER/WER changes on AISHELL-1 and LibriSpeech remain below 0.1 percentage points. Gains extend to explicit conditions excluded from fine-tuning and to Mandarin hotword recognition on real recordings.

arXiv abs page · PDF · same-day batch