PaperScope
LIVE · 2026-09-03 05:40 UTC

Vocal Music under Phoneme-Conditional Analysis

Hayoon Kim, Kyogu Lee

Latestcs.CLcs.LGcs.AIcs.CV
arXiv ID
2608.30823 v1
Category
Submitted
2026-08-31

Abstract

The vocal music of each language carries a distinctive sonic identity, even without instrumental accompaniment. We ask whether these differences are measurable and traceable to specific phonemes. To tackle this question, we introduce phoneme-conditional analysis, which isolates the acoustic effect of typologically distinctive phonemes by comparing marker syllables against matched non-marker controls within the same song, holding singer, melody, and genre constant. Across nine typologically diverse languages and thousands of songs, we measure effects along five acoustic dimensions. Song-level profiles built from these effects identify the language of an unaccompanied vocal at 85.5% balanced accuracy in a nine-way classification with folds grouped by artist; whether the separability arises by accumulation of the phoneme-local effects themselves is left open. Our findings suggest that phonological structure leaves systematic and measurable traces in how each language is sung.

Comment: Accepted to the 27th International Society for Music Information Retrieval Conference (ISMIR 2026)

arXiv abs page · PDF · same-day batch