PaperScope
LIVE · 2026-09-29 05:40 UTC

PlurVA-LLM-2026 Shared Task Track-1: Pluralistic Value Alignment in LLMs via Multilingual Fine-Tuning and Threshold Calibration

Vihindi Kotalawala, Nevidu Jayatilleke

Latestcs.CLcs.LGcs.AIcs.CV
arXiv ID
2609.32382 v1
Category
Submitted
2026-09-26

Abstract

We present our system for the PlurVA-LLM 2026 Shared Task Track-1, which focuses on pluralistic value alignment in the contexts of China, Indonesia, and Sri Lanka. For this resource-constrained track, we fine-tuned Llama 3.1 8B Instruct using 4-bit QLoRA. Our approach combines option-permutation augmentation for Chinese data, annotator vote expansion for Indonesian data, and binary reformulation with SinhalaMMLU augmentation for Sri Lankan data. We further applied conditional threshold calibration to the predictions for the Sri Lankan data. The final system achieved accuracies of 0.785 for Chinese, 0.715 for Indonesian, and 0.916 for Sri Lankan, resulting in an overall macro-average accuracy of 0.805.

Comment: 11 pages, 7 figures, 6 tables, Accepted paper at the first workshop on Pluralistic Value Alignment of LLMs @ AACL-IJCNLP 2026

arXiv abs page · PDF · same-day batch