📖
VisConf: Quality-Aware Consensus for Best-of-N in Vision-Language Model Reasoning
Muhammad Usman, Muhammad Qasim Ayub, Usman Ahad, Muhammad Tahir

VisConf: Quality-Aware Consensus for Best-of-N in Vision-Language Model Reasoning

Published 2026 Verification Pending

Overview & Synopsis

Best-of-N methods improve text-only LLM reasoning by sampling multiple trajectories before selecting an answer. For Vision-Language Models (VLMs), answer frequency and model confidence alone can be insufficient, as sampled generations also vary in their engagement with the visual input. We find that distributional confidence and visual attention are complementary indicators of rollout quality. Each is limited on its own, while trajectories that show strong signals in both are more likely to be correct. Motivated by this, we introduce VisConf, a rollout-quality score that multiplicatively combines visual engagement with candidate-calibrated Self-Certainty, penalizing rollouts that are weak in either signal. We incorporate Rank-Weighted Consensus (RWC), a tuning-free aggregation rule that converts within-question VisConf ranks into answer-level vote weights. Across three VLMs on MathVista, MMMU-Pro, and MMStar, VisConf with RWC consistently outperforms strong BoN baselines. Our analysis shows particularly large gains when correct trajectories are present but underrepresented in the candidate pool.

Indexed from repository: arXiv (arxiv.org)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title VisConf: Quality-Aware Consensus for Best-of-N in Vision-Language Model Reasoning
Author / Organization Muhammad Usman, Muhammad Qasim Ayub, Usman Ahad, Muhammad Tahir
Subject & Discipline cs.CV
Publication Year 2026
License / Rights arXiv Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website arXiv (arxiv.org)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-277614
Original Source Link Visit Source Page on arxiv.org »