๐Ÿ“–
Reliability-Aware Probabilistic Fusion for Multimodal Learning with Incomplete Evidence
Patitapaban Palo, Abhisek Tiwari, Mattia Carletti, Anshul Thakur, Xiao Gu, David A. Clifton

Reliability-Aware Probabilistic Fusion for Multimodal Learning with Incomplete Evidence

Science & Mathematics Published 2026 Verification Pending

Overview & Synopsis

Multimodal inputs may be missing or degraded, raising distinct questions of evidence availability and trust. We introduce a reliability-aware Gaussian Product-of-Experts (PoE) in which an input-dependent reliability weight tempers each modality's latent precision, while missing experts are omitted. We characterize how reliability and availability affect posterior information and expert influence. Across two clinical multimodal tasks, the full framework remains competitive with complete inputs and achieves its clearest mean-AUROC advantage under modality absence, particularly on HAIM-MIMIC-MM. Ablations show a substantial gain from missing-aware training and an additional HAIM improvement from reliability weighting under matched PoE, missing-aware, and consistency training. Unseen test-time corruptions are used diagnostically and reveal modality-dependent reliability-weight and latent-uncertainty responses, including failure under severe degradation. Thus, reliability weighting provides an explicit evidence-control mechanism, while learning dependable quality signals remains an open challenge.

Indexed from repository: arXiv (arxiv.org)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title Reliability-Aware Probabilistic Fusion for Multimodal Learning with Incomplete Evidence
Author / Organization Patitapaban Palo, Abhisek Tiwari, Mattia Carletti, Anshul Thakur, Xiao Gu, David A. Clifton
Subject & Discipline cs.LG
Categories Science & Mathematics
Publication Year 2026
License / Rights arXiv Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website arXiv (arxiv.org)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-267142
Original Source Link Visit Source Page on arxiv.org »