๐Ÿ“–
Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents
Genshin Kakimoto, Atsushi Yanagisawa

Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents

Author / Organization:
Science & Mathematics Published 2026 Verification Pending

Overview & Synopsis

Staged post-training of multimodal foundation models chains vision-language alignment, reasoning distillation, and domain tuning, yet how each phase trades capabilities against the others remains under-characterised. Tracking an 8.4B-parameter model from an un-fine-tuned baseline through three training phases on Japanese financial documents (evaluated on five text-input benchmarks), we find the phases interact non-additively: math-only distillation overwrites the financial knowledge acquired earlier even as procedural math skill survives, and the domain phase repairs more than it installs. A skip-phase ablation is best for domain knowledge but forfeits numerical-reasoning gains, so per-phase contributions are not decomposable and the best checkpoint is task-dependent, with implications for checkpoint retention and scheduling rather than added stages.

Indexed from repository: arXiv (arxiv.org)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents
Author / Organization Genshin Kakimoto, Atsushi Yanagisawa
Subject & Discipline cs.AI
Categories Science & Mathematics
Publication Year 2026
License / Rights arXiv Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website arXiv (arxiv.org)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-270617
Original Source Link Visit Source Page on arxiv.org »