Home » Authors » Ziqing Qiao, Xiaoyue Xu, Sikui Zhang, Yinuo Xu, Bingxiang He, Chaojun Xiao, Xu Han

Ziqing Qiao, Xiaoyue Xu, Sikui Zhang, Yinuo Xu, Bingxiang He, Chaojun Xiao, Xu Han

Public reference bibliography and cataloged PDF materials authored or published by Ziqing Qiao, Xiaoyue Xu, Sikui Zhang, Yinuo Xu, Bingxiang He, Chaojun Xiao, Xu Han.

Found 1 document(s) Page 1 of 1

Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law

Year: 2026 • Source: arxiv.org • Listed PDF

Long-context continual pre-training (LCCP) is widely used to improve long-context capability, but how its benefits scale with the number of tokens used for LCCP remains unclear. We investigate this question through model...