LLM training data mixture optimization breaks when training pools shift — every prior proxy experiment becomes stale.
Author Name NARITA Yusuke (Visiting Fellow, RIETI) / AIHARA Shunsuke (Hanjuku Kaso Inc., ZOZO Technologies, Inc.) / SAITO Yuta (Hanjuku Kaso Inc., Tokyo Institute of Technology) / MATSUTANI Megumi ...