Xiaomi's First Big Model of Inference Xiaomi MiMo Open Source

Xiaomi has open sourced its first large inference model, Xiaomi MiMo, with a parameter size of 7B, which has outperformed several well-known models in mathematical inference and code competition evaluations.MiMo significantly improves inference capabilities through innovative pre-training and post-training strategies, including 200B inference data synthesis and three-stage training, as well as reinforcement learning optimizations. The full range of MiMo-7B models is available at HuggingFace. The technical report is available at: https://github.com/XiaomiMiMo/MiMo/blob/main/MiMo-7B-Technical-Report.pdf