Pepsi model

Yesterday, the Grinch Model team officially launched the first flagship non-thinking model of the Ling 2.0 series -- Ling-1T. It was described that the model was based on the Ling 2.0 architecture and had a total parameter size of 1T, each token activated about 50B parameters and completed pre-training on high-quality language above 20T token to support the highest 128K context window. According to the official presentation, Ling-1T shows the lead in a number of difficult benchmark tests such as code generation, software development, competitive mathematics, and logical reasoning..