Basic model structure

In the early hours of the morning, Alithong released the next generation of basic model structures, Qwen3-Next, and opened up the Qwen3-Next-80B-A3B series based on the architecture. According to official sources, it is believed that Context Length Scaling and Total Parameter Scaling are two major trends in the development of large models in the future. In order to further enhance the training and reasoning efficiency of the model under long context and large-scale general parameters, a new Qwen3-Next model structure was designed. I don't know