Kunlun WanweiThe group recently announced through its official WeChat account thatBig ModelOn the first anniversary of its release, Tiangong Model 3.0 will officially begin public beta on April 17Public Beta, and will also selectfree and open source"Tiangong 3.0" uses 400 billion parameter MoE (mixed expert model).Officially stated that it is one of the largest MoE models in terms of model parameters and one of the strongest in performance in the world, performance exceeds Grok 1.0.
It is reported that compared with the previous generation 'Tiangong 2.0' MoE large model, 'Tiangong 3.0' has 'amazing' performance improvements in the fields of model semantic understanding, logical reasoning, and generalization, as well as versatility, uncertainty knowledge, and learning ability.Its model technology knowledge and ability have increased by more than 20%, and its mathematics/reasoning/coding/cultural and creative abilities have increased by more than 30%..
"Tiangong 3.0" also addsEnhanced search, research mode, code calling and chart drawing, multiple calls to online search, etc.and specifically trained the model's Agent capabilities. It can independently complete planning, calling, and combining external tools and information, and can fulfill various complex needs such as industry analysis and product comparison.
Tiangong Model 3.0Claimed to be the world's first multimodal "super model"It integrates multiple capabilities including AI search, AI writing, AI long text reading, AI dialogue, AI speech synthesis, AI image generation, AI comic creation, AI image recognition, AI music generation, AI code writing, and AI table generation. The official calls it a "super application in the era of big models."
In October last year, Kunlun Wanwei open-sourced the "Skywork" Skywork-13B series of billion-level large language models and also open-sourced a 600GB, 150B Tokens open-source Chinese data set.
Kunlun Wanwei's Skywork-13B series currently includes two models with 130 billion parameters:Skywork-13B-Base model, Skywork-13B-Math model, the open source address is as follows:
-
Skywork-13B download address (Model Scope):https://modelscope.cn/organization/skywork
-
Skywork-13B download address (GitHub):https://github.com/SkyworkAI/Skywork