Huawei Announces Open Source Pangu 7B Dense and 72B Hybrid Expert Models

June 30th.HuaweiToday's official announcementOpen SourcePangu (creator of the universe in Chinese mythology) Dense model with 7 billion parameters, Pangu Pro MoE 72 billion parametershybrid expert modeland Rise-based model inference techniques.

Huawei said, "This move is another key initiative for Huawei to practice the Rise ecological strategy, to promote the research and innovative development of big model technology, and to accelerate the application and value creation of AI in thousands of industries."

• Pangu Pro MoE 72B model weights, underlying inference code, is now officially available on the open source platform.
• Rise-based inference code for ultra-large-scale MoE models has been officially launched on the open source platform.
• The Pangu 7B correlation model weighting and inference code will be available on the open source platform in the near future.

1AI Attached open source address:

https://gitcode.com/ascend-tribe