ants open source high performance enhanced learning weight exchange framework Awex

According to the BLG, the ants group announced the Awex framework for the high performance of the open source hundreds of billions of parameters for enhanced learning weight exchange. It was described that in October of this year, two trillion-billion flagship models of parameters, including the non-thinking Ling-1T and the thinking model Ring-1T, were officially launched. Ring-1T, based on its self-researched high-performance weight exchange framework,Awex (Asystem Weight Exchange Framework), achieved a weight synchronisation of the hundreds of billion parametric levels in 5-10 seconds on thousands of calories of GPU clusters。

Search