Databricks

Databricks recently launched a general-purpose large language model DBRX, claiming to be "the most powerful open source AI currently available", and is said to have surpassed "all open source models on the market" in various benchmarks. According to the official press release, DBRX is a large language model based on Transformer, using the MoE (Mixture of Experts) architecture, with 132 billion parameters, and pre-trained on 12T Token source data. Researchers tested this model and found that compared with the market...

Startup Databricks recently announced the launch of the open source AI model DBRX, claiming that it is the world's most powerful open source large-scale language model to date, more powerful than Meta's Llama 2. DBRX uses a transformer architecture, contains 132 billion parameters, and is composed of 16 expert networks. Each inference uses 4 of the expert networks, activating 36 billion parameters. Databricks introduced in a company blog post that in terms of language understanding, programming, mathematics and logic...