Llama3.1Leaked! You heard it right, this one has 405 billion parametersOpen Source ModelIt's already causing a big bang on Reddit. This may have been the closest open source model to GPT-4o to date, and even surpassed it in some respects。
Llama3.1 byMetaDeveloped by (formerly Facebook)Large Language ModelsAlthough it has not been officially released yet, the leaked version has already caused a stir in the community. This model not only includes the base model, but also the benchmark results of 8B, 70B and the maximum parameter 405B.
Performance comparison: Llama3.1 vs GPT-4o
Even Llama3.1, version 70B, exceeded GPT-4o in a number of baseline tests, as compared to the leak. This is the first time that open source models have reached SOTA levels on multiple benchmarks, and it is amazing:free and open sourcePower is powerful!
Model highlights: multi-language support, richer training data
The Llama 3.1 model is trained using 15T+ tokens from public sources, and the pre-training data cutoff is December 2023. It supports not only English, but also multiple languages including French, German, Hindi, Italian, Portuguese, Spanish, and Thai. This makes it perform well in multilingual conversation use cases.
The Llama3.1 research team attaches great importance to the security of the model. They adopted a multi-faceted data collection method, combining artificially generated data with synthetic data to mitigate potential security risks. In addition, the model also introduced boundary prompts and adversarial prompts to enhance data quality control.
Model card source: https://pastebin.com/9jGkYbXY#google_vignette