OpenELM

Recently, an investigation revealed that several tech giants, including Apple, used YouTube video subtitles to train AI models. The data covered more than 170,000 videos, including content from well-known creators such as MKBHD and Mr. Beast. Apple used this data to train its open source model OpenELM, which was released in April this year. In response, Apple recently clarified that OpenELM was not used in any of its AI or machine learning features, including Apple Intelligence. Apple strongly…

Prior to WWDC24, Apple released an "efficient language model with an open source training and inference framework" on the Hugging Face platform called OpenELM. Of course, this is an open source language model, and the source code, as well as pre-trained model weights and training recipes, are available on Apple's Github repository at The source code, as well as pre-trained model weights and training recipes, are available in the Apple Github repository. The translation of the official synopsis is as follows: Reproducibility and transparency of large-scale language models are critical to advancing open research, ensuring credibility of results, and investigating data and model biases and potential risks. To this end, we release OpenELM,...