{"id":12976,"date":"2024-06-12T13:56:40","date_gmt":"2024-06-12T05:56:40","guid":{"rendered":"https:\/\/www.1ai.net\/?p=12976"},"modified":"2024-06-12T13:56:40","modified_gmt":"2024-06-12T05:56:40","slug":"%e8%8b%b9%e6%9e%9cai%e5%ae%98%e6%96%b9%e8%af%a6%e8%a7%a3%ef%bc%9aapple-intelligence-%e6%9c%ac%e5%9c%b0-30-%e4%ba%bf%e5%8f%82%e6%95%b0%e6%a8%a1%e5%9e%8b%ef%bc%8c%e4%ba%91%e7%ab%af","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/12976.html","title":{"rendered":"Apple&#039;s &quot;AI&quot; official explanation: Apple Intelligence local 3 billion parameter model, cloud based on Apple chip server"},"content":{"rendered":"<p data-vmark=\"1bea\"><a href=\"https:\/\/www.1ai.net\/en\/tag\/%e8%8b%b9%e6%9e%9c\" title=\"[View articles tagged with [apple]]\" target=\"_blank\" >apple<\/a>At yesterday&#039;s WWDC24, it was announced\u00a0<a href=\"https:\/\/www.1ai.net\/en\/tag\/apple-intelligence\" title=\"_Other Organiser\" target=\"_blank\" >Apple Intelligence<\/a>(Apple Smart) will be\u00a0<a href=\"https:\/\/www.1ai.net\/en\/tag\/iphone\" title=\"_Other Organiser\" target=\"_blank\" >iPhone<\/a>, Mac and other devices introduce a series of AI functions.<\/p>\n<p data-vmark=\"a5df\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12977\" title=\"75bd6223-c770-4949-8c32-d28c0cfab065\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/75bd6223-c770-4949-8c32-d28c0cfab065.png\" alt=\"75bd6223-c770-4949-8c32-d28c0cfab065\" width=\"1291\" height=\"704\" \/><\/p>\n<p data-vmark=\"2008\">Subsequently, Apple&#039;s machine learning official website released detailed information about Apple Intelligence. According to Apple&#039;s official introduction, Apple Intelligence has two basic models:<\/p>\n<ul class=\"list-paddingleft-2\">\n<li>\n<p data-vmark=\"2519\">Local Model:<span class=\"accentTextColor\">On-device language model with approximately 3 billion parameters<\/span>, the test score is higher than many open source models with 7 billion parameters (Mistral-7B or Gemma-7B);<\/p>\n<\/li>\n<li>\n<p data-vmark=\"7b15\">Cloud Model: A larger cloud-based language model that can be run on Apple chip servers through private cloud computing.<\/p>\n<\/li>\n<\/ul>\n<p data-vmark=\"82f0\">Apple said that Apple Intelligence consists of multiple high-performance generative models that are specifically tailored to users&#039; daily tasks and can dynamically adapt to their current activities. The basic models built into Apple Intelligence are fine-tuned for user experience, such as writing and refining text, prioritizing and summarizing notifications, creating interesting images for users&#039; conversations with family and friends, and taking in-app actions to simplify interactions between apps.<\/p>\n<p data-vmark=\"2a9a\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12978\" title=\"f03e43d6-2b3b-4ffb-9558-a3bec26562c1\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/f03e43d6-2b3b-4ffb-9558-a3bec26562c1.png\" alt=\"f03e43d6-2b3b-4ffb-9558-a3bec26562c1\" width=\"1188\" height=\"372\" \/><\/p>\n<p data-vmark=\"b146\">In terms of pre-training, Apple&#039;s base model is trained on the AXLearn framework, an open source project released by Apple in 2023. It is built on JAX and XLA, enabling Apple to train models scalably on a variety of training hardware and cloud platforms, including TPUs as well as cloud and local GPUs.<\/p>\n<p data-vmark=\"42d1\">IT Home noted that Apple promised that when training the basic model,<span class=\"accentTextColor\">The company never uses users&#039; private personal data or user interactions and uses filters to remove personally identifiable information that is publicly available on the Internet.<\/span>, such as Social Security and credit card numbers. Apple also filtered profanity and other low-quality content to prevent it from being included in the training corpus. In addition to filtering, Apple also performed data extraction, deduplication, and applied model-based classifiers to identify high-quality documents.<\/p>\n<p data-vmark=\"fd4a\">In terms of optimization, Apple uses grouped-query-attention on both the device-side model and the server-side model. The on-device model uses a vocabulary size of 49K, while the server model uses a vocabulary size of 100K, which includes additional language and technology tags.<\/p>\n<p data-vmark=\"3490\">Through optimization, Apple claims to\u00a0<a class=\"s_tag\" href=\"https:\/\/iphone.ithome.com\/\" target=\"_blank\" rel=\"noopener\">iPhone 15 Pro<\/a>\u00a0superior,<span class=\"accentTextColor\">Able to achieve a first token latency of approximately 0.6 milliseconds per prompt token and a generation rate of 30 tokens per second<\/span>.<\/p>\n<p data-vmark=\"74d4\">In the instruction trace evaluation (IFEval) test, Apple&#039;s local model performed better than models including Phi-3-mini, Mistral-7B and Gemma-7B, and was not inferior to DBRX-Instruct, Mixtral-8x22B and GPT-3.5-Turbo; while the level of the cloud model was basically on par with GPT-4-Turbo.<\/p>\n<p data-vmark=\"a2f1\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12979\" title=\"78df7be6-9d85-4085-9463-fffd8c2ae6ff\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/78df7be6-9d85-4085-9463-fffd8c2ae6ff.png\" alt=\"78df7be6-9d85-4085-9463-fffd8c2ae6ff\" width=\"1153\" height=\"807\" \/><\/p>\n<p data-vmark=\"a143\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12980\" title=\"d0816f0a-c12c-4f9e-ada1-2606db602a3d\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/d0816f0a-c12c-4f9e-ada1-2606db602a3d.png\" alt=\"d0816f0a-c12c-4f9e-ada1-2606db602a3d\" width=\"1150\" height=\"794\" \/><\/p>\n<p data-vmark=\"9259\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12981\" title=\"f73b1ea7-a372-4e65-a786-71d491b1d9be\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/f73b1ea7-a372-4e65-a786-71d491b1d9be.png\" alt=\"f73b1ea7-a372-4e65-a786-71d491b1d9be\" width=\"1154\" height=\"469\" \/><\/p>\n<p data-vmark=\"92a5\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12982\" title=\"1b2dfef5-fcb3-4655-b6c9-b5f9504121ab\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/1b2dfef5-fcb3-4655-b6c9-b5f9504121ab.png\" alt=\"1b2dfef5-fcb3-4655-b6c9-b5f9504121ab\" width=\"1141\" height=\"475\" \/><\/p>\n<p data-vmark=\"9639\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12983\" title=\"3a26b0a7-6e81-4352-a805-9938cfdf7153\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/06\/3a26b0a7-6e81-4352-a805-9938cfdf7153.png\" alt=\"3a26b0a7-6e81-4352-a805-9938cfdf7153\" width=\"1094\" height=\"446\" \/><\/p>\n<p data-vmark=\"86b1\">Apple plans to launch this summer <a href=\"https:\/\/www.1ai.net\/en\/tag\/ios\" title=\"_Other Organiser\" target=\"_blank\" >iOS<\/a> 18. Apple Intelligence will be opened in the iPadOS 18 and macOS Sequoia beta versions, and will then be open to the public in the form of beta versions this fall, but some features, more languages, and platform support will have to wait until next year.<\/p>\n<p data-vmark=\"6b35\">Apple Intelligence is free to use, but is limited to devices with an A17 Pro chip or any M-series chip. This means that to use these features, you need an iPhone 15 Pro or iPhone 15 Pro Max, and the upcoming iPhone 16 series will also support Apple Intelligence.<\/p>\n<p data-vmark=\"d96f\">On the Mac side, you need a Mac with an M1 or later, and for iPad, you need an iPad Pro or iPad Air with an M1 chip or later.<\/p>","protected":false},"excerpt":{"rendered":"<p>Apple heavily announced Apple Intelligence at WWDC24 yesterday, which will introduce a range of AI features to devices like the iPhone and Mac. Subsequently, Apple's machine learning website published details of Apple Intelligence. According to Apple's official introduction, Apple Intelligence has two basic models: the local model: a language model with about 3 billion parameters on the device, with higher test scores than many open-source models with 7 billion parameters (Mistral-7B or Gemma-7B); and the model in the cloud: a larger cloud language model that can be computed in a private cloud and run on Apple's chip servers. models.<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[3024,869,583,345],"collection":[],"class_list":["post-12976","post","type-post","status-publish","format-standard","hentry","category-news","tag-apple-intelligence","tag-ios","tag-iphone","tag-345"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/12976","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=12976"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/12976\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=12976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=12976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=12976"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=12976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}