{"id":42806,"date":"2025-09-11T11:55:08","date_gmt":"2025-09-11T03:55:08","guid":{"rendered":"https:\/\/www.1ai.net\/?p=42806"},"modified":"2025-09-11T11:55:08","modified_gmt":"2025-09-11T03:55:08","slug":"transformer-%e4%bd%9c%e8%80%85%ef%bc%9a%e6%88%91%e4%bb%ac%e5%8f%af%e8%83%bd%e8%b5%b0%e9%94%99%e4%ba%86-ai-%e5%8f%91%e5%b1%95%e7%9a%84%e8%b7%af","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/42806.html","title":{"rendered":"Transformer author: We may have been wrong about AI development"},"content":{"rendered":"<p>Previously, the paper \u201cAttention is All You Need\u201d <a href=\"https:\/\/www.1ai.net\/en\/tag\/transformer\" title=\"_Other Organiser\" target=\"_blank\" >Transformer<\/a> ) <a href=\"https:\/\/www.1ai.net\/en\/tag\/ashish-vaswani\" title=\"_Other Organiser\" target=\"_blank\" >Ashish Vaswani<\/a> I was interviewed by Bloomberg, and I've come up with an in-depth reflection: <a href=\"https:\/\/www.1ai.net\/en\/tag\/ai\" title=\"[View articles tagged with [AI]]\" target=\"_blank\" >AI<\/a> Development models may be suffocating real technological breakthroughs\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-42807\" title=\"0196c78dj00t2eo6n014fd000u000km\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2025\/09\/0196c78dj00t2eo6n014fd000u000k0m.jpg\" alt=\"0196c78dj00t2eo6n014fd000u000km\" width=\"1080\" height=\"720\" \/><\/p>\n<p>Vaswani argues that the significant business interests in the AI domain have led to a few companies like Google and OpenAI investing in incremental improvements to existing Transformer models rather than exploring new and potentially revolutionary paths. The essence of this \"arms race\" is commercial competition, not pure scientific exploration\u3002<\/p>\n<p>The industry's popular belief in the Scaling Laws - that is, to invest more in data and data, the model becomes stronger. However, with the release of the much-anticipated GPT-5, its \"squeezed toothpaste\" upgrade was seen by many experts as a sign of diminishing returns from the law\u3002<\/p>\n<p>But Vaswani believes it is too early to conclude that progress on AI has stalled. However, he also indicated that the discussions following the publication of GPT-5 reinforced his concerns about the way artificial intelligence is developed\u3002<\/p>\n<p>At the same time, he believes that the application of artificial intelligence in areas such as education and health care has real science to pursue<strong>\"WE CAN'T LET THE CLOSED AI DEVELOPMENT STOP US FROM EXPLORING THESE NEW FRONTIER AREAS. I'M SORRY<\/strong><\/p>","protected":false},"excerpt":{"rendered":"<p>Recently, Ashish Vaswani, the first author of the paper \u201cAttention is All You Need\u201d (presenting the Transformer framework), received an interview from Bloomberg and offered an in-depth reflection: the current AI development model, which is dominated by a small number of technocrats, may be stifling real technological breakthroughs. Vaswani argues that the significant business interests in the AI domain have led to a few companies like Google and OpenAI investing in incremental improvements to existing Transformer models rather than exploring new and potentially revolutionary paths. The essence of this \"arms race\" is commercial competition, not pure scientific exploration. Industry<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[411,7581,7580],"collection":[],"class_list":["post-42806","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-ashish-vaswani","tag-transformer"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/42806","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=42806"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/42806\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=42806"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=42806"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=42806"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=42806"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}