Previously, the paper “Attention is All You Need” Transformer ) Ashish Vaswani I was interviewed by Bloomberg, and I've come up with an in-depth reflection: AI Development models may be suffocating real technological breakthroughs。
Vaswani argues that the significant business interests in the AI domain have led to a few companies like Google and OpenAI investing in incremental improvements to existing Transformer models rather than exploring new and potentially revolutionary paths. The essence of this "arms race" is commercial competition, not pure scientific exploration。
The industry's popular belief in the Scaling Laws - that is, to invest more in data and data, the model becomes stronger. However, with the release of the much-anticipated GPT-5, its "squeezed toothpaste" upgrade was seen by many experts as a sign of diminishing returns from the law。
But Vaswani believes it is too early to conclude that progress on AI has stalled. However, he also indicated that the discussions following the publication of GPT-5 reinforced his concerns about the way artificial intelligence is developed。
At the same time, he believes that the application of artificial intelligence in areas such as education and health care has real science to pursue"WE CAN'T LET THE CLOSED AI DEVELOPMENT STOP US FROM EXPLORING THESE NEW FRONTIER AREAS. I'M SORRY