Transformer

Recently, Ashish Vaswani, the first author of the paper “Attention is All You Need” (presenting the Transformer framework), received an interview from Bloomberg and offered an in-depth reflection: the current AI development model, which is dominated by a small number of technocrats, may be stifling real technological breakthroughs. Vaswani argues that the huge business interests in AI have led to a few companies like Google and OpenAI investing in the existing Transformer model..