A few days ago,OpenAI Co-FounderAndrej Karpathy, former head of AI at Tesla, gave a personal talk at Y Combinator's AI Startup Academy event.
In this talk, Karpathy introduced the concept of "Software 3.0 Era".He believes that natural language is replacing traditional code and that large-scale language models (LLMs) are becoming the new 'universal computers'.
Karpathy points out that in Software 3.0, natural language (such as English) will serve as the "programming interface" that gives commands directly to the big language model and lets the model do all the rest of the work itself, which Karpathy says is not an iteration of the tool, but a "fundamental change".
At the same time, Karpathy also suggests that big language models have the properties of utilities, fabs, and operating systems. For example, "fab": the huge amount of arithmetic power and R&D barriers to train big models make a few labs become the new "chip makers".
In addition, Karpathy looks ahead to AI Agent（The Future of Intelligence. Agents, he says, are neither humans nor traditional programs, but rather new "consumers and manipulators of digital information. He further explains, "Because Agents require us to redesign documents, interfaces, and even network protocols to provide them with 'native' content that is readable and executable.