Jason Wei, a core OpenAI researcher who was just blasted out of the company: the boundaries of RL

THE “CERTIFICATE LAW” POINTS OUT THAT THE EASE WITH WHICH AN AI RESOLVES A MISSION IS PROPORTIONAL TO ITS PROBABILITIES, RATHER THAN TO THE COMPLEXITY OF THE MISSION ITSELF; THAT CERTIFIABILITY CONSISTS OF FIVE KEY ATTRIBUTES: OBJECTIVE TRUTH, RAPID VALIDATION, SCALABLE AUTHENTICATION, LOW NOISE AND CONTINUOUS REWARD; AND THAT ANY PROBLEM THAT MEETS THESE FIVE ATTRIBUTES WILL BE SOLVED BY AI IN THE FUTURE, WHICH WILL CREATE AN “INTELLECTUAL FRONT LINE” AND THAT AI WILL BE MORE INTELLIGENT IN A VERIFIABLE MISSION。