InstructGPT

Today is the second anniversary of the release of InstructGPT, the pioneer of modern large language models. Jim Fan introduced the importance of InstructGPT and said a few very interesting points about InstructGPT. He also showed a picture of the very classic three-step LLM training method in InstructGPT, and I also let GPT-4 explain it and put it below. InstructGPT pioneered a classic model training method: pre-training first, then supervised fine-tuning, and finally reinforcement learning based...