Rubrics
August 12, 2025
Pre-training is about making AI correct, post-training is about making AI helpful1. That helpfulness is (primarily) shaped by reinforcement learning. RL for LLMs really took off with RLHF (RL from Human Feedback), which trained based on the score from a reward model.
-
Correct in predicting the next token, and helpful, honest and harmless, specifically. ↩

