#grpo

Large Language Models

DPO or GRPO? Escaping SFT's Repetitive Output Trap in LLM Fine-Tuning

Your SFT-tuned model looks perfect on paper — loss converged, formats spot-on. Then production hits, and it churns out robotic repeats. Time for DPO or GRPO.

AI Research

TRL v1.0: The Post-Training Library That Bends But Doesn't Break

AI post-training libraries die fast if they can't adapt. TRL v1.0 doesn't just survive the chaos—it thrives on it, splitting stable APIs from bleeding-edge experiments.

Large Language Models

o3's 10x RL Compute Gambit: The Real State of LLM Reasoning Reinforcement

OpenAI's o3 didn't just scale — it poured 10x compute into reinforcement learning for reasoning, smashing benchmarks. Meanwhile, GPT-4.5's yawn proves scaling alone is tapped out.