← All questions
Training & Fine-tuningMedium· Reinforcement Learning· Policy Optimization

How do you choose between different RL objectives like...

Both Kimi K1.5 and DeepSeek R1 converge to similar structures—policy gradients scaled by baselined rewards with regularization. Empirical differences are largely driven by data quality and reward design rather than the specific objective. In practice, start with GRPO for familiarity, add a length reward after initial convergence, and remove standard deviation normalization if training instability is observed on near-uniform reward groups.

Code playground (Python)