Why do modern models like Llama 3 train at 40:1 or high...

While Chinchilla provides the optimal ratio for minimizing loss per training FLOP, modern production models prioritize inference efficiency. Because inference costs scale with every query, over-training a smaller model is a strategic trade-off: it increases the one-time training investment but results in a smaller, more efficient model that provides permanent savings during the serving phase.