179 questions
No questions match those filters.
← All questions
EvaluationHard· Scaling Laws· Regression Analysis
How would you detect that a scaling-law fit is wrong?
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansDetecting a poor scaling-law fit involves analyzing the residuals (L_hat - L_obs). If the residuals are not zero-mean or show a clear correlation with the input variables, the model is likely misspecified. A monotone sign pattern—where residuals are consistently positive for small models and negative for large ones—suggests that the optimizer has failed to find the global minimum. The standard fix is to use multi-start nonlinear regression, initialized near previous estimates, to ensure convergence to the same parameter values.