← All questions
EvaluationMedium· Prompt Engineering· Few-Shot Learning· Sensitivity Analysis

Few-shot is reported to reduce prompt sensitivity, and FormatSpread reports sensitivity persisting as you add shots. Which is wrong?

Few-shot prompting reduces sensitivity by adding margin to the correct continuation, but it does not eliminate it. Because softmax attention normalizes across demonstrations, the increments decay, meaning the sensitivity persists even as you add more shots. Therefore, few-shot prompting is a useful lever, but it is not a complete fix, and sensitivity measurement should still be performed.

Code playground (Python)