← All questions
RAGVery Hard· Hallucination· Circuit Analysis· Resource Allocation

A researcher argues that since in-context learning is m...

While the circuit is real and explains why unseen identifiers work, copying is only one path among the (H + 1)L paths the residual stream expands into. Furthermore, induction heads copy only approximately, and causal evidence is limited to smaller models. If a per-query audit shows failures are concentrated in retrieval misses, the researcher’s proposal to move the budget is correct.

Code playground (Python)