179 questions
No questions match those filters.
← All questions
EvaluationHard· Interpretability· Causal Tracing
An engineer says: we located this model’s induction heads, and on this answer the top one attends to chunk 4, so the answer is grounded in chunk 4. Do you accept that?
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansThe attention weight is not exclusive evidence of use. Because the final output is a margin over 1,024 head terms plus the direct path, one well-behaved addend does not determine the final sign. The definitive experiment is to remove the chunk and re-run the model to see if the output changes, as interpretability claims must be validated through causal intervention.