← All questions
System DesignVery Hard· Constrained Decoding· Circuit Analysis· RAG

Research wants to map copying circuits to guarantee ver...

Copying is circuit-implemented and can be measured via the OV spectrum, but the eigenvalue evidence is correlational and per-model, making it fragile to base model swaps. Constrained decoding provides a hard, reliable guarantee at the sampler level. Use the circuit scan as a regression test, but reserve the circuit-based approach for cases where failures are paraphrased rather than verbatim misquotations, as constrained decoding cannot address paraphrasing.

Code playground (Python)