← All questions
AgentsHard· System Design· Cost Optimization· Self-Reflection

A colleague wants to rip out the reflection tokens and...

The decision depends on what you are gating. If you are gating ‘is this passage worth using,’ an external critic is strictly better because it is cheaper and allows for independent release cadences. If you are gating ‘is this sentence I just wrote entailed by what I retrieved,’ an external document scorer cannot perform this task, and the coupling provided by reflection tokens is necessary for the capability.

Code playground (Python)