← All questions
RAGMedium· Evaluation· Ablation· Reliability

You run a remove-the-evidence ablation and find that re...

First, rule out noise by checking against the resampled variance floor. If the improvement is significant, it indicates the document is actively harmful, acting as a ‘one-bad-document’ pattern that degrades accuracy. Instead of treating it as a decorative citation, you should demote the source’s reliability weight to prevent it from negatively influencing future generations.

Code playground (Python)