← All questions
RAGMedium· Evaluation· Contamination· Benchmarking

Your RAG pipeline barely beats the closed-book baseline...

When a RAG pipeline fails to significantly outperform a closed-book baseline, it is often due to contamination where the benchmark’s source corpus is already present in the model’s pre-training data. Before modifying the pipeline or reranker, you should test against a decontaminated or temporal slice of the data to ensure the comparison is fair.

Code playground (Python)