← All questions
RAGHard· Reranking· Context Window· Retrieval

A colleague proposes dropping the reranker and moving t...

The proposal treats retrieval (R) as equivalent to answer accuracy (A). However, utilization decays as the passage count increases. Dropping the reranker lowers the signal-to-noise ratio (μ) while increasing k, which moves both factors in the wrong direction. The recommended experiment is to fix the gold passage at one position and sweep the distractor count at k values of 5, 20, 100, and 500. If the utilization curve is flat out to k=500, the proposal is valid; otherwise, it is likely to underperform.

Code playground (Python)