← All questions
System DesignHard· Reranking· Retrieval· System Architecture

How do you decide between using a ColBERT-style retriev...

Do not defend ColBERT based on MRR@10, as a reranker will likely win that comparison. Instead, focus on the retrieval ceiling: a reranker cannot retrieve what the first stage missed. If the first stage’s recall is low, no reranker can recover the missing documents. If storage is the primary constraint, explore ways to pay it down, such as lower dimensions or residual compression, before defaulting to a reranker.

Code playground (Python)