← All questions
Retrieval & EmbeddingsHard· SPLADE· Latency· Sparse Retrieval

We shipped SPLADE. Recall@1000 went up four points and...

The increase in recall and the spike in latency are linked by the same underlying mechanism: the expansion of the query representation. SPLADE increases the number of active, nonzero dimensions in the query vector compared to traditional methods.

Because each nonzero query dimension necessitates the traversal of an additional posting list, expanding from 8 terms to 100 terms effectively multiplies the number of traversals by 12.5. This increased computational load on the query side is the direct cause of the significant rise in p99 latency.

Code playground (Python)