179 questions
No questions match those filters.
← All questions
Retrieval & EmbeddingsHard· SPLADE· Latency· Performance Tuning
How do you diagnose a significant latency increase afte...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansRecall and latency often move together in SPLADE, so this is typically not a bug but a consequence of query expansion. Each nonzero query dimension requires traversing another posting list. To diagnose, measure the average nonzeros for queries and documents separately. Proposed solutions include raising the query regularization parameter (λq), pruning the query vector to top-m dimensions at serve time, or considering SPLADE-doc to remove query expansion entirely.