← All questions
RAGHard· Retrieval & Embeddings· Prompt Engineering· System Design

The retrieval lead wants your four demonstrations delet...

Do not argue based on priorities. Since demonstrations and retrieved chunks compete for the same prefill FLOPs and KV bytes, the trade-off is mathematically decidable. Demonstrations are nearly free under prefix caching, while every retrieved chunk incurs a cost on every request. Propose an experiment measuring both grounded accuracy and sensitivity, as deleting demonstrations may introduce variance that recall metrics fail to capture.

Code playground (Python)