← All questions
RAGHard· Evaluation· Chunking Strategies· Recall

Semantic chunking lifted recall@5 by three points on ou...

Before deploying, you must investigate the composition of your evaluation set. If the set was constructed by concatenating unrelated documents, it creates artificially sharp topic boundaries that flatter semantic chunking techniques. You must determine if your production corpus actually contains these types of boundaries. If the production data is different, the observed performance gain may not translate to real-world usage.

Code playground (Python)