← All questions
RAGMedium· System Design· Evaluation· Engineering Trade-offs

How do you decide between shipping a post-hoc citation...

Shipping a post-hoc citation search is faster but may provide a false sense of security if the citations are not grounded in the generation process. Before deciding on the implementation, you must measure the discriminating power of the citations. If the rate of citations for correct sentences is nearly identical to the rate for incorrect sentences, the post-hoc approach is merely a UI feature rather than a verification tool. This data should be weighed against the significant engineering cost of implementing retrieval-conditioned generation.

Code playground (Python)