← All questions
EvaluationMedium· Faithfulness· Factuality· LLM Evaluation

What is the difference between faithfulness and factual...

Faithfulness and factuality are distinct concepts in LLM evaluation. Faithfulness refers to the alignment between the generated output and the provided retrieved context. Because the context is present in the prompt, you can compute faithfulness per request in a production environment.

Factuality, conversely, refers to the truthfulness of the information relative to the external world. Since the system does not have access to the entire world as an oracle during inference, factuality cannot be computed in real-time and must be assessed offline using external verification sources.

Code playground (Python)