← All questions
EvaluationHard· Policy· Risk Management· Thresholding

How do you set a policy for a faithfulness checker thre...

A single global threshold is rarely the right solution for complex generation tasks. Instead, define the policy based on the harm profile of the application. For high-stakes domains like medical or legal records, the threshold should be strict. For lower-stakes tasks like support-ticket summaries, you can allow more slack for bridging inferences. The goal is to block harmful hallucinations while allowing the model to perform useful, natural summarization.

Code playground (Python)