← All questions
LLMOps & ProductionHard· Abstention· User Experience· Metrics

Your abstention rate is 54% and users are leaving. Brin...

Resist the urge to simply lower the threshold, as this directly trades off the safety you were tasked to protect. Instead, attack the cost of wrong answers by attaching checkable spans to the output. By increasing the open rate of these citations, you effectively lower the cost of a wrong answer, allowing for a lower threshold that recovers query volume without increasing the error rate. You must verify these citations with metrics like FActScore, as citations can appear on unsupported sentences.

Code playground (Python)