Your pipeline’s end-to-end accuracy dropped four points...

When an end-to-end accuracy metric drops, the first move is to resist immediate action and instead perform a mathematical decomposition of the metric. By using the formula A = hc1 + (1 - h)c0, you can isolate the impact of different query types and performance levels. For instance, a drop in accuracy could be caused by a high proportion of hard queries (h) with lower performance (c1), or a shift in the performance of easier queries (c0). Because these scenarios imply opposite investment strategies, identifying the root cause through this decomposition is essential before attempting to fix the pipeline.