You have an 8k context window, a 2-second p95 budget, a...

When choosing between IRCoT and Self-Ask, one must derive the prefill costs for each. IRCoT involves a cumulative loop that increases prefill tokens, while Self-Ask is generally lighter. The decision should be based on whether the intermediate sub-answers can be compressed into a string that retains the required citation data for the final answer.