← All questions
LLMOps & ProductionVery Hard· Indexing· Cost Optimization· System Architecture

Infra wants to freeze the graph index because a full re-extraction costs $2,850 and six hours; product wants same-day updates for a compliance SLA. Adjudicate.

The core issue is that the current design treats full reconstruction as the only update primitive. By moving to incremental, dual-level indexing, you only update touched entities. Alternatively, you can isolate the slow-changing, high-recurrence data in the graph index and leave fast-changing content in a vector index, which can be updated in seconds, satisfying both infrastructure costs and product SLAs.

Code playground (Python)