In a generative retriever, where does the index go?

Generative retrieval shifts the index from a standalone vector store into the model itself. With atomic identifiers, the index is essentially the output embedding matrix (N x d_model). With hierarchical identifiers, it becomes a much smaller output table paired with a cluster tree. This transition requires the model to memorize the corpus, which is achieved through specific training tasks.