← All questions
Retrieval & EmbeddingsMedium· Vector Indexes· Memory Management· Quantization

How much memory does your vector index need?

The interviewer is testing your ability to compute index memory rather than looking it up. For example, a million 768-dimensional vectors in FP32 require approximately 3.07 GB, while the same set quantized requires roughly 96 MB. Being able to derive these figures ensures your design remains robust as parameters evolve.

Code playground (Python)