> So, no matter where it is stored, it has to leave that store, get transformed and enriched and then run through an embeddings generator (ML inference).
Same for pretty much all the data in your database. It comes from an app, that does validation/editing/transforms. The benefit is that it's all together, can be atomic, only requires one query to get, update, and delete.
Vector databases are just normal databases with a vector index. There's no reason for you to have a specialized DB for it.
Also, embeddings aren't inference, it's a token lookup. There's no forward pass.
Same for pretty much all the data in your database. It comes from an app, that does validation/editing/transforms. The benefit is that it's all together, can be atomic, only requires one query to get, update, and delete.
Vector databases are just normal databases with a vector index. There's no reason for you to have a specialized DB for it.
Also, embeddings aren't inference, it's a token lookup. There's no forward pass.