We already support vector stores! If you go to https://lastmileai.dev/models, you can New > "Tune new model", which under the covers creates embeddings for your data (either file upload or scraped from a website). You get a new "Model Fork" from this, which you can then use in a Workbook.
We're working on more complex scenarios with vector stores, including API integrations.