Hacker News new | past | comments | ask | show | jobs | submit login
Show HN: Inferrd – Heroku for Machine Learning (inferrd.com)
3 points by LucasLanglois 7 days ago | hide | past | favorite | 4 comments

Hey, Lucas here. I’m excited to share Inferrd along with my co-founder Theo. It’s a product we started working on after dealing with our fair share of deploying models on GPU in traditional clouds (GCP, AWS, Azure) for consulting contracts.

Hosting AI is challenging because it requires GPUs and most of the time, data scientists are left to design and build the infrastructure. Configuring Nvidia and Cuda is another issue that can consume days or weeks (add a few more weeks for TensorRT).

That’s why we built Inferrd, it’s a Heroku-style GPU hosting platform specifically designed for AI models. All the libraries are pre-configured, no cold start and out-of-the-box support for most major frameworks (spaCy, TensorFlow, PyTorch, Keras, Scikit, XGBoost). In addition, we leverage GPU sharing to provide very competitive pricing. Lastly, we provide key authentication, smooth scaling and monitoring tools.

AI hosting is a very interesting new space, and we’ll be around to answer any questions!

I suspect the brilliance/differentiating factor for your service is that you "leverage GPU sharing to provide very competitive pricing", and the "smooth scaling" part. Is that right?

That's one part of the answer.

The other is that you can use Inferrd from your notebook and have it running in 1mn.

I see, thanks!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact