Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
dr_kiszonka
on Dec 10, 2023
|
parent
|
context
|
favorite
| on:
Ask HN: What's the best hardware to run small/medi...
Possibly the easiest way would be to run them in a notebook on Amazon SageMaker.
https://aws.amazon.com/sagemaker/notebooks/
dvfjsdhgfv
on Dec 10, 2023
[–]
So you just start a notebook and then what?
dr_kiszonka
on Dec 10, 2023
|
parent
[–]
You then download a model you want, say, Llama 2. Install a Python package to interact with the model (possibly `pip install llama-cpp-python`) and have fun.
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
https://aws.amazon.com/sagemaker/notebooks/