Hacker News new | past | comments | ask | show | jobs | submit login
Ask HN: AWS g6 instances loading into VRAM slowly?
3 points by teaearlgraycold 5 months ago | hide | past | favorite
I'm curious if anyone here would know what the bottleneck is when loading data into VRAM from CPU RAM on AWS. Myself and my teammates are seeing surprisingly slow load times for models. Our local training hardware doesn't have this issue. Would GCP be faster?



Consider applying for YC's W25 batch! Applications are open till Nov 12.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: