Hacker News new | past | comments | ask | show | jobs | submit login
Set up the CTRL text-generating model on GCE with just a few console commands (github.com)
43 points by minimaxir 9 months ago | hide | past | favorite | 4 comments



This repo is the promised followup to my comment on the CTRL submission yesterday which linked to examples I made during testing: https://news.ycombinator.com/item?id=20948760


Thanks! Stupid question: if I don't want to spend fifty cents an hour to play with it, and have a machine with lots of RAM, is it possible to hold the model in RAM instead (rather than VRAM)? I'm sure this would be a serious slow-down, but it seems possible?


It should be possible to run the model on a CPU, but I haven't tested it.


Attempted getting CTRL going myself yesterday to no avail, and subsequently was refreshing your twitter this morning waiting for this :) Thank you!




Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact

Search: