This is a 30B parameter model with 3B active. It should run performantly on a Ma... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

anon373839 83 days ago | parent | context | favorite | on: Cohere's First Model for Developers

This is a 30B parameter model with 3B active. It should run performantly on a Mac with > 48GB RAM at 8bit precision.

ltononro 83 days ago [–]

Well that is like 3 USD/hour if you run it on a rented gpu

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact