On: The Era of 1-bit LLMs: ternary parameters for cost...

[azinman2]

That's important for new applications to emerge where this happens on lots of data. You can't run LLMs at scale on tasks like Google might (every webpage) when the cost of each document is so high to process. Interactive chatbots are just the tip.