https://x.com/realGeorgeHotz/status/1819963680739512550
> This is one of the coolest papers I've seen in a while. "Self-Compressing Neural Networks" is dynamic quantization-aware training that puts size (in bytes) of the model in the loss! > My implementation (in @__tinygrad__):
https://github.com/geohot/ai-notebooks/blob/master/mnist_sel...
https://x.com/realGeorgeHotz/status/1819963680739512550
> This is one of the coolest papers I've seen in a while. "Self-Compressing Neural Networks" is dynamic quantization-aware training that puts size (in bytes) of the model in the loss! > My implementation (in @__tinygrad__):
https://github.com/geohot/ai-notebooks/blob/master/mnist_sel...