TelaMalloc: Efficient On-Chip Memory Allocation for Production ML Accelerators

[mlerner]

https://www.micahlerner.com/2023/04/16/telamalloc-efficient-on-chip-memory-allocation-for-production-machine-learning-accelerators.html

[mgraczyk]

I was reading through this and thinking "oh this sounds interesting and useful for my work", then I got to Figure 1 and though, hmm these diagrams look very familiar. When I saw "Pixel 6" in Figure 2 I realized oh, this is the allocator in the compiler I use to run models on Pixel!