On: Notes on training BERT from scratch on an 8GB consumer GPU

[Trapais]

Maybe they should support their modern consumer cards in ROCm. Maybe their ROCm documentation should not suck balls.

I'd say there is a reason AMD is a laughing stock in ML, but it's incorrect. There's not a reason, there are tons of reasons to never touch it.