Everything about Distributed Training and Efficient Finetuning

[pama]

https://sumanthrh.com/post/distributed-and-efficient-finetuning/

[pama]

This is an up to date discussion of useful techniques for training large models.