It's effortful, time consuming, boring, and involves changes of behaviour, self image and thought processes, and involves potentially standing out against peers, family, friends, colleagues and industry culture.
If there were literally no down sides, everyone would do it by default.
If there were literally no down sides, everyone would do it by default.