Studies suggest vitamin D deficiency can cause brain and nerve damage.
You can say the same thing for magnesium deficiency - it causes permanent damage over time. Furthermore, 75% of the population is deficient in it, and it's nearly impossible to detect and diagnose a deficiency. Your body doesn't tell you "hey, time to eat some magnesium" the way it tells you to eat food. Chances are you (yes, you) are deficient in magnesium, unless you take a supplement.
Yes, B12 deficiency is serious, but there are other equally important vitamins and minerals that even non-vegetarians are deficient in, whose symptoms are difficult to detect, and require supplementation to fix.
Vegetarian diets don't have the monopoly on required supplementation.