The registry is not very discoverable. However, once you discovered, a lot of customization can be had from running as little as a single registry script.
As a trivial example, remapping caps-lock to something sane was easier on the last few windows releases I tried (just run a registry script) than on any of the 'nixes I used in the same time period.
