If you own /usr/local, anything running with your privileges can affect the whole system. /usr/local/bin usually comes before the /usr/bin and /bin in PATH, so even system scripts that rely on other programs could be affected as they would run the /usr/local ones instead of the right ones.
