I listened to a guy from Toastmasters once, and at the start of the speech he said, "Will you please pull me up if I say 'um' or 'ah' at any point?" And he didn't, over the course of an hour or so. The trick, apparently, is to speak deliberately and know what you're going to say before you say it.