That was my experience too... but after clicking around for a while & then going back to the App Store prefpane, I did see a padlock (unlocked) on the App Store prefpane. I haven't been able to reproduce it again, but it seems there's some kind of bug there even on El Capitan.
Other panes validate the password correctly