Exactly! This is part of a more fundamental problem with the whole concept of responsive web design... It can't be just about media queries. I blogged about this some time ago, and plan to amend with links to this article. Well done. Here's my post --
http://barkgolgafrincham.wordpress.com/2012/10/04/responsive...