The point here is not that any given site needs to be secure, but that by having all sites secure, the whole web is better off for it. The downside for you is that you'd need to do some extra work, but the upside is that you can enjoy a much more secure web. For everyone who doesn't have to deal with upgrading to https (which, is by very far most people who use toe web) it is only a good thing.
