Google should sometimes just give people what they claim they want. "Be careful what you wish for". Unions often have "work to rule" - you do what you're paid to do and no more, and it's an effective method of industrial action.
If a newspaper site doesn't want Google to index them Google should just drop them. Maybe provide help about setting up robots.txt.
Does Google have a blog post about why they index pages behind a paywall, and why they're happy to not index pages behind paywalls? (I understand it as "we want to index stuff that people can get to. If they can't get to it we don't want to index it")
Or maybe Google should just give ads and paywalled content the same shaded background?
