In 5 years you might look back and realize you no longer write browser-specific code any more.
We said the same thing when IE started losing market share a decade ago.
The problem is, everyone who makes a browser thinks they have the best ideas in the world, and then impliment them, but their users never blame the browser.
If someone is trying to access your site and it breaks, do you really think they're going to say, "dang, I should really tell Chrome to fix their incompatibility".
No, they will always assume the error lies with the site owner.
Are you old enough to remember the "best viewed with Netscape" badges that were everywhere in the 90s?
Unless in 5 years we have only Chrome left, then surely.