We only use chrome because Firefox struggled in the initial testing. Having said that, I haven't tried in anything other than chrome in ages and I'd wager the situation has changed a lot in the last couple of years.
That's one of the issue i have with SVG browser implementation varies so much. Our product that is performant in Chrome sucks in IE11
What's the slow bit in IE? Is it the svgs?