Yeah, my team of experienced devs were all surprised by this. To the source they went, and found it was true. Not that we'd generally end up hashing a URL, but still.
I'd suggest you assess first the amount of code that depends on java.net.URL both in Java SE itself and then in the ecosystem, before you can say it would be "easy" to remove java.net.URL.
Hint: same reasons java.util.Date, and java.util.Vector are still there.
Given a bunch of URL's, they may have a colliding hashcode just because they resolve to the same IP address. For example because they are all cloudflare websites that resolve to the same cloudflare endpoint.
java.net.URL was introduced in Java 1.0, the very first public release of Java back in 1996.
In 2001, Java 1.4 included a new class java.net.URI that addressed this and other improvements.
Since then, it is well known by average experienced Java developers to a) read javadocs, b) not use URL class, and c) use URI.
It's been 19 years this problem has been fixed.
As to why not remove it, I'd suggest to dig through the OpenJDK mailing list.
[1] https://news.ycombinator.com/item?id=21765788