Hacker News new | comments | ask | show | jobs | submit login

Pretty much all browser vendors agree SunSpider is a bad benchmark, but yet it keeps getting used and abused. All vendors have tweaked their JS engine for SunSpider itself.

Dromaeo is a much better benchmark suite in that it tests actual DOM things rather than pure language stuff. Kraken (also by Moz) also attempts to focus on webapp usecases rather than doing billions of regexes per second.




> Pretty much all browser vendors agree SunSpider is a bad benchmark, but yet it keeps getting used and abused. All vendors have tweaked their JS engine for SunSpider itself.

Still, there is a gap between tweaking the JS engine and running completely different code (a gap which most GPU makers jumped over without hesitating a few years ago, but it's annoying to see the issue crop up again)


Testing DOM performance is a very different beast from testing JS engine performance.

For example, DOM-based tests are useless when trying to compare Node.js performance against other JS engines.


There's a decent Microsoft blog post explaining which aspects of browser performance the different benchmarks test:

http://blogs.msdn.com/b/ie/archive/2010/09/14/performance-wh...

On SunSpider: "The WebKit SunSpider tests exercise less than 10% of the API’s available from JavaScript and many of the tests loop through the same code thousands of times. This approach is not representative of real world scenarios and favors some JavaScript engine architectures over others."


About the Dromaeo test: IE could call CAPICOM to deal with AES, Base64, RSA in browser, which is super fast.

And personally I think all browsers could just expose an API for these kinds of encryption and computing-heavy stuff, like secure random seeds, etc. Implementing those in Javascript is just a temporary solution.


I believe that we need as DOM+js as pure js benchmarks.





Applications are open for YC Summer 2019

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact

Search: