Hacker News new | comments | show | ask | jobs | submit login

Long ago, I have decided not to recommend a product whose manuals you couldn't see before buying it. It came from a huge disappointment over ATG's Dynamo web platform that led to a cancelled project and some lawyering. If we could have seen all the documentation, we'd have decided against it.

Benchmarking is the same - unless I can see independent benchmarks (ones not authorized or paid for the software maker, done based on publicly available knowledge on the platform) I'm not buying.

It is crummy that you can't read other peoples perf numbers, that being said, evaluation versions exist for a reason. No need to rely on other peoples generic benchmarks.


Not everyone has the expertise or the time to run their own extensive, comprehensive benchmark suite. It could be dangerous to do so for the uninitiated who may come to the wrong conclusions.

People should however be allowed to make mistakes.

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | DMCA | Apply to YC | Contact