Hacker News new | past | comments | ask | show | jobs | submit login
Teaching and Assessing Property-Based Testing (brownplt.org)
42 points by luu 3 days ago | hide | past | favorite | 2 comments

In my opinion therer is a bigger problem of mutation testing being even less known and less used, even though it's more widely applicable and easier.

How do you personally use mutation testing? In my experience it gives noisy results, so it's most valuable when I have a lot of time to personally examine the output -- contrasted with tools like property testing which can be trivially integrated into an automated pipeline.

As one class of examples, a ton of numeric code works by iteratively finding better solutions till some stopping condition is met, and since such algorithms are by design robust to certain kinds of perturbations a mutation testing framework will find a ton of mutations which don't meaningfully affect the final output. Interpreting such a report requires spending time to figure out if any particular perturbation should or should not have been detected by your tests.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact