This definitely already exists and is open source, I just forgot the name: It was a software testing tool (probably for Python but could've been for another language) that introduced random modifications to your code so you could see which parts were actually covered by your tests - the idea being that significantly changing a line should make at least one test fail, otherwise you can't say that that line is really covered, even if it is executed during a test run. It also had some clever ways of determining what to change in which ways because obviously this type of testing is a lot more computation-intensive than regular testing, and even more so if you "brute force" it.

Does anyone remember the name?


Nevermind, I found it: https://pypi.org/project/MutPy/

And the general concept is called mutation testing, apparently.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.