Pests and Bugs sound alike?? They act alike too!!
Boris Beizer, in his book Software Testing Techniques (1990) coined the term pesticide paradox to describe the phenomenon that the more you test software, the more immune it becomes to your tests.
Just like, if you keep applying the same pesticide, the insects eventually build up resistance and the pesticide no longer works. Software undergoing the same repetitive tests build resistance to them, and they fail to catch more defects after that.
- Software undergoing the same repetitive tests eventually builds up resistance to them.
- As you run your tests multiple times, they stop being effective in catching bugs.
- Moreover, part of the new defects introduced into the system will not be caught by your existing tests and will be released onto the field.
Solution: Refurnish and Revise Test Materials regularly
In order to overcome the pesticide paradox, testers must regularly develop newer tests exercising the various parts of the system and their inter-connections to find additional defects.
Also, testers cannot forever rely on existing test techniques or methods and must be on the look out to continually improve upon existing methods to make testing more effective.
It is suggested to keep revisiting the test cases regularly and revising them. Though agile teams provide little spare time for such activities, but the testing team is bound to keep planning these exercises within the team in order to keep the best performance coming. A few ideas to achieve this:
- Brainstorming sessions – to think of more ideas around the same component testing
- Buddy Reviews – New joinees to the team are encouraged to give their fresh perspective to the existing test scenarios for the product, which might get some new cases added.
- Strike out older tests on functionalities that are changed / removed
- Build new tests from scratch if a major change is made in a component – to open a fresh perspective
This article has been recommended and used as a reference by HANNES LINDBLOM in his blog at https://konsultbolag1.se/bloggen/veckans-testartips-15-tur-genom-variation
2 thoughts on “Pesticide Paradox in Software Testing”
A very basic idea which you would think is obvious but very unknown to most of the developers/testers. Everyone think that good results from existing test suites means good quality while they fail to understand that 100% +ve result from test suites for more than a couple of cycles should raise eyebrows instead of giving a smile. If you are not being caught by the test cases then there is something that you are missing. Though its always a nightmare for a developer to write test case for every new feature he works on but slowly and steadily this habit needs to be built upon. A very good write up Nishi. Thumbs up 🙂
Thanks for the comments Satinder!