I didn’t see that one coming
The world works best when QA professionals do not get surprised a lot.
Actually never would be just fine. After some time you really do see it all, right?
Wrong.
There are some laws of nature that we tend to forget, or just push aside, but always comes back, like a karmic
boomerang of truth. If your system is more than trivial, and you run a database profiler, you will learn something new.
If you run a profiler on your code and stress it, you will learn something new.
If you run your system on real world (“production”) data – you will learn something new.
Mainly, that you have some unexpected bugs.
Keeping it real
Real world data have three things going for it:
- There is a lot of it.
- It is diverse, and in it’s way, devious.
- It mirrors issues with parts of the system that are not currently under test, including 3rd party issues.
- If your system has elements open to the world, you get calls that are invalid in just any permutation you can come up with.
Recent Comments