Writing performance tests – the pitfalls
Performance tests have some challenges you need to take into account when you write your tests to avoid having a lot of false positive results (not passing tests where the performance is actually acceptable).
The most common issues you will encounter are:
- How to manage the external systems: We know that external systems are very important in applications today, but it is not always trivial to have them during tests.
- How to be deterministic: Continuous integration/test platforms are often shared. How do you ensure you have the resources needed in order to have a deterministic execution time and to not be slown down, as another build is using all the available resources?
- How to handle the infrastructure: To do an end-to-end test, you need multiple injectors (clients) and probably multiple backend servers. How do you ensure you have them available without them being too expensive if you use cloud platforms such as Amazon Web Services (AWS)?
You can see the...