Automated performance testing is one of the touchstones that is meant to enable the dream of continuous integration and delivery: Shifting left, catching performance defects early so they don’t become bigger and more complex at a later stage. When it comes to automating performance testing there are some things that can be done to add value, while others tend to re-enforce the old maxim that “Just because you can, does not mean you should”. Part of this presentation will be outlining how an over-reliance can result in catastrophic consequences and offering some insights and offering some advice on how to avoid this in your project.