What do you think of outsourcing specialty testing, such as performance testing? Will this make a team “less Agile” and if so, what are the risks of this approach?
As mentioned in the previous answer, in some cases the only way to get meaningful performance testing is to use a specialized performance testing provider. In Agile, we work in small increments, and usually we only plan for the next sprint or two. It’s critical to plan ahead for testing activities requiring outside help. During release or theme planning, the team should think through all four Agile Testing Quadrants (fig. 1), identify all testing activities that are required before release, and make sure they have all the people and resources to get these done at the right time. People and tools to do the testing are not the only issue. You may need large amounts of production-like test data, which could take a lot of time to create or obtain.
The “Agile” way to approach “Quadrant Four” aspects of quality is to think about them up front and do spikes if needed to prove that an architecture or design scales and provides acceptable response time. Whenever my team embarks on a new, complex theme, we come up with a design that we think will work. Then, two programmers pair on a “spike” -- they implement the design in code that will be thrown away. They do performance testing on the code, and decide whether the design provides acceptable performance. It may just need some tuning, or we may need to start all over with a new design. When you leave performance testing to the end of a project, it’s too late to start over. If the performance isn’t good enough, the whole project may fail.
Dig Deeper on Agile Software Development (Agile, Scrum, Extreme)
Related Q&A from Lisa Crispin
Agile leader Lisa Crispin explains a more organic, more Agile approach to test reporting. Continue Reading
When it comes to Agile planning, average time over many iterations is a more important metric than individual story estimates. Continue Reading
Most inexperienced Scrum teams overcommit on what they will deliver, and when. Agile leader Lisa Crispin says that does more harm than good. Continue Reading
Have a question for an expert?
Please add a title for your question
Get answers from a TechTarget expert on whatever's puzzling you.