Data warehouse/BI performance testing tool recommendations

Data warehouse/BI performance testing tool recommendations

What testing tool would you recommend for performance testing in a Data Warehouse/BI space?

    Requires Free Membership to View

    When you register, you'll receive targeted emails designed to keep you informed of the most relevant information on Agile development, application security, testing & QA, software requirements, and more.

    Hannah Smalltree, Editorial Director

    By submitting your registration information to SearchSoftwareQuality.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchSoftwareQuality.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

For each of the data warehouse and business intelligence implementations that I've been involved in were finalized in a similar fashion. The load testing for the data warehouses, databases, ETLs, etc, have been done using simple monitoring tools and some script code for seeding data, test setup, and execution. I've not seen many large commercial tools used in that space, unless it was a database or network monitoring tool that the company already had. Performance testing the data warehouse is typically fairly straightforward. It has more to do with the data than it does the tools you're using.

For the business intelligence side of the project, running canned reports, ad hoc reporting, multi-user load, is where you tend to find some of the more traditional performance testing tools come into play. This testing tends to look similar to other performance testing efforts. The big tool vendors HP, IBM, Microsoft and the like, all have a place based on the technologies your business intelligence solution leverages. Open source tools like JMeter and OpenSTA, can also be used for some aspects of the testing depending on complexity and/or technology constraints.

I've found with business intelligence testing, that the data still has a lot to do with your scenarios. So while you're likely adding an element of load, you're still likely going to be doing a lot of data staging/seeding. Any tool that is compatible with your business intelligence interface is likely to do the trick for you.

This was first published in October 2009