In an effort to reduce cost, increase speed to market and improve quality, many organizations look to the test center of excellence as a solution. Some do so without really understanding what it is, what the benefits are and how to get there. Before implementing a test center of excellence, it is important to debunk some myths surrounding them. Forgoing these fallacies will allow developers to understand what a test center of excellence is and what it is not. Once that is clear, the development team can determine if a test center of excellence could be beneficial to their organization.
Test CoE myth 1: A test center of excellence is just a term for outsourcing testing
In reality, a test center of excellence (CoE) is a framework of people, processes and technology governing how software testers deliver highly effective testing services to the greater organization. It is comprised of quality experts providing leadership and shared consulting services to ensure clearly established goals, well-defined processes, a governance mechanism and common tools and technology. Test CoE processes should be established by the organization, and the governance mechanism should not be outsourced, as this leads to miscommunication and mistakes.
Test CoE myth 2: Test centers of excellence require engaging offshore teams
Most test centers of excellence are built around knowledge, skills and resource sharing that allow for capacity management through the core/flex model. In the core/flex model, onsite test leads are aligned with and become subject matter experts in the organization's core business verticals. In addition to managing the project testing in their respective areas, the core test leaders become mentors for the flex team members.
Flex team members are deployed to and released from projects based on the project's staffing requirements. Although flex team members are not always on-site, they are also not always offshore. Offshore teams located in India or China are usually the most cost-effective; however, teams may also be located near shore in South America or in the United States or Canada.
Test CoE myth 3: Test centers of excellence only provide scalable test teams
Resource scalability through the core/flex model is a feature of a test CoE. However, a highly effective test CoE provides not only project testing services but also consultative services in test estimation, methodology and design, test environment and data management, and performance and functional test automation frameworks. Test engineers and test architects in specialties such as performance and load testing, functional automation, security and mobile device testing complete the core team. A very successful test CoE provides business value by consistently improving the efficiency and effectiveness of the entire test process.
The real challenge and rewards of a test center of excellence
A good test CoE can improve speed to market. At the same time, it can reduce cost and increase quality due to its focus on resource scalability and 24x7 availability; streamlined, efficient processes; and effective use of tools and automation. However, establishing a test CoE requires a substantial investment of time and money. The process must be run like a project with a sponsor in a leadership position, definition and establishment of quality process and roles. The development of automation frameworks and purchase of tools require a significant financial investment.
Therefore, it is critical to carefully assess whether the value of a test CoE will outweigh the costs to the organization. The first step in the evaluation process is to assess the test maturity and effectiveness of your current test organization. The assessment should focus on three areas: people, processes and tools.
Assess people with the following questions. Does your test organization have highly competent testers, a competency model and a plan for professional development? Do you have on staff or contract with mobile device test specialists skilled in automation, performance and load? Is the resource level appropriate to the volume of work, and is the volume of work steady or does it fluctuate? If the answers are primarily "no," a test CoE would be of value from a people standpoint.
Next, assess processes and tools. Does your organization have clearly established testing processes and procedures? Is there a test methodology that is consistently followed for every project? Are there established test roles including those with responsibility for managing overall test operations? Does your organization have a test automation strategy and framework, as well as the appropriate tools to provide efficient and effective testing? If the answers are primarily "no," then a team needs to be established to develop these processes as a first step to a test CoE.
In conclusion, a test CoE can provide scalable, efficient testing services; however, the true value of a test CoE lies in delivering business value through effective management and integration of people, processes and tools.
How to build a test center of excellence
An application performance CoE helps enterprise apps
A SOA CoE is key to success
When to start a new center of excellence