Home > Ask the Software Quality Experts > Software Testing and Quality Assurance Questions & Answers > Trace matrix as an indicator of test coverage
Ask The Software Quality Expert: Questions & Answers
EMAIL THIS

Trace matrix as an indicator of test coverage

Karen N. Johnson EXPERT RESPONSE FROM: Karen N. Johnson

Pose a Question
Other Software Quality Categories
Meet all Software Quality Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 13 February 2007
Do you believe in using the trace matrix as the best indicator of test coverage?


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   



RELATED CONTENT
Software Testing and Quality Assurance
Why do performance testers write new scripts so often?
How to create performance testing workload models
Fixing Web application performance troubleshooting problems
Expert advises on implementation of Selenium IDE for effective software testing
When should regression testing occur in an automated test plan?
Achieving peak performance in integration testing
Getting answers about OpenSTA script problems
Defining core software regression tests
Breaking in functionality on UI application pages
Where to find good methodology guides for software testing

Software testing tools and frameworks
Performance testing tools - Commercial, less expensive and free
Software Testing Ezines
New IBM Rational, Tivoli integrated tools pair development with IT
STPCon: Do reality checks on performance test products, panelists advise
Demo: Using WebGoat, a free software testing tool
Getting answers about OpenSTA script problems
Defining core software regression tests
Selecting the best tool for stress and load testing
Required prerequisites for performance testing
Surgient 7's self-provisioning promises software testers quick IT resource access

Advice from Karen N. Johnson
How testers can convince developers of software errors
Should you retest closed defects during regression testing?
Eliminating testing environment troubles
Do software testers need developer experience?
Software testing best practices vary by context
Functional testing: Unit testing, integration testing and beyond
Building automated tests for legacy applications
The benefits of user acceptance testing
The scope of user acceptance testing
Regression testing: How to select test cases

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
JUnit  (SearchSoftwareQuality.com)
NUnit  (SearchSoftwareQuality.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary


The trace matrix is an established testing tool. The trace matrix proposes that each requirement has one or more tests identified. Allegedly if you have one or more test cases tied to each requirement, and each test case is executed, you have proof that the application has been tested.

My challenge to the trace matrix is, what about requirements that are implied or assumed? Or what about testing ideas that don't map back to a requirement? Many great testing ideas come to mind while we're testing. If the trace matrix prevents test ideas from being executed because there is no stated requirement to trace back to, then I would challenge the practice of the trace matrix. In fact, by focusing on filling out a trace matrix, testing ideas can be stymied. This is the core reason why I don't believe a trace matrix is necessarily the best indication that a system is well tested.

However, if you're working in a regulated environment where you are governed that the trace matrix shall be used to demonstrate complete test coverage, then the trace matrix must be updated. As long as the requirements and trace matrix can be updated all the way until the end of a project, then a trace matrix can be the indicator of test coverage. If the requirements are frozen and the trace matrix is not updated up until the project is complete, then the trace matrix is not necessarily the best indicator of test coverage.




Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Software Quality - Software Maintenance, Software Requirements, Software Standards
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2006 - 2009, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts