Home > Ask the Software Quality Experts > Software Testing and Quality Assurance Questions & Answers > Trace matrix as an indicator of test coverage
Ask The Software Quality Expert: Questions & Answers
EMAIL THIS

Trace matrix as an indicator of test coverage

Karen N. Johnson EXPERT RESPONSE FROM: Karen N. Johnson

Pose a Question
Other Software Quality Categories
Meet all Software Quality Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 13 February 2007
Do you believe in using the trace matrix as the best indicator of test coverage?

>
EXPERT RESPONSE
The trace matrix is an established testing tool. The trace matrix proposes that each requirement has one or more tests identified. Allegedly if you have one or more test cases tied to each requirement, and each test case is executed, you have proof that the application has been tested.

My challenge to the trace matrix is, what about requirements that are implied or assumed? Or what about testing ideas that don't map back to a requirement? Many great testing ideas come to mind while we're testing. If the trace matrix prevents test ideas from being executed because there is no stated requirement to trace back to, then I would challenge the practice of the trace matrix. In fact, by focusing on filling out a trace matrix, testing ideas can be stymied. This is the core reason why I don't believe a trace matrix is necessarily the best indication that a system is well tested.

However, if you're working in a regulated environment where you are governed that the trace matrix shall be used to demonstrate complete test coverage, then the trace matrix must be updated. As long as the requirements and trace matrix can be updated all the way until the end of a project, then a trace matrix can be the indicator of test coverage. If the requirements are frozen and the trace matrix is not updated up until the project is complete, then the trace matrix is not necessarily the best indicator of test coverage.


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


RELATED CONTENT
Software Testing and Quality Assurance
Should you retest closed defects during regression testing?
Common mistakes of new software testers
How to test an application's scalability, performance
Integration testing: Is it black box or white box testing?
Test strategy document vs. an acceptance test plan
The future of software testing
Quality assurance testing vs. user acceptance testing
Eliminating testing environment troubles
How to use tools for system integration testing
How to match the test environment to the production environment

Software testing tools and frameworks
How to use tools for system integration testing
The Art of Debugging with GDB, DDD, and Eclipse -- Ch. 1
Choosing code coverage tools
Virtual environments ease software development, testing
Rewind that software bug!
Functional testing of Web services
On-demand software testing service pays off for three startups
Software testing in a virtual environment
Dynamic analysis tool from Coverity looks at concurrency defects
BMC tool helps resolve problems in Java and .NET applications

Advice from Karen N. Johnson
Should you retest closed defects during regression testing?
Eliminating testing environment troubles
Do software testers need developer experience?
Software testing best practices vary by context
Functional testing: Unit testing, integration testing and beyond
Building automated tests for legacy applications
The benefits of user acceptance testing
The scope of user acceptance testing
Regression testing: How to select test cases
How to thoroughly test a website without automated tools

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
JUnit  (SearchSoftwareQuality.com)
NUnit  (SearchSoftwareQuality.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Software Quality - Software Maintenance, Software Requirements, Software Standards
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides enterprise IT professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective IT purchase decisions and managing their organizations' IT projects - with its network of technology-specific Web sites, events and magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Reprints  |  Site Map




All Rights Reserved, Copyright 2006 - 2008, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts