Thread

Skip Navigation LinksForums > SpiraTeam Forums > SpiraTeam Issues & Questi... > Easy Way to Assess Releas...

Easy Way to Assess Release Test Coverage from Test Set Level? RSS Feed

Wednesday, December 12, 2012
Wondering if there is an easy way to base the Release Test Coverage (#passing, #failing, etc) on instances of test cases - i.e. from test set level - versus based on actual # of associated test cases.

We generally use highly parameterized Test Cases, which can be run several times within a Test Set(s) for the same release (and with different results).  For example, TX 1 contains two instances of TC001, where one is passing and the other failing.

We want to be able to assess Release Test Coverage based on all test cases for the Release (where 'all' accounts for TC001 twice, because each instance has different parameters) .  Currently, Release Test Coverage is based off of test case only - so that if the same TC is run multiple times for the Release, only the most recent test run status is recorded in the Release Test Coverage status bar/#count.   It would nice to be able to generate a count of how many instances of TC001 passed/failed/etc for the Release.

Any suggestions for how do to handle monitoring the test run statuses of parameterized TCs?
2 Replies
Adam SAdam S
re: Tory Crandall on Wednesday, December 12, 2012
Friday, December 14, 2012

Hi Tony

Have you tried the following:

1) Go to Testing > Test Sets

2) Click Show/Hide Columns and make sure that the Release # column is displayed

3) Filter your test sets by Release. You'll see the coverage of tests for each set.

Regards

Adam

Tory CrandallTory Crandall
re: Adam S on Friday, December 14, 2012
Friday, December 14, 2012
Yes, this works...was just hoping there was a way to view it from the Releases page using the Test Coverage Column since that column makes it so easy to see total #s of passed/failed etc test cases. 

I guess really what I'm looking for is a Test Set Coverage column on that page (which would imply tying test sets to releases much like you tie test cases to releases, and then reporting the test set execution status from the Releases page).  ?   This would also seemingly allow us to use the Release Reports for reporting purposes (currently not of use to us since they only report last run status of a test case, regardless of parameterization).

Thanks for your help.
Tagged
Statistics
  • Started: 12/12/2012
  • Last Reply: 12/14/2012
  • Replies: 2
  • Views: 452
Powered by KronoDesk v1.1.0.15 | © Copyright Inflectra Corporation 2011-2016 | Licensed to Inflectra Corporation.