Skip Navigation LinksForums > SpiraTeam Forums > SpiraTeam Issues & Questi... > Spira Team Execution Stat...

Spira Team Execution Status is updaed as Failed even the Test Passes RSS Feed

Tuesday, February 12, 2013
Hello all,

Background: We are using Command line engine as Automation engine in Remote Launch to run Cucumber Test Scripts.

The problem is even after successful test case execution, for some cases the Execution Status in the SpiraTeam is updated to "Failed" Status, instead of "Pass".

Whereas the Test Results show output results as success for the same test case.

This is happening for a particular type of Test Cases which are meant to test Screen Validations/Error Messages.

How to solve this problem?

1 Replies
Riddhi SharmaRiddhi Sharma
re: Riddhi Sharma on Tuesday, February 12, 2013
Wednesday, February 13, 2013
We got the solution for this. Just wanted to share it here.

The Execution Status(for Command Line Automation) is decided as:

Passed – If automated test ran successfully and the results output to the console did not include any of the phrases – FAIL, ERROR, FATAL, WARNING, CAUTION
Failed – If automated test ran successfully, but one of the phrases – FAIL, ERROR, FATAL – was included in the console output
Caution – If automated test ran successfully, but one of the phrases – WARNING, CAUTION – was included in the console output
Blocked – The automated test did not run successfully

So, if the NAME of the Test Case contains any of the reserved phrases like "ERROR" or "FATAL" or "WARNING" or "FAIL" or "CAUTION" then the execution status is updated to FAILED even when the test had passed.

In ours case, test case name was containing "error" phrase which lead to the mentioned issue.

To conclude, the following phrases MUST NOT be used in the test case name:

  • Started: 2/12/2013
  • Last Reply: 2/13/2013
  • Replies: 1
  • Views: 826
Powered by KronoDesk v1.1.0.15 | © Copyright Inflectra Corporation 2011-2017 | Licensed to Inflectra Corporation.