Skip Navigation LinksHome Page > Forums > SpiraTeam Forums > SpiraTeam Issues & Questi... > Spira Team Execution Stat...

Spira Team Execution Status is updaed as Failed even the Test Passes

Tuesday, February 12, 2013
Avatar
Hello all,

Background: We are using Command line engine as Automation engine in Remote Launch to run Cucumber Test Scripts.

The problem is even after successful test case execution, for some cases the Execution Status in the SpiraTeam is updated to "Failed" Status, instead of "Pass".

Whereas the Test Results show output results as success for the same test case.

This is happening for a particular type of Test Cases which are meant to test Screen Validations/Error Messages.

How to solve this problem?


(To Reply to this thread you first need to Sign-In )
1 Replies
Wednesday, February 13, 2013
Avatar
re: Riddhi Tuesday, February 12, 2013
We got the solution for this. Just wanted to share it here.

The Execution Status(for Command Line Automation) is decided as:

Passed – If automated test ran successfully and the results output to the console did not include any of the phrases – FAIL, ERROR, FATAL, WARNING, CAUTION
Failed – If automated test ran successfully, but one of the phrases – FAIL, ERROR, FATAL – was included in the console output
Caution – If automated test ran successfully, but one of the phrases – WARNING, CAUTION – was included in the console output
Blocked – The automated test did not run successfully

So, if the NAME of the Test Case contains any of the reserved phrases like "ERROR" or "FATAL" or "WARNING" or "FAIL" or "CAUTION" then the execution status is updated to FAILED even when the test had passed.

In ours case, test case name was containing "error" phrase which lead to the mentioned issue.

To conclude, the following phrases MUST NOT be used in the test case name:
FAIL, ERROR, FATAL, WARNING, CAUTION
Statistics
  • Started: Tuesday, February 12, 2013
  • Last Reply: Wednesday, February 13, 2013
  • Replies: 1
  • Views: 1247
Tel: 1-866-572-5878 | Help Desk | Legal Notices | Privacy Policy
Powered by KronoDesk v3.0.1 help desk software | © Copyright 2006-2019 | Licensed to Inflectra Corporation.