Quantcast

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

JIRA noreply@jenkins-ci.org
Issue Type: Patch Patch
Affects Versions: current
Assignee: Jørgen Tjernø
Components: jenkins-plugin-runtime, testlink
Created: 29/Jun/12 6:44 PM
Description:

I'm building QA environment where test cases can be managed in TestLink and automated tests can be executed using Jenkins.

I have followed instructions in 'Jenkins TestLink Plug-in Tutorial' to execute automated tests.

http://tupilabs.com/books/jenkins-testlink-plugin-tutorial/en/

Jenkins successfully exectuted 'Test Current time' test case and its status is marked as 'Passed' in TestLink

When 'Test Current time' fails, it results in build failure (see Jenkins console output below) and failure is not reported to TestLink.

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running jenkins.plugins.testlink.examples.TestCurrentTime
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.563 sec <<< FAILURE!

Results :

Failed tests: testCurrentTime(jenkins.plugins.testlink.examples.TestCurrentTime): expected:<true> but was:<false>

Tests run: 1, Failures: 1, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 53.719s
[INFO] Finished at: Thu Jun 21 16:31:01 EDT 2012
[INFO] Final Memory: 124M/247M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project jenkins-testlink-plugin-tutorial: There are test failures.
[ERROR]
[ERROR] Please refer to C:\Jenkin\jobs\testMaven\workspace\target\surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Build step 'Invoke top-level Maven targets' marked build as failure
Finished: FAILURE

Environment: Found on Windows; it may be found in other platforms as well
Project: Jenkins
Labels: plugins jenkins testlink
Priority: Major Major
Reporter: Karthik T
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

JIRA noreply@jenkins-ci.org

The "jenkins-plugin-runtime" component is unrelated to TestLink Plugin - it's a runtime for running Ruby plugins in Jenkins. Removing component and setting assignee to "automatic".

Change By: Jørgen Tjernø (29/Jun/12 9:19 PM)
Assignee: Jørgen Tjernø Bruno P. Kinoshita
Component/s: jenkins-plugin-runtime
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

JIRA noreply@jenkins-ci.org
In reply to this post by JIRA noreply@jenkins-ci.org

Hi Karthik,

Could you share more about your job configuration, please? Are you using "clean test" as top level maven build step? It would be useful if you could post some pictures of your job and testlink configuration, or detailed configuration

Thanks
-B

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

JIRA noreply@jenkins-ci.org
In reply to this post by JIRA noreply@jenkins-ci.org
Bruno P. Kinoshita resolved Patch JENKINS-14263 as Not A Defect

Hi Karthik! Now I've noticed that the build is failing and not the tests. Failed tests don't mark the build as FAILURE (unless you say so, under advanced settings). Try reviewing your settings in your build, and let me know if there is any outdated information in the plug-in tutorial.

Cheers, B

Change By: Bruno P. Kinoshita (11/Sep/12 12:39 AM)
Status: Open Resolved
Resolution: Not A Defect
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[JIRA] (JENKINS-14263) TestLink Plugin: Jenkins reports build failure when test case is failed

JIRA noreply@jenkins-ci.org
In reply to this post by JIRA noreply@jenkins-ci.org
Bruno P. Kinoshita closed Patch JENKINS-14263 as Not A Defect

Fixed in 3.1.7 (available from update-center in the next hours)

Change By: Bruno P. Kinoshita (19/Sep/12 3:54 PM)
Status: Resolved Closed
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Loading...