|
ajbanck created JENKINS-13214:
--------------------------------- Summary: Tests with the same name are no longer reported in the test results Key: JENKINS-13214 URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 Project: Jenkins Issue Type: Bug Components: maven2 Affects Versions: current Reporter: ajbanck After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. Test set having tests executed with parameters: ... ..Executing TestMyTest#testDefault(true) ..Executing TestMyTest#testDefault(false) .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. Resulting test results: xml ... <testcase time="0.047" classname="TestMyTest" name="testDefault"/> <testcase time="0.043" classname="TestMyTest" name="testDefault"/> </testsuite> In version 1.425 the 132 test results where correctly displayed. In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161223#comment-161223 ] Ruslan Strazhnyk commented on JENKINS-13214: -------------------------------------------- Got the same problem. It is broken from 1.455 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161223#comment-161223 ] Ruslan Strazhnyk edited comment on JENKINS-13214 at 4/4/12 12:51 PM: --------------------------------------------------------------------- Got the same problem. It is broken from 1.453 Still works good on 1.452 - I discovered it afer series of downgrades was (Author: desperado): Got the same problem. It is broken from 1.455 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kutzi reassigned JENKINS-13214: ------------------------------- Assignee: kutzi > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161250#comment-161250 ] kutzi commented on JENKINS-13214: --------------------------------- Do you have a 'real-world' example of a testresult.xml? > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Strazhnyk updated JENKINS-13214: --------------------------------------- Attachment: xml_result.zip Yes, here it is. I run one testfile with a couple of config files, and though name of the test is the same, but any of them could fail. So I need statistic for each of them. In Jenkins I gather result through " Publish Test Results in Labeled Groups" with report file mask test-reports/*.xml. It worked until the changes in v 1.452 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161276#comment-161276 ] Ruslan Strazhnyk edited comment on JENKINS-13214 at 4/5/12 8:32 AM: -------------------------------------------------------------------- Yes, here it is. I run one testfile with a couple of config files, and though name of the test is the same, but any of them could fail. So I need statistic for each of them. In Jenkins I gather result through "Publish Test Results in Labeled Groups" with report file mask test-reports/*.xml. It worked until the changes in v 1.452 was (Author: desperado): Yes, here it is. I run one testfile with a couple of config files, and though name of the test is the same, but any of them could fail. So I need statistic for each of them. In Jenkins I gather result through " Publish Test Results in Labeled Groups" with report file mask test-reports/*.xml. It worked until the changes in v 1.452 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161276#comment-161276 ] Ruslan Strazhnyk edited comment on JENKINS-13214 at 4/5/12 8:37 AM: -------------------------------------------------------------------- Yes, here it is. I run one testfile with a couple of config files, and though name of the test is the same, but any of them could fail. So I need statistic for each of them. In Jenkins I gather result through "Publish Test Results in Labeled Groups" with report file mask test-reports/*.xml. It worked until the changes in v 1.453 was (Author: desperado): Yes, here it is. I run one testfile with a couple of config files, and though name of the test is the same, but any of them could fail. So I need statistic for each of them. In Jenkins I gather result through "Publish Test Results in Labeled Groups" with report file mask test-reports/*.xml. It worked until the changes in v 1.452 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161319#comment-161319 ] Greg Temchenko commented on JENKINS-13214: ------------------------------------------ I would describe it as incapability between [LabeledTestGroupsPublisher Plugin|http://wiki.hudson-ci.org/display/HUDSON/LabeledTestGroupsPublisher+Plugin] and the new version of Jenkins. > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161324#comment-161324 ] Ruslan Strazhnyk commented on JENKINS-13214: -------------------------------------------- Greg, I disagree. The same happens when gather result with "Publish JUnit test result report" option. > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161324#comment-161324 ] Ruslan Strazhnyk edited comment on JENKINS-13214 at 4/6/12 8:45 AM: -------------------------------------------------------------------- Greg, I disagree. The same happens when gather result with "Publish JUnit test result report" option. So the bug is not in the plugins, but in Jenkins code was (Author: desperado): Greg, I disagree. The same happens when gather result with "Publish JUnit test result report" option. > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161329#comment-161329 ] SCM/JIRA link daemon commented on JENKINS-13214: ------------------------------------------------ Code changed in jenkins User: Christoph Kutzinski Path: changelog.html core/src/test/java/hudson/tasks/junit/TestResultTest.java core/src/test/resources/hudson/tasks/junit/JENKINS-13214/27449.xml core/src/test/resources/hudson/tasks/junit/JENKINS-13214/27540.xml core/src/test/resources/hudson/tasks/junit/JENKINS-13214/29734.xml http://jenkins-ci.org/commit/jenkins/1d249b98fb2a70f31b27849898e5d50dd5b018a4 Log: Added testcase and changelog for JENKINS-13214. The actual fix is in 7fba652710e64f6dce00e2e186e77ee2a39bd445 Compare: https://github.com/jenkinsci/jenkins/compare/2dd0398...1d249b9 > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Labels: regression > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
|
In reply to this post by JIRA noreply@jenkins-ci.org
[ https://issues.jenkins-ci.org/browse/JENKINS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kutzi resolved JENKINS-13214. ----------------------------- Resolution: Fixed > Tests with the same name are no longer reported in the test results > ------------------------------------------------------------------- > > Key: JENKINS-13214 > URL: https://issues.jenkins-ci.org/browse/JENKINS-13214 > Project: Jenkins > Issue Type: Bug > Components: maven2 > Affects Versions: current > Reporter: ajbanck > Assignee: kutzi > Labels: regression > Attachments: xml_result.zip > > > After updating from 1.425 to 1.456 test results will only show one test for tests having the same name. > Test set having tests executed with parameters: > ... > ..Executing TestMyTest#testDefault(true) > ..Executing TestMyTest#testDefault(false) > .Finished test set [Unit Tests] on Fri Mar 23 12:26:08 CET 2012. Executed [132] tests. > Resulting test results: xml > ... > <testcase time="0.047" classname="TestMyTest" name="testDefault"/> > <testcase time="0.043" classname="TestMyTest" name="testDefault"/> > </testsuite> > In version 1.425 the 132 test results where correctly displayed. > In version 1.456 the test results page is only having one entry for these tests, total amount of tests reported is no longer valid and is the count per test method and not the count of tests actually executed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira |
| Powered by Nabble | Edit this page |
