[JIRA] Created: (JENKINS-11085) QC test report is same as the Junit Test report(parsing the wrong file?)

QC test report is same as the Junit Test report(parsing the wrong file?)
------------------------------------------------------------------------

                 Key: JENKINS-11085
                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
             Project: Jenkins
          Issue Type: Bug
          Components: qc
    Affects Versions: current
         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
            Reporter: Ever Tang
            Assignee: Romain Seguy
         Attachments: TestResultGraph.JPG

I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153256#comment-153256 ]

Ever Tang commented on JENKINS-11085:
-------------------------------------

Additional information:

I followed the instructions for setting up QC, did not change the QC test report filename etc.

The QC report is generated under the workspace folder:

  workspace/qcreport-AdidasTestSet-17.xml  (the file contains correct data)

The Junit test reports are located at

  workspace/build/unittest-reports/TEST-xx.xml

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153275#comment-153275 ]

Romain Seguy commented on JENKINS-11085:
----------------------------------------

This is "normal". The plugin generates results using the JUnit XML format. As such, both the JUnit publisher and the QC publisher can read the files.
I suggest you set the input field of the JUnit publisher to a regexp which doesn't match the name of the QC result file.
Tell me if it's ok.

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153634#comment-153634 ]

Romain Seguy commented on JENKINS-11085:
----------------------------------------

I've investigated this morning and, clearly, it's currently impossible to publish JUnit tests and QC tests on the same job: The underlying Java objects do conflict.

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153635#comment-153635 ]

Ever Tang commented on JENKINS-11085:
-------------------------------------

Apologize for the dupe and thanks for the quick response. I actually found out a solution that works nicely. There is another plugin called LabeledTestGroupsPublisher which addresses the limitation of the Hudson's Junit test reporting. It allows me to group the tests based on file name pattern and give the group a label. Each group will have its own trend report.

Thanks again!

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153638#comment-153638 ]

Romain Seguy commented on JENKINS-11085:
----------------------------------------

No problem, without the other issue I wouldn't have seen that it is actually a bug. I'll also take a look at the other plugin to see if I can get inspired from it to fix the bug.

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

    [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=153639#comment-153639 ]

Ever Tang commented on JENKINS-11085:
-------------------------------------

That's great. Just want to say one more time I really appreciate your effort. Your solution has helped us greatly to implement the fully automated testing process. Keep it up!

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Romain Seguy
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

     [ https://issues.jenkins-ci.org/browse/JENKINS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Romain Seguy reassigned JENKINS-11085:
--------------------------------------

    Assignee: Daniel Petisme  (was: Romain Seguy)
   

> QC test report is same as the Junit Test report(parsing the wrong file?)
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11085
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11085
>             Project: Jenkins
>          Issue Type: Bug
>          Components: qc
>    Affects Versions: current
>         Environment: Hudson 1.389 running on a Windows box, with QTP/QC client installed properly
>            Reporter: Ever Tang
>            Assignee: Daniel Petisme
>         Attachments: TestResultGraph.JPG
>
>
> I have a project that has both unit tests and QTP regression tests(hooked up with QC Plugin). If I disable the Junit report in the Post Build step(Junit test is still enabled), and only enable QC report, Hudson shows the test result trend graph properly. For instance, I have 3 QTP regression tests and it shows correctly 2 success 1 failure etc.  But if I enable the Junit Test Report in the Post Build steps, I will see 2 identical test result trend graphs both showing the Junit test results(~100 of them). The QC test result is no where to be found

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira