Run Reporting Portals that work well with TestNG

[Sandeep Chouksey]

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[praveen133t]

I wanted to have something like that. So I developed my own batch job that will dump the results to a database and then created a simple MVC application to display the results in necessary format.

On Wednesday, June 11, 2014 12:44:39 PM UTC-5, Sandeep Chouksey wrote:

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Yevhen Bilevych]

Hi Sandeep,

Would Continuous Integration tools - Jenkins,  Teamcity,  Bamboo - work for you? Properly configured,  CI suits your needs plus allows you to schedule test runs.

You may try  and others.

Thanks,
Yevhen

11 черв. 2014 20:44, користувач "Sandeep Chouksey" <[hidden email]> написав:

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Sandeep Chouksey]

I don't think these CI tooks break down test results into individual test cases. They tend to just run a bucket of tests and either pass or fail the job from my understanding. 

On Wednesday, June 11, 2014 2:50:37 PM UTC-4, Yevhen Bilevych wrote:

Hi Sandeep,

Would Continuous Integration tools - Jenkins,  Teamcity,  Bamboo - work for you? Properly configured,  CI suits your needs plus allows you to schedule test runs.

You may try  and others.

Thanks,
Yevhen

11 черв. 2014 20:44, користувач "Sandeep Chouksey" <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">scho...@...> написав:

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">[e-mail].
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">testng...@....
Visit this group at <a href="http://groups.google.com/group/testng-users" target="_blank" onmousedown="this.href='http://groups.google.com/group/testng-users';return true;" onclick="this.href='http://groups.google.com/group/testng-users';return true;">http://groups.google.com/group/testng-users.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" onmousedown="this.href='https://groups.google.com/d/optout';return true;" onclick="this.href='https://groups.google.com/d/optout';return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Krishnan Mahadevan]

Breaking down test results at individual test case level is NOT an attribute of CI tools. What Yevhen was basically calling out here is that, if a CI tool such as Jenkins has been configured properly [ I.e., the build job is configured to retain last 10 builds etc.,] you can find out the test results of the last 10 iterations. I believe there are plugins as well in the Jenkins world which add more things to the equation such as looking at trends etc.,

The other one that I can think of is  Sonar. If Sonar has been configured, apart from it doing code analysis it also lets one view the trends with respect test coverage etc., [ But its not going to be an elaborate one of course].

The easiest way I can think of here is that, one build their own data source for this portal and construct the portal by consuming the data from the data source.

Thanks & Regards

Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

From: Sandeep Chouksey <[hidden email]>
Reply-To: <[hidden email]>
Date: Thursday, 12 June 2014 12:54 am
To: <[hidden email]>
Subject: Re: [testng-users] Run Reporting Portals that work well with TestNG

I don't think these CI tooks break down test results into individual test cases. They tend to just run a bucket of tests and either pass or fail the job from my understanding. 

On Wednesday, June 11, 2014 2:50:37 PM UTC-4, Yevhen Bilevych wrote:

Hi Sandeep,

Would Continuous Integration tools - Jenkins,  Teamcity,  Bamboo - work for you? Properly configured,  CI suits your needs plus allows you to schedule test runs.

You may try  and others.

Thanks,
Yevhen

11 черв. 2014 20:44, користувач "Sandeep Chouksey" <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">scho...@...> написав:

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">[e-mail].
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="RspHx4f7LQsJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">testng...@....
Visit this group at <a href="http://groups.google.com/group/testng-users" target="_blank" onmousedown="this.href='http://groups.google.com/group/testng-users';return true;" onclick="this.href='http://groups.google.com/group/testng-users';return true;">http://groups.google.com/group/testng-users.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" onmousedown="this.href='https://groups.google.com/d/optout';return true;" onclick="this.href='https://groups.google.com/d/optout';return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Nikesh]

look at Cuanto - http://www.trackyourtests.com

we have implemented this in our project.

On Wed, Jun 11, 2014 at 11:50 PM, Krishnan Mahadevan <[hidden email]> wrote:

Breaking down test results at individual test case level is NOT an attribute of CI tools. What Yevhen was basically calling out here is that, if a CI tool such as Jenkins has been configured properly [ I.e., the build job is configured to retain last 10 builds etc.,] you can find out the test results of the last 10 iterations. I believe there are plugins as well in the Jenkins world which add more things to the equation such as looking at trends etc.,

The other one that I can think of is  Sonar. If Sonar has been configured, apart from it doing code analysis it also lets one view the trends with respect test coverage etc., [ But its not going to be an elaborate one of course].

The easiest way I can think of here is that, one build their own data source for this portal and construct the portal by consuming the data from the data source.

Thanks & Regards

Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

From: Sandeep Chouksey <[hidden email]>
Reply-To: <[hidden email]>
Date: Thursday, 12 June 2014 12:54 am
To: <[hidden email]>
Subject: Re: [testng-users] Run Reporting Portals that work well with TestNG

I don't think these CI tooks break down test results into individual test cases. They tend to just run a bucket of tests and either pass or fail the job from my understanding. 

On Wednesday, June 11, 2014 2:50:37 PM UTC-4, Yevhen Bilevych wrote:

Hi Sandeep,

Would Continuous Integration tools - Jenkins,  Teamcity,  Bamboo - work for you? Properly configured,  CI suits your needs plus allows you to schedule test runs.

You may try  and others.

Thanks,
Yevhen

11 черв. 2014 20:44, користувач "Sandeep Chouksey" <[hidden email]> написав:

Hey All,

Are there any solutions out there for run reporting portals that can be used. Our use case is to be able to store run-results(on a test case level) and have an easy to use portal to surface results for each run and go back in time as well do to past historical analysis. Any tools already existing in this space?

Thanks.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [e-mail].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at http://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.