How to get the reason for Skipped Test cases in TestNG

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

How to get the reason for Skipped Test cases in TestNG

Raju Arelli
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Krishnan Mahadevan
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Raju Arelli
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Krishnan Mahadevan
No. You don't need to implement anything.
You just build a TestNG listener based on org.testng.ITestListener wherein you will get notified of the test method's ITestResult and from within that you can query the throwable to find out the reason.

Refer to the below links for more information:

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Thu, Nov 24, 2016 at 8:24 AM, Raju Arelli <[hidden email]> wrote:
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Raju Arelli
Hi Krishnan,

Is there any chance to avoid Configuration Skipping in TestNG atleast?

On Thursday, November 24, 2016 at 8:36:25 AM UTC+5:30, Krishnan wrote:
No. You don't need to implement anything.
You just build a TestNG listener based on org.testng.ITestListener wherein you will get notified of the test method's ITestResult and from within that you can query the throwable to find out the reason.

Refer to the below links for more information:
  • Getting started with listeners  (This is my blog) : <a href="https://rationaleemotions.wordpress.com/2012/01/27/listen-to-what-i-have-to-say-about-testng-listeners/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.wordpress.com%2F2012%2F01%2F27%2Flisten-to-what-i-have-to-say-about-testng-listeners%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGYgJwo7I72dTaaZEghe-zDtsUnkQ&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.wordpress.com%2F2012%2F01%2F27%2Flisten-to-what-i-have-to-say-about-testng-listeners%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGYgJwo7I72dTaaZEghe-zDtsUnkQ&#39;;return true;">https://rationaleemotions.wordpress.com/2012/01/27/listen-to-what-i-have-to-say-about-testng-listeners/
  • TestNG Listeners with some samples for org.testng.ITestListener : <a href="https://examples.javacodegeeks.com/enterprise-java/testng/testng-listeners-example/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fexamples.javacodegeeks.com%2Fenterprise-java%2Ftestng%2Ftestng-listeners-example%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEumoo6bRTWygI09oj2rUJqFQzP4g&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fexamples.javacodegeeks.com%2Fenterprise-java%2Ftestng%2Ftestng-listeners-example%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEumoo6bRTWygI09oj2rUJqFQzP4g&#39;;return true;">https://examples.javacodegeeks.com/enterprise-java/testng/testng-listeners-example/

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ <a href="http://wakened-cognition.blogspot.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;">http://wakened-cognition.blogspot.com/
My Technical Scribbings @ <a href="http://rationaleemotions.wordpress.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;">http://rationaleemotions.wordpress.com/

On Thu, Nov 24, 2016 at 8:24 AM, Raju Arelli <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">raja...@...> wrote:
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">krishnan.ma...@gmail.com> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of <a href="https://github.com/cbeust/testng/commit/81eedb8351f67a38fe23668a0819be1c5b67a997" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fcbeust%2Ftestng%2Fcommit%2F81eedb8351f67a38fe23668a0819be1c5b67a997\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEHvNrNMTWzmVmW6NhrF8qQuI-p0Q&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fcbeust%2Ftestng%2Fcommit%2F81eedb8351f67a38fe23668a0819be1c5b67a997\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEHvNrNMTWzmVmW6NhrF8qQuI-p0Q&#39;;return true;">this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ <a href="http://wakened-cognition.blogspot.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;">http://wakened-cognition.blogspot.com/
My Technical Scribbings @ <a href="http://rationaleemotions.wordpress.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;">http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">raja...@...> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng-users...@googlegroups.com.
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng...@....
Visit this group at <a href="https://groups.google.com/group/testng-users" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;">https://groups.google.com/group/testng-users.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng-users...@googlegroups.com.
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng...@....
Visit this group at <a href="https://groups.google.com/group/testng-users" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;">https://groups.google.com/group/testng-users.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng-users...@googlegroups.com.
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="-oDkisPnCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">testng...@....
Visit this group at <a href="https://groups.google.com/group/testng-users" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/group/testng-users&#39;;return true;">https://groups.google.com/group/testng-users.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Krishnan Mahadevan
Maybe you could set the attribute "always-run=true" for the config annotations and see if that's what you need.

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 30, 2016 at 12:42 PM, Raju Arelli <[hidden email]> wrote:
Hi Krishnan,

Is there any chance to avoid Configuration Skipping in TestNG atleast?

On Thursday, November 24, 2016 at 8:36:25 AM UTC+5:30, Krishnan wrote:
No. You don't need to implement anything.
You just build a TestNG listener based on org.testng.ITestListener wherein you will get notified of the test method's ITestResult and from within that you can query the throwable to find out the reason.

Refer to the below links for more information:

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Thu, Nov 24, 2016 at 8:24 AM, Raju Arelli <[hidden email]> wrote:
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Raju Arelli
Hi Krishnan,

As the TestNG 6.9.11 is released, can you confirm whether the fix you provided to get the reason for configuration failure ?

Thanks,
Raju

On Wed, Nov 30, 2016 at 12:54 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Maybe you could set the attribute "always-run=true" for the config annotations and see if that's what you need.

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 30, 2016 at 12:42 PM, Raju Arelli <[hidden email]> wrote:
Hi Krishnan,

Is there any chance to avoid Configuration Skipping in TestNG atleast?

On Thursday, November 24, 2016 at 8:36:25 AM UTC+5:30, Krishnan wrote:
No. You don't need to implement anything.
You just build a TestNG listener based on org.testng.ITestListener wherein you will get notified of the test method's ITestResult and from within that you can query the throwable to find out the reason.

Refer to the below links for more information:

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Thu, Nov 24, 2016 at 8:24 AM, Raju Arelli <[hidden email]> wrote:
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]om.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]om.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]om.
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to get the reason for Skipped Test cases in TestNG

Krishnan Mahadevan
The last released version of TestNG is 6.10 (TestNG 6.11 is being released, but I am not sure if its hit Maven central yet).

TestNG 6.10 should have my fix. Have you tried ? If yes does it not work ?

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Thu, Mar 2, 2017 at 7:11 PM, Raju Arelli <[hidden email]> wrote:
Hi Krishnan,

As the TestNG 6.9.11 is released, can you confirm whether the fix you provided to get the reason for configuration failure ?

Thanks,
Raju

On Wed, Nov 30, 2016 at 12:54 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Maybe you could set the attribute "always-run=true" for the config annotations and see if that's what you need.

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 30, 2016 at 12:42 PM, Raju Arelli <[hidden email]> wrote:
Hi Krishnan,

Is there any chance to avoid Configuration Skipping in TestNG atleast?

On Thursday, November 24, 2016 at 8:36:25 AM UTC+5:30, Krishnan wrote:
No. You don't need to implement anything.
You just build a TestNG listener based on org.testng.ITestListener wherein you will get notified of the test method's ITestResult and from within that you can query the throwable to find out the reason.

Refer to the below links for more information:

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Thu, Nov 24, 2016 at 8:24 AM, Raju Arelli <[hidden email]> wrote:
HI Krishnan,
Thanks for the update.
How can we get to know whether the skipping is due to configuration failure or normal failure?
Do i need to implement ITestResult interface for that ?

Thanks
Raju

On Wed, Nov 23, 2016 at 8:49 PM, ⇜Krishnan Mahadevan⇝ <[hidden email]> wrote:
Raju,

AFAIK, TestNG already adds the details about why a Test method was skipped which can be queried by invoking  ITestResult#getThrowable() [ Here ITestResult is the test result object of a test method that was skipped ]

But if a test method gets skipped due to a configuration failure, then this information is currently not available.

That being said, as part of this commit  I have enhanced TestNG to start including this data even for test methods that were skipped due to a configuration failure. So this will be available in the upcoming TestNG version [ I don't know the timelines for when the next version of TestNG is going to be available though ]


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribbings @ http://rationaleemotions.wordpress.com/

On Wed, Nov 23, 2016 at 6:40 PM, Raju Arelli <[hidden email]> wrote:
I have around 100 test cases in my Test suite.
When I run the suite,few of the test cases are getting skipped without any reason.I couldn't able to find the log for skipping.
When I run the same test cases individually,those are running perfect.

Could somebody assist on this.

Thanks,
Raju


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

--

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.
Loading...