How to rerun skipped tests in testNG?

Question

I am using TestNG for my tests. In some tests, test data gets generated so in afterMethod I am checking if extra data was generated. If so I delete it. But sometimes for any reason data removing request doesn't return a successful response and I got an exception. In this case, all next test cases in class will be skipped. Is there a way to do not skip the remaining tests in the class if some exception was gotten in AfterMethod? Or Is it possible to re-run skipped tests?

@AfterMethod(alwaysRun = true)
public void clearData() throws Exception {
    throw new Exception();
}

@Test
public void testOne() {
    //Do something
}

@Test
public void testTwo() {
    //Do something
}

See this blog: https://www.beust.com/weblog/better-mock-testing-with-testng/ — Truong, Jul 02 '21 at 14:42
How do you want to handle when an exception occurs? Retry clearing the data and just move on to the next test method without clearing the data? — Gautham M, Jul 02 '21 at 15:15
@Misa this is the approach which is used in our testing framework and I can not change it. In method under Test annotation we create test data if needed, perform actions and use assertions. And separated AfterMethod removes generated during the test data. — Ip Man, Jul 05 '21 at 20:01
@GauthamM I don't know the perfect solution for that case. But how it works for now it is a worst way when all next tests stop performing. Perfectly clearing data step in AfterMethod shouldn't gets failed, but temporary we have an issue with data deletion and I need to work around it. And I though better then try-catch solution might exist. — Ip Man, Jul 05 '21 at 20:09
@IpMan Please read the article entirely. They don't use ```@AfterMethod``` — Truong, Jul 05 '21 at 22:53

score 1 · Accepted Answer · answered Jul 07 '21 at 06:53

try-catch would be the best solution, because any exceptions generated out of the methods should be handled by that method instead of the testng framework.

@AfterMethod
public void clearData() throws Exception {
    try{
        // do something....
    } catch(Exception e) {
        // do nothing....
    }
}

But it is possible to re-run the skipped test with a little workaround (a long one! ). (Note: I would still suggest the try-catch approach).

Create an AfterSuite method with alwaysRun set to true.

public class YourTestClass {
    private static int counter = 5; //desired number of maximum retries
    
    // all your current code.......
    
    @AfterSuite(alwaysRun = true)
    public void afterSuite(ITestContext ctx) {
        IResultMap skippedTests = ctx.getSkippedTests();

        while(skippedTests.size() > 0 && (counter--) > 0) {
            List<XmlInclude> includeMethods
                = skippedTests.getAllMethods()
                              .stream()
                              .map(m -> new XmlInclude(m.getMethodName()))
                              .collect(Collectors.toList());
            XmlClass xmlClass = new XmlClass(this.getClass().getName());
            xmlClass.setIncludedMethods(includeMethods);
            
            XmlTest test = ctx.getCurrentXmlTest();
            List<XmlClass> classes = test.getXmlClasses();
            classes.remove(0);
            classes.add(xmlClass); 

            TestRunner newRunner = new TestRunner(new Configuration(),
                                                  ctx.getSuite(),
                                                  test,
                                                  false,
                                                  null,
                                                  new ArrayList<>());
            newRunner.run();

            Set<String> newPassed = newRunner.getPassedTests().getAllResults()
                                             .stream()
                                             .map(ITestResult::getName)
                                             .collect(Collectors.toSet());
            IResultMap passedTests = ctx.getPassedTests();
            Iterator<ITestResult> iter = skippedTests.getAllResults().iterator();
            while(iter.hasNext()) {
                ITestResult result = iter.next();
                if(newPassed.contains(result.getName())) {
                    result.setStatus(ITestResult.SUCCESS);
                    passedTests.addResult(result, result.getMethod());

                    //remove the test from list of skipped tests.
                    iter.remove();
                }
            }     
        }
    }
}

How to rerun skipped tests in testNG?

1 Answers1