How to Create TestNG.xml File in Eclipse

TestNG is a framework used for Java automation testing that makes creating and running automated tests much easier. One of its standout features is running tests in parallel using a TestNG.xml file, which expedites software release cycles.

This tutorial on how to create a TestNG.xml file in Eclipse dives deep into how to execute multiple test files from a single file known as the TestNG.xml file. Also, it explores creating a TestNG.xml file in Eclipse.

What Is the TestNG.xml File?

TestNG.xml is a configuration file that allows for organizing and executing the automated tests. It helps customize the test execution, including test suites, methods, parameters, and groups.

TestNG allows you to create multiple test cases simultaneously, and that is where the TestNG.xml file eases this task of writing various test cases all within single or multiple classes using TestNG Annotations.

Why Use TestNG.xml File?

The TestNG.xml file allows running tests in parallel, which could help the software teams save time and get faster feedback on the builds.

Here are the reasons to use the TestNG.xml file:

Prioritizes the test methods

TestNG.xml can be used to prioritize the test methods inside the test block. The TestNG.xml file allows for the specification of the tests in the order in which they need to be executed. This helps organize and efficiently run the test in the required order.

Allows parameterization in the tests

XML file allows parameterization, using which values used in the tests using the @Parameters annotation can be provided using the <parameter> tag in the TestNG.xml file.

A classic example for this case would be cross browser testing, where the browser placeholder is updated in the tests using @Parameters annotation, and multiple test blocks can be created in the TestNG.xml file.

To learn more about it, you can go through this blog on TestNG parameterization.

Provides parallel test execution

Another advantage of the TestNG.xml file is parallel testing. Using the parallel tag, test blocks under the test suite can be executed in parallel.

It can also help in parallel execution of the test methods provided inside each test block.

Provides TestNG listeners

The TestNG listeners can be added to the TestNG.xml file, thus helping to get the minute details about the test execution. This can help automation test engineers easily debug failed tests.

Offers group test execution

The TestNG.xml file allows group execution of the test cases. It will enable the executing the test method in a specific order as updated in the file. Therefore, while performing TestNG testing, the TestNG.xml file allows testers to control the test execution flow.

Different Tags in a TestNG.xml File

Following is an example of the TestNG.xml file with multiple tests within a test suite and a single test with various tags inside it:

Let’s discuss the different tags used in the above TestNG.xml file:

<suite>

A TestNG.xml file has a single suite block. It is represented using the <suite> tag in the file. A suite can contain multiple test blocks within it.

<test>

There can be multiple test blocks inside the TestNG.xml file. It is represented by the <test> tag and can contain one or multiple <classes> tags inside it.

<classes>

The <classes> tag has the name of the Java class that has the test methods written inside it. It can contain single or multiple test classes inside the <classes> tag block.

<methods>

The <methods> tag can contain single or multiple test methods. These are the names of the actual test methods which will be executed for testing. The name of the test methods can be included using the <include> tag or excluded using the <exclude> tag. The <include> tag will queue up the test method for execution, while the < exclude > tag will skip the test, and the test will not be executed.

You can also enhance your Selenium test execution process by using AI-augmented testing agents such as KaneAI.

KaneAI by LambdaTest is an AI test assistant, featuring industry-first AI capabilities for test authoring, management, and debugging, tailored specifically for high-speed quality engineering teams. With KaneAI, users can effortlessly create and refine complex test cases using natural language, drastically cutting down the time and expertise needed to dive into test automation.

Setting Up a TestNG Project in Eclipse

Before creating a TestNG.xml file, you need to set up the TestNG project in Eclipse. If you don’t have Eclipse installed, refer to this guide to install TestNG in Eclipse.

Shown below are the steps:

1. Create a new Java Project in Eclipse IDE using File > New > Java Project.



2. Enter the project name and click the Next> button.



3. Navigate to the Libraries tab.



4. Click the Add Library button.



5. Select the TestNG library from the library options and click the Next> button.



6. Click the Finish button to complete the library addition process.



7. Click the Finish button to complete the project setup.

Create a New TestNG Class

Let’s now create a new TestNG class. This test will be executed using TestNG.

1. Right-click on the project name > TestNG > Create TestNG class.



2. Specify the additional information in the New TestNG class window, as shown in the screenshot below, and click the Finish button.



3. The value for the source folder should be the /src folder path in the project. Any name can be provided in the Package name field. The Class name field should be provided with the class name in which the tests will be written.

Select the annotation as required. We have selected the @BeforeMethod and @AfterMethod annotations, which we will use in the test.

Write a Test

A new test class will be added as per the details provided in Step 2. You may notice the red marks in the test class. Hover the mouse over the error line, for example, on @Test annotation. Once the annotation is added, the errors will disappear.

1. Make the necessary changes in the class, like updating the test method name and writing the code in the respective @Test, @Before, and @After annotations.
2. To run the tests, right-click on the class name > Run As > TestNG Test.

The tests will be executed using TestNG, and the results will be shown in the console window at the bottom.

Subscribe to the LambdaTest YouTube Channel and stay updated with the latest video tutorials on Selenium Java.

Demo: How to Create a TestNG.xml File in Eclipse?

In the above section, we set up a TestNG.xml file and executed tests using TestNG. Now, let’s look at how to create a TestNG.xml file in Eclipse.

There are two methods to create a TestNG.xml file:

Method 1:

1. Right-click on the project folder, and towards the bottom of the list, select TestNG and then Convert to TestNG.



2. A screen like the one below would appear. Click on Next.



3. The next window that pops up will have the refactored source code after you click Finish.



4. A new addition to your project directory will be displayed, named as testng.xml.



• Double-click on testng.xml to open the XML file, which looks like the one below.

Method 2:

1. Right-click on New, and select File.



2. Enter the following file name testng.xml, and then click on Finish.

This is what a basic TestNG.xml file looks like.

You have your very first TestNG.xml file ready. Now you know how to create a TestNG.xml file in Eclipse. Let’s leverage this TestNG.xml file to run automated tests using automation testing tools like Selenium. If you want to dig further and explore the true capabilities of Selenium, check out this guide on what is Selenium.

Running a TestNG.xml File

The hierarchy of an XML file goes like this- first <suite> tag, second <test> tag, and lastly, <classes> tag. You can give any name to the <suite> and <test> tags, but you have to be careful while naming classes since it combines the package and test name.

Since the suite is the topmost hierarchy, this is where multiple test classes can be placed. Let’s understand with the help of an example. For the test scenarios below, we have created two Java classes wherein both tests will run on the LambdaTest eCommerce Playground website.

Test Scenario 1:

Test Scenario 2:

Implementation:

The following code will help implement test scenarios 1 and 2. The EcommercePlayGroundTests class has both test methods to implement the test scenarios.

There are two additional methods in the class. The first one is the setup() method, which will run before any test runs and help set up the WebDriver and start the Chrome browser. The second tearDown() method will gracefully close the WebDriver session.

In case you want to know more about WebDriver, you can go through this tutorial on what is Selenium WebDriver.

The testCheckTitle() method will implement the Test Scenario 1, whereas the testSearchForProduct() method will implement the Test Scenario 2.

Test Execution:

Let’s create the TestNG.xml file with the name testng-demo.xml and update both test method names to execute the tests.

In the TestNG.xml file above, there are 2 test methods that have the <include> tag and belong to the EcommercePlaygroundTests class. When this file is executed, both tests will run in parallel in the order in which they are updated.

First, the testCheckTitle() method will run, next the testSearchForProduct() method will be run. To run the tests methods in parallel, we need to update the parallel = “methods” tag in the <test> tagline.

To run the project using the XML file, right-click on the testng.xml file and select Run As > TestNG Suite.

This will execute and run both of the tests using testng.xml with a simple click. Following is the test execution result displayed in the console.

Parallel Testing Using TestNG.xml File

Now that you have executed your TestNG.xml file successfully. As mentioned earlier, this file helps running tests in parallel. So, it is important to note the changes you need to make in the TestNG.xml to perform automation testing. However, configuring hundreds of browsers and operating systems in your nodes doesn’t look feasible enough.

Instead, you can leverage a cloud grid offered by LambdaTest. It is an AI-powered test orchestration and execution platform that lets developers and testers perform Selenium automation testing with TestNG on over 3000+ real browsers and operating systems online. That way, you only need to focus on writing better Selenium automation scripts without worrying about test infrastructure needs.

Let’s use the same test scenario we implemented in the earlier section of the blog, where we searched for a product on the LambdaTest eCommerce Playground website. Earlier, we ran the tests on the local Chrome browser.

Test Scenario:

Implementation:

A new test class, Base.java, has been created to take care of all the configurations related to running tests on the LambdaTest cloud grid. It will also take care of starting and closing the browsers.

The values for the browser name, version, and platform name will be provided on runtime using the testng.xml file.

The setup() method will update the browser, its version, and platform name as the values are set using the @Parameters annotation in TestNG.

The capabilities required for configuration can be set using the LambdaTest Automation Capabilities Generator.

Code Walkthrough:

The getLtOptions() method will set the required capabilities in the test scripts.

Next, a new test class ECommercePlaygroundTestsOnCloud, has been created to implement the test scenario and extend the Base class.

The testSearchForProduct() method will search for the product iphone from the website’s home page. After loading the search page, it will check that the page title equals Search- iphone.

If everything works fine, the status variable will be updated to passed.

Test Execution:

Let’s create a new TestNG.xml file and name it as testng-parallel.xml. That will help to perform Selenium testing on two different browsers and platforms in parallel.

The parallel = “tests” will execute both tests in parallel.

The details of the test execution can be found on the LambdaTest Web Automation Dashboard.

Conclusion

In this blog on how to create a TestNG.xml file in Eclipse, we discussed the importance of using the TestNG.xml file.

With the TestNG.xml file, testers can organize the tests, customize and run the tests in parallel, and group the tests. It also helps in the parameterization of the tests and provides more visibility towards the test execution.