TestArchitect Corner: How to Use Jenkins in TestArchitect

Jenkins is a Continuous Integration (CI) tool that controls repeatable tasks in software development. Check out this guide to see how TestArchitect seamlessly integrates with Jenkins to establish a CI environment for Automated Testing.

With the rising popularity of Continuous Integration/Continuous Delivery (CI/CD), Continuous Testing (CT) is becoming a hot topic for discussion. Knowing that comprehensive tests are running smoothly is highly beneficial for the CI/CD pipeline; but, running tests can be both times- and resource-consuming—not to mention that tests can become boring and rigid! Using the repetitive characteristics of CI/CD and applying them to testing can be a way to address this.

A key component of Continuous Integration (CI) is the frequent running of automated tests to catch potential bugs as soon as they are introduced in the development process. The CI software life cycle involves a process of coding, building, testing, and bug-fixing, often at a rate of several iterations per day.

Most CI systems allow for much of this cyclic process to be automated: Code commits can be set to trigger software builds, build completion can trigger Automated Testing, and test results can be rapidly compiled, processed, and reported to allow bugs to be addressed in the coding process.

TestArchitect supports integration with all CI/CD tools––as long as the tools support command-line interfaces (CLI).

How to Integrate TestArchitect with Jenkins

Jenkins is a Java-based, open-source Continuous Integration (CI) tool that controls and monitors the execution of repeatable tasks in software development. TestArchitect incorporates features that allow it to be readily integrated into a Jenkins-based CI environment.

A typical Jenkins-based CI environment with integrated TestArchitect involves the following components:

  • Software development workstations with a common source control server such as SVN or CVS.
  • A Jenkins master server to manage the CI process.
  • One or more test execution machines. Each machine must be set up as both a TestArchitect controller and Jenkins slave.
  • At least one machine with TestArchitect installed to:
    • Allow for the development of tests in TestArchitect Client,
    • Provide a repository for test-related project items such as test modules and results, and
    • Generate execution batch files for the test controllers.

Note that TestArchitect may be installed on a Jenkins slave, but not on the Jenkins master.

Creating a Batch File

To establish a connection between TestArchitect and a Jenkins server, a batch file that includes executed test modules is required.

1. Select a test module or test folder for execution, then click Execute on the toolbar.

2. In the Execute Test dialog box, click the Advanced Settings tab.

3. Select the Export result(s) to xUnit checkbox.

4. Click to specify the path where the XML file is to be saved.

5. In the Open dialog box, specify the path to the Jenkins slave workspace.

  • Note:
  • The Jenkins master machine is responsible for controlling and monitoring executed jobs on slave machines.
  • Jenkins slave machines are responsible for executing jobs.

6. Click Open.

  • The specified installation path now appears in the Select a destination folder text box.

7. Click Generate Batch File.

  • The Creation of a batch file complete message appears, letting you know that the batch file creation was successful.

Importing the Batch File

1. On the Jenkins dashboard, select New Job.asd

2. Enter a Job name and select a project category.

3. Click OK.

  • The Config page appears.

4. In the Build section, click the Add build step.

5. In the drop-down list, select Execute Windows batch command.

6. Enter the path to the batch file in the Command text box.

  • Note: The batch file must be stored on the Jenkins master machine. You must copy the generated batch files on the Jenkins slave machines and paste them into the Jenkins master machine.

7. In the Post-Build Actions section, click Add post-build action.

8. In the drop-down list, select Publish JUnit test result report.

9. Enter *.xml into the Test report XMLs text box to specify that all XML files related to executing test modules are to be selected.

10. Click Save.

TestArchitect Support Team
We are the TestArchitect Support team who will help you achieve Automation success. Creating a few dozen automated test cases is easy. Maintaining them overtime while scaling your test suite to thousands of tests is not. It needs the right mix of tools, methods, and expertise.

The Related Post

The 12 Do’s and Don’ts of Test Automation When I started my career as a Software Tester a decade ago, Test Automation was viewed with some skepticism.
Are you frustrated with vendors of test automation tools that do not tell you the whole story about what it takes to automate testing? Are you tired of trying to implement test automation without breaking the bank and without overloading yourself with work? I experienced first-hand why people find test automation difficult, and I developed ...
September Issue 2018: The Secrets to Better Test Automation  
Identifying which tests to begin with when starting automation is key to driving testing cycle times down and coverage up. So there you are. You’ve done a little research and made the business case to upper management regarding test automation and they bit on the proposal. Surprisingly, they supported you all the way and are extremely ...
Test automation provides great benefits to the software testing process and improves the quality of the results. It improves reliability while minimizing variability in the results, speeds up the process, increases test coverage, and ultimately can provide greater confidence in the quality of the software being tested. However, automation is not a silver bullet. It ...
People who know me and my work probably know my emphasis on good test design for successful test automation. I have written about this in “Key Success Factors for Keyword Driven Testing“. In the Action Based Testing (ABT) method that I have pioneered over the years it is an essential element for success. However, agreeing ...
The path to continuous delivery leads through automation Software testing and verification needs a careful and diligent process of impersonating an end user, trying various usages and input scenarios, comparing and asserting expected behaviours. Directly, the words “careful and diligent” invoke the idea of letting a computer program do the job. Automating certain programmable aspects ...
I recently came back from the Software Testing & Evaluation Summit in Washington, DC hosted by the National Defense Industrial Association. The objective of the workshop is to help recommend policy and guidance changes to the Defense enterprise, focusing on improving practice and productivity of software testing and evaluation (T&E) approaches in Defense acquisition.
One of the basic challenges with test automation is adoption. I can’t tell you how many times I’ve cataloged licenses for a company and found out they already have many different automation software packages, none of which is being used. Traditionally I’ve been told that is because the tools don’t work and that the teams ...
Test automation can provide great benefits to the software testing process and improve the quality of the results…. but its use must be justified and its methods effective. The reasons to automate software testing lie in the pitfalls of manual software testing… As we all know too well, the average manual software testing program:
I’ve been teaching a lot lately, was in India for one week, and I’m off to Seattle in two weeks to teach on performance topics. I thoroughly enjoy teaching, it allows me to stay sharp with current trends, and provides a nice break from the “implementation focus” that I generally have day to day.
*You can check the answer key here

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe