Automation Frameworks and How to Build a Simple One

An automation framework is a way to organize your code in meaningful manner so that any person who is working with you can understand what each file contains.

Automation frameworks differ based on how you organize your code – it can be organized based on your data, so that any person who wants to use or edit data files such as an excel sheet can do so easily. These types of frameworks are known as data-driven frameworks.

Keyword-driven frameworks are those which can be written with keyword functions such as: Login, ClickButton, SearchList etc. These enable automation engineers to work within the framework easily, without ambiguity in function or code.

The combination of the above is called a Hybrid framework. There are some other frameworks which are named according to their usage such as Modular frameworks, structural frameworks etc.

Long story short, a framework is a way to organize your complex code logic in a more meaningful way to make life easier.

This can result in many advantages such as:

  • Easily understandable code.
  • Code that is easy to debug.
  • Rapid development of code.
  • Less error prone code.

Automation frameworks are developed during the initial stage of any automation project. But, as we know, the initial phase of automation will not contain all the final project features. These will be added to the framework incrementally, hence we will start with small steps known as Folder structures. These dictate where we are going to place our codes within the folder. The folders in this structure are given clear and meaningful names such as “Utilities”, “Core” and “Test Data”.

Once we have the folder structure in place, we can place the code files within those folders. The folder structures are common in any framework or automation testing tool.

The next step focuses on the “Reusability” of the code we write. Starting with the first iteration, the code should be written with the intention of future use. Ideally, the code can be reused by the team with few or no changes.

Similarly, the code should also be “Generic” meaning the code should be compatible with more than one application. Since you are investing a lot of time in your framework design and development, tomorrow your company can come up with a new plan and can ask you to automate application B using the process you used when automating application A. If you have written your framework specifically for application A, then you must re-write your code for Application B. Lesson of the story— try to avoid writing code specific to a particular application. Of course, there are cases where you must write code for a particular application. In these cases, try to isolate the application specific code in your framework and make it more visible so that anybody working in the framework can understand that it’s only relevant to that application and not common to the whole framework.

Code written for automation must contain clear comments that include the description of the code (which can include the actual functionality of the code) and a specified return type. The latter should be familiar to any programmer since automation test engineers are no different from programmers.

Above is a basic structure of how your framework should look, as every framework or design has its own structure, which can best understood by pictorial representation.

As you can see in the diagram, the framework has just 3 layers, but you can increase the layers of abstraction in such a way that it can have between 3 and 10 layers. But the number of layers depends on your needs and the complexity of your automation framework.

The theory of framework layering is this: The more layers of abstraction you create, the more efficient your framework will be.

This was just an introduction to automation frameworks but I hope you got a basic idea of what they are all about.

What is a test automation framework?

A test automation framework is a set of guidelines like coding standards, test-data handling, object repository treatment etc., which when followed during automation scripting, produce beneficial outcomes like increased code re-usability, higher portability, reduced script maintenance costs, etc.

These are just guidelines and not rules; they are not mandatory and you can still script without following them but you may miss out on the advantages of having a framework.

Ten steps for test automation framework methodology:
  • Identify the scope of testing: Company oriented, Product oriented, Project Oriented, etc.
  • Identify the needs of testing: identify types of testing e.g. FT, Web Services, etc. and applications / modules to be tested.
  • Identify the requirements of testing: find out the nature of your requirements, identify types of actions for each requirement identify high priority requirements.
  • Evaluate the test automation tool: evaluation checklist, identify the candidate tools available in the market, sample run, rate & select the tools, implementation, and training.
  • Identify the actions to be automated: Actions, Validations, and requirements supported by the tool design of the test automation framework: framework guidelines, validations, actions involved, systems involved, tool extensibility support, customs messages, and UML documentation.
  • Design of the input data bank: types of input files, categorization, and design of the file prototypes.
  • Develop the automation framework: development of script based upon framework design, driver scripts, worker scripts, record / playback, screen / window / transaction, action / keyword & data driven.
  • Population of input data bank: different types of data input, populate data from different data sources, manual input of data and parent – child data hierarchy.
  • Configuration of the schedulers: Identify scheduler requirements and configure the schedulers.
Karthik KK
Karthik has been working as an Automation Test Engineer, Architect and Consultant for the past 7 years. He has done work for many different companies and uses tools such as QTP, Selenium, Visual Studio, Test Complete, and Ranorex.

The Related Post

I recently came back from the Software Testing & Evaluation Summit in Washington, DC hosted by the National Defense Industrial Association. The objective of the workshop is to help recommend policy and guidance changes to the Defense enterprise, focusing on improving practice and productivity of software testing and evaluation (T&E) approaches in Defense acquisition.
< Michael Hackett sat down with EA’s Stephen Copp to discuss the world of integrated test platforms.
There are few topics in quality assurance testing that cause as much confusion as smoke testing versus sanity testing. The two names would seem to describe very different practices— and they do! But people still get them confused, since the distinction is somewhat subtle.
Recently while teaching a workshop on Testing Dirty Systems, I uttered this “Randyism” off the top of my head, “Test automation is not automatic.” I realized immediately that I had just concisely stated the problem in making test automation a reality in many organizations. Most testers know that test automation is not automatic. (Wouldn’t it be great?) However, ...
Test automation provides great benefits to the software testing process and improves the quality of the results. It improves reliability while minimizing variability in the results, speeds up the process, increases test coverage, and ultimately can provide greater confidence in the quality of the software being tested. However, automation is not a silver bullet. It ...
Introduction A common issue that I come across in projects is the relationship between test automation and programming. In this article I want to highlight some of the differences that I feel exist between the two.
Bringing in experts can set you up for automation success. Test automation isn’t easy when your testing gets beyond a few hundred test cases. Lots of brilliant testers and large organizations have, and continue to struggle with test automation, and not for lack of effort. Everyone understands the value of test automation, but few testing ...
September Issue 2018: The Secrets to Better Test Automation  
June Issue 2019: Testing the Software Car
Learn how to leverage TestArchitect and Selenium for turnkey, Automated Web testing. TestArchitect lets you create, manage, and run web-based automated tests on different types of browsers—using either a WebDriver or non-WebDriver technique. In this article, we will explore employing WebDriver for testing a web-based application with TestArchitect. TestArchitect with WebDriver is a tool for automating ...
The huge range of mobile devices used to browse the web now means testing a mobile website before delivery is critical.
Test Automation is significant and growing-yet I have read many forum comments and blog posts about Test Automation not delivering as expected. It’s true that test automation can improve reliability while minimizing variability in the results, speed up the process, increase test coverage, and ultimately provide greater confidence in the quality of the software being ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe