The Importance of Volume in Automated Software Testing

All too often, software development organizations look at automating software testing as a means of executing existing test cases faster. Very frequently there is no strategic or methodological underpinning to such an effort. The approach is one of running test cases faster is better, which will help to deliver software faster.

Even in organizations that start to build a test automation effort on a good foundation of strategy, methodology, and supporting tools, taking such a narrow view of the test automation effort misses a huge dynamic.

Simply running existing test cases faster reduces testing time but does not increase testing capacity. Less time is taken to test, a good thing, but software testing may still be falling woefully behind software development and still represent a huge bottleneck. This is further exacerbated by the rapid increases in productivity that software development has undergone and continues to enjoy.

This approach can also lead to another detrimental dynamic. From this approach, often times organizations look to hand the test automation off to inexpensive low-skill organizations that have relatively little experience with testing and test automation – often times offshore. While this can work given the relatively modest goals for automation it creates a future problem. At some point in time the organization is going to come to realize that they need to substantially increase the volume of testing in order to keep pace with development, and they will have entirely the wrong team in place to accomplish this.

More than Automation, the Goal Should be High Volume Automation

To be truly successful in test automation requires a change in emphasis. While it is commendable to do the existing testing faster, the goal must be to do a very high volume of test automation. This will allow software testing to truly keep pace with development. By setting this as a goal, and putting in place the necessary processes, organization, and partners, a software testing organization can keep pace with development and make valuable contributions to software quality.

The Keys to High Volume Testing and Test Automation

What, then, are the keys to success in high-volume test automation? There are many key ingredients, including:

  • An overall software testing strategy that informs methodology and tool selection.
  • A methodology that supports the strategy and makes it easy to design and implement tests. As important, the methodology must also make it easy to maintain automated test cases. An organization does not want to trade the bottleneck of manual testing with a new bottleneck – maintaining test cases. Easy to maintain and reuse test cases are critically important to obtaining high levels of test automation and testing.
  • Software testing tools that support the strategy and methodology and make it easy to design, implement, maintain, and reuse test cases.

Another factor that can be critical to the success of such an effort is engaging the right partner to facilitate the process. Organizations that feel they are weak in the strategy and process department when it comes to software testing should look to a partner who can help them to align quality assurance objectives with business objectives. Such an organization can help to:

  • Define and refine objectives
  • Align objectives and business vision
  • Maximize test efficiencies with the latest methodologies and tools

Companies with a handle on strategy and process may wish to engage a partner who understands how to translate the vision into a high-volume testing program; one with experience implementing high-volume methodologies and the tools that support them. Equally as important is a partner with experience employing global resource strategies to help keep costs down.

Benefits of High Volume Testing

There are many benefits to a testing program that sets goals for very high volumes of developed, maintained, and executed test cases. These include:

  • A software testing organization that can keep up with the pace of development
  • Increased testing coverage
  • Improved software quality (assuming that good test cases are designed and automated)

Conclusion

Successful test automation programs do not simply aim to run existing test cases faster. Truly successful automated software testing programs set much more lofty goals. They set the goal of providing truly high volume testing and test automation. They implement the right strategies, methodologies, and tools to support high volume. Doing so, testing can keep pace with development and make big contributions to software quality.

Rob Pirozzi
Over 20 years of sales, marketing, management, and technology experience in high technology with exposure to industries including financial services, healthcare, higher education, government, and manufacturing; demonstrating a strong track record of success.

The Related Post

Understanding the benefits and challenges of Automating ERP is critical. According to SAP, ERP (Enterprise Resource Planning) “is the core processes that are needed to run a company: finance, human resources, manufacturing, supply chain, services, procurement, and others. At its most basic level, ERP integrates these processes into a single system. But new ERP systems ...
LogiGear Magazine – September 2010
Identifying which tests to begin with when starting automation is key to driving testing cycle times down and coverage up. So there you are. You’ve done a little research and made the business case to upper management regarding test automation and they bit on the proposal. Surprisingly, they supported you all the way and are extremely ...
Bringing in experts can set you up for automation success. Test automation isn’t easy when your testing gets beyond a few hundred test cases. Lots of brilliant testers and large organizations have, and continue to struggle with test automation, and not for lack of effort. Everyone understands the value of test automation, but few testing ...
When configured with a Python harness, TestArchitect can be used to automate testing on software for custom hardware Unlike other proprietary and open source tools, that are able to automate only desktop, or mobile, TestArchitect (TA Test) has the ability to test the software that runs on hardware in the following ways: 1. TA can ...
Cross-Browser Testing is an integral part of the Software Testing world today. When we need to test the functionality of a website or web application, we need to do so on multiple browsers for a multitude of reasons.
Take 5 and test your knowledge on the Software Testing essentials covered in our March 2019 issue. Good luck!
Introduction A common issue that I come across in projects is the relationship between test automation and programming. In this article I want to highlight some of the differences that I feel exist between the two.
Jenkins is a Continuous Integration (CI) tool that controls repeatable tasks in software development. Check out this guide to see how TestArchitect seamlessly integrates with Jenkins to establish a CI environment for Automated Testing.
There are few topics in quality assurance testing that cause as much confusion as smoke testing versus sanity testing. The two names would seem to describe very different practices— and they do! But people still get them confused, since the distinction is somewhat subtle.
This article was developed from concepts in the book Global Software Test Automation: A Discussion of Software Testing for Executives, by Hung Q. Nguyen, Michael Hacket and Brent K. Whitlock Introduction The top 5 pitfalls encountered by managers employing software Test Automation are: Uncertainty and lack of control Poor scalability and maintainability Low Test Automation ...
Recently while teaching a workshop on Testing Dirty Systems, I uttered this “Randyism” off the top of my head, “Test automation is not automatic.” I realized immediately that I had just concisely stated the problem in making test automation a reality in many organizations. Most testers know that test automation is not automatic. (Wouldn’t it be great?) However, ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe