Letter from the Editor – April 2013

Automation is a mantra in testing. Anyone associated with software development wants more test automation, but it’s often misunderstood. People who do test automation know how difficult it can be. But some people do not understand that automation is code, and that it needs to have architecture and design just like production code. They do not understand that it needs code review, and especially ongoing maintenance, which can be more expensive than maintenance of the production code. These misunderstandings about automation in addition to misunderstandings about testing in general, make test automation a political problem as much as it is a software problem.

In this issue, just as with last year’s September issue, test automation is the focus. As we know, test tools have always lagged development tools. At the same time, as software development lifecycles speed up and faster testing is needed, there is an ever greater need for test automation. As the business has grown more aware of these facts, the test automation tool market has rapidly grown. Today, most ALM tools (which we’ve written about here) include test automation tools or an ability to easily integrate test automation tools as normal practice. But remember the old saying “a fool with a tool is still a fool.” Tools will not solve your test automation problems. Great test design, architecture, great data design, and knowledgeable testers along with a great tool will get you started.

One of the most profound findings from the automation section of our 2010 Global Testing Survey is that 1/3 of respondents did 100% manual regression testing. What kind of confidence will you have from that? It is difficult for product teams to fully realize what a risk this is. If they did realize, I think many more companies would make the investment in staff, training, methodology and tools to make automation as important as their production code. The risk is that high.

Test automation is more complicated today. Most test teams today have to support far more platforms than ever in addition to traditional platform combinations, additional browser combinations, matrices of client/server combinations, and now multiple mobile platforms . Supporting a large suite of automated tests is hard enough. Supporting multiple tools due to inabilities for many tools to work across platforms, browsers and especially mobile devices makes an exponential nightmare. At this point, mobile automation can be so problematic for traditional teams we devoted an issue entirely to automating tests for mobile devices in December 2012.

In this issue, Karthik KK gives recommendations for organizing your automation code; LogiGear CTO Hans Buwalda addresses misconceptions about test automation; Randall Rice shows us why automation is not automatic; Amol Kher, Wello CTO, discusses the challenges his Netflix testing team faced when implementing their mobile application; LogiGear, Halliburton and Simco collaborate on a case study to show how to leverage test automation to increase the efficiency of distributed teams; Jonathan Khol urges testing teams to use games to make testing more engaging, productive and fun; and finally, Tad Anderson reviews the book Experiences of Test Automation by Dorothy Graham and Mark Fewster.

As always, we at LogiGear Magazine hope you find useful information to help in your test efforts. Automate more!

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

We launched the first ever software testing conference in Vietnam, VISTACON. It was a resounding success, with well over 200 participants and 20+ speakers from around the globe; each speaking on a wide range of cutting-edge testing topics. In this month’s magazine, we have uploaded several video recordings of event presentations – giving our readers ...
In the November 2011 issue: Mobile Application Testing, I began my column with the statement, “Everything is mobile.” One year later the statement is even more true. More devices, more platforms, more diversity, more apps. It boggles the mind how fast the landscape changes. Blackberry has been kicked to the curb by cooler and slicker ...
Our plan for the December LogiGear Magazine was to have a forward-looking Trends and Challenges issue. However, whilst assembling our September issue on SMAC, we realized the momentum SMAC was gaining in the industry. We had a large amount of content on our hands from a range of excellent contributors. Thus, we decided to split ...
Everything is mobile. What else can we say? Everything. If your product or service is currently not, it will be very soon. As Apple says: “There’s an app for that.” There is an app for everything. The race for mobile apps has consumed the software development world. I did a few projects at Palm Computing in the ...
How do you test software? How do you validate it? How do you find bugs? These are all good questions anyone on your project team or anyone responsible for customers may ask you. Can you articulate your test strategy─not your test process, but explain your approach to testing? I find that this can be a ...
“Why do we need to understand a bunch of test methods? I write test cases from user stories or requirements, automate what I can and execute the rest manually, and its fine.” If this is your situation: good for you. If you are time crunched, if your automated tests have lost relevance, are hard to ...
Happy New Year from LogiGear to those of us who celebrated New Years on January 1! And for our lunar calendar followers, an almost Happy New Year come February 3rd. We look forward to an exciting and full 2011 as its predecessor was a tough year for many in the software business. At LogiGear Magazine, ...
This is LogiGear magazine’s first issue on the big world of DevOps. DevOps is a very large topic. Just when you thought you were safe from more process improvement for a while—not so fast. There’s DevOps, Continuous Testing, Continuous Delivery and Continuous Deployment. In this issue, we are focusing on Continuous Testing, the part most ...
Continuous Testing… what is it? When we first decided to do a magazine issue dedicated to the DevOps practice of Continuous Testing, I joked with someone: “It’s about testing continuously.” And their reply was: “Yeah. What else would it be?” I was joking, but clearly the joke didn’t land. Continuous Testing is about testing continuously, ...
I have been excited about this issue since I included it in the 2011 editorial calendar. This issue of LogiGear Magazine dives into an exploration of agile automation—from the most efficient methods for test automation, to skill sets and better preparation for test teams, and even to understanding the variety of tools in question. We ...
This is our third issue concerning topics of Continuous Delivery (CD) and DevOps with the inclusion of Continuous Testing. DevOps has been around for a while and I hope the period of buzz is over and companies moving towards building a development pipeline have begun their process, including changing their test strategies.
Testing the Software Car. As usual with the LogiGear Magazine, we are tackling a big subject. With our goal of having single-topic issues, we have the ability to grab and disseminate as much information as we can related to a current topic that is interesting and also on the frontier of Software Testing.   Some ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe