Letter from the Editor – April 2013

Automation is a mantra in testing. Anyone associated with software development wants more test automation, but it’s often misunderstood. People who do test automation know how difficult it can be. But some people do not understand that automation is code, and that it needs to have architecture and design just like production code. They do not understand that it needs code review, and especially ongoing maintenance, which can be more expensive than maintenance of the production code. These misunderstandings about automation in addition to misunderstandings about testing in general, make test automation a political problem as much as it is a software problem.

In this issue, just as with last year’s September issue, test automation is the focus. As we know, test tools have always lagged development tools. At the same time, as software development lifecycles speed up and faster testing is needed, there is an ever greater need for test automation. As the business has grown more aware of these facts, the test automation tool market has rapidly grown. Today, most ALM tools (which we’ve written about here) include test automation tools or an ability to easily integrate test automation tools as normal practice. But remember the old saying “a fool with a tool is still a fool.” Tools will not solve your test automation problems. Great test design, architecture, great data design, and knowledgeable testers along with a great tool will get you started.

One of the most profound findings from the automation section of our 2010 Global Testing Survey is that 1/3 of respondents did 100% manual regression testing. What kind of confidence will you have from that? It is difficult for product teams to fully realize what a risk this is. If they did realize, I think many more companies would make the investment in staff, training, methodology and tools to make automation as important as their production code. The risk is that high.

Test automation is more complicated today. Most test teams today have to support far more platforms than ever in addition to traditional platform combinations, additional browser combinations, matrices of client/server combinations, and now multiple mobile platforms . Supporting a large suite of automated tests is hard enough. Supporting multiple tools due to inabilities for many tools to work across platforms, browsers and especially mobile devices makes an exponential nightmare. At this point, mobile automation can be so problematic for traditional teams we devoted an issue entirely to automating tests for mobile devices in December 2012.

In this issue, Karthik KK gives recommendations for organizing your automation code; LogiGear CTO Hans Buwalda addresses misconceptions about test automation; Randall Rice shows us why automation is not automatic; Amol Kher, Wello CTO, discusses the challenges his Netflix testing team faced when implementing their mobile application; LogiGear, Halliburton and Simco collaborate on a case study to show how to leverage test automation to increase the efficiency of distributed teams; Jonathan Khol urges testing teams to use games to make testing more engaging, productive and fun; and finally, Tad Anderson reviews the book Experiences of Test Automation by Dorothy Graham and Mark Fewster.

As always, we at LogiGear Magazine hope you find useful information to help in your test efforts. Automate more!

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

I have been training testers for about 15 years in universities, corporations, online, and individually – in both a training, managing and coaching capacity. So far, I have executed these various training efforts in 16 countries, under good and rough conditions – from simultaneous translation, to video broadcast to multiple sites, to group games with ...
On the whole, everyone wants to do a great job, have a better work environment, happy clients and customers, and to be employed by a company earning lots of money. All great goals! But this is not always the case. When it is not, you can suggest process improvements, better tool use, different estimating techniques, ...
Because of the type of work I do (consulting projects at different companies), I’ve been lucky in my Software Development career to have worked on a bunch of software projects specific to hardware devices or integrating new hardware into software systems. Starting with the Palm Pilot, I worked on some operating systems (OS) projects, firmware, ...
I have been excited about this issue since I included it in the 2011 editorial calendar. This issue of LogiGear Magazine dives into an exploration of agile automation—from the most efficient methods for test automation, to skill sets and better preparation for test teams, and even to understanding the variety of tools in question. We ...
How do you test software? How do you validate it? How do you find bugs? These are all good questions anyone on your project team or anyone responsible for customers may ask you. Can you articulate your test strategy─not your test process, but explain your approach to testing? I find that this can be a ...
As fast as Mobile is growing, the platform is still immature and is evolving at a very rapid pace. While there are whole countries that have migrated large government services to mobile, countries ranging from Estonia to Turkey to Kenya have many longtime mobile users have yet to use mPay or other mobile payment systems. ...
Change is constant. What’s different today is the rate of change. Moore’s law resulted from the observation that that the rate of change in computing power is exponential. The products, services and software landscape appears just as dynamic. At the same time, we pretty much take for granted the ubiquitous presence of software running our ...
There is a growing software development dynamic of teams without Testers. When I first went into Software Quality, I learned one thing right away: My role was user advocate. My main job was to find bugs. This is the Lean principle called Amplified Learning. We learn about behavior by testing. Even then, validation was not ...
As we settle into autumn, we’re taking the time to start some new traditions. This is LogiGear magazine’s first issue on SMAC. SMAC—social, mobile, analytics and cloud. We will be doing more issues in the next few years on these topics since so much of the product world is moving to this development stack.
For everyone still celebrating holidays: Happy Lunar New Year! At this time of the year many teams and companies are starting new projects, new initiatives, and hiring new staff. LogiGear Magazine will continue to be the resource for you for better testing with much less stress! We are excited about the focus of this month’s ...
Software development projects are multifaceted. There is staffing and budget work. There are communication and team dynamics. There are project and process issues from what the customer wants, when they want it, revenue projections, and production dates. As part of my work in helping people deliver software, I get involved in all aspects mentioned above. ...
I remember the times when test teams sat in their own area and we were not allowed to “bother” developers.

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe