Letter From The Editor – September 2020

There is a growing software development dynamic of teams without Testers.

When I first went into Software Quality, I learned one thing right away: My role was user advocate. My main job was to find bugs. This is the Lean principle called Amplified Learning. We learn about behavior by testing. Even then, validation was not the main job. We validate by finding bugs. There is a current movement happening in software development towards having Developers validating software without Testers or Test Teams.

Now, in this new paradigm without Testers—who is doing that?

The current movement toward Developers validating software without Testers or Test Team to test is risky—for a lot of reasons. First, let’s look at the role of a Tester:

What is a Tester’s job, or at least—what are some expectations of Testers?

  • Think like a user.
  • Act like a user.
  • Find bugs to cut user support calls.

Let’s look again at the Venn Diagram describing the main skills I look for on a Test Team (Figure 1).

Let’s say Developers take over all technical testing—both white-box and gray-box tests. That is a big ask, and the subject of its own discussion. Will a Developer really set blocks of time aside—or will they do “happy path” acceptance criteria validation and call it done?

The gap between Dev Mindset and Testing Mindset has narrowed significantly.

Developers work toward building and validating. Testers design tests thinking about externals: Inputs, platforms, alternative paths, boundary cases, and corner cases. Testers even think about the ever-elusive user expectations.

Subject Matter Testing – BAs and/or POs

In a perfect world, if you want to reduce Test Engineers, you have business analysts (BAs) or Product Owners (POs) and User Experience teams (UX) who will provide extensive, complete, well-thought-out user stories or requirements with lots of acceptance criteria. These people are Subject Matter Experts (SMEs) or Domain Experts, having Domain Knowledge. These folks will be very involved at the beginning of the project assisting with TDD (test-driven development) analysis of what to test. They will also run and execute System Tests (fully integrated end-to-end transaction/workflow testing on an environment very similar to production.) These folks will also run a User Acceptance Test, a pre-release test phase executed by Users. 

Testing Skill – and There are Testers Being Testers

There are tests designed and Tester skills independent to Domain/Subject Matter Expertise.

Exploratory Testing—the Lean principle of “Just in Time” (JIT Test Design)—tests the system the way it was actually built—not what a design doc or release plan test skill. New tests are designed as tests are executed based on observations, clues, and behaviors.

Good Testers can test any system. Testing is definitely not solely reliant on Subject Matter Knowledge. And actually, the more and better BAs, POs, UX teams, the less of that style testing you want.

Testing focuses on: boundaries, under stress, error cases, complex cases, boundary data, wrong data, less common platforms, problematic devices or browsers, different character sets and date/address/phone formats… the lists and tasks go on. This is where Test Teams thrive and Developers run out of steam and time to test. This is not the forte of BAs or POs—this is Test Engineer 101! This mindset, skill set, and sets of tasks cannot get lost and usually cannot be effectively distributed among other staff. It isn’t their focus.

We mainly use Exploratory Testing as a tool to learn—how does the function or system behave when I try this data, that platform, when I repeat the task but do it under a different memory condition or, even If I do it concurrently with another task? This is the basis of testing. It’s fundamental to software development. It’s a mindset. When this mindset is minimized or removed from a software development team you need, at least, 3 things:

  1. Very understanding users who are fine with having bugs/unexpected behavior, as long as they get value fast and get fast roll-backs and fixes.
  2. A substantial support system that can scale with more customer calls, customer cases, immediate feedback, and hand-holding to fix customer found issues.
  3. Not to be worried about competitors, reviews, or lost customers.

Summary

Test Teams still have a place in Modern SDLCs. Test Teams give a unique and important perspective, judgment, and feedback. It is this kind of thinking that is still needed. More specifically, the Tester’s thinking is still needed. Especially when it comes to meeting customer expectations. Even if speedy development is hoping for immediate feedback; initiatives like Continuous Testing can help to meet this need for immediate feedback in systems like DevOps.

“In this Issue” of LogiGear Magazine, we hope to inspire you to Modernize your SDLC. Our Cover Story is a special 2-part article which covers Developer testing. Our VP of Business Solutions, Clay Simmons discusses using Agile Testing Quadrants to solve Automation headaches. We have a delightful infographic on where QA Fits in Agile, and our Blogger of the Month feature is from Manish John as he dispenses lessons learned in 5 years as a Software Engineer. We’re also debuting a new survey series to capture what your work life has been like during this pandemic. I encourage you to take it and share it with your teammates, we will be releasing results in the upcoming December issue!

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

Change is constant. What’s different today is the rate of change. Moore’s law resulted from the observation that that the rate of change in computing power is exponential. The products, services and software landscape appears just as dynamic. At the same time, we pretty much take for granted the ubiquitous presence of software running our ...
Hello everyone – I’m hoping each one of us is having a great October. This time of the year is always my favorite, with the changing of the seasons, Fall was always my favorite time of year; it signified change and renewal – but I don’t want to digress to much from what’s going on ...
API testing– an old school technology gets way cool again. APIs and testing them is nothing new; the technology has been around for decades. The most basic definition of an API is an exposed function— a producer (person or company) writes a function and exposes it so that others, consumers, can use it. We copy ...
I once consulted for a company to give a week-long course on testing and QA. It was a survey course covering a wide range of topics. I was setting up and chatting with students in the room. One man came over to me and said: “I have been testing for 6 months and I am completely ...
I was just recently at a company that had a beautiful test architecture, framework, and Cucumber with tons of well-automated tests. But there was no good test management on top of the Cucumber tests, and they did not do a good job tagging the tests. Although almost everybody on the team could write and maintain ...
Continuous Testing… what is it? When we first decided to do a magazine issue dedicated to the DevOps practice of Continuous Testing, I joked with someone: “It’s about testing continuously.” And their reply was: “Yeah. What else would it be?” I was joking, but clearly the joke didn’t land. Continuous Testing is about testing continuously, ...
Testing the Software Car. As usual with the LogiGear Magazine, we are tackling a big subject. With our goal of having single-topic issues, we have the ability to grab and disseminate as much information as we can related to a current topic that is interesting and also on the frontier of Software Testing.   Some ...
Test automation is a big topic. There are so many different areas to talk about: tool choice, jumpstart, cross platform, services, cloud… Each of these areas have changed so much in the recent past that they could each be worth their own magazine issue.
Happy New Year from LogiGear to those of us who celebrated New Years on January 1! And for our lunar calendar followers, an almost Happy New Year come February 3rd. We look forward to an exciting and full 2011 as its predecessor was a tough year for many in the software business. At LogiGear Magazine, ...
A while ago, I helped start a Software Quality Certificate Program as a part of the Software Engineering Program at the University of California, Santa Cruz Extension in Silicon Valley. I was on the Board of Advisors. While putting the curriculum together, a few people suggested a Measurement and Metrics course. Since I was teaching ...
Automation is a mantra in testing. Anyone associated with software development wants more test automation, but it’s often misunderstood. People who do test automation know how difficult it can be. But some people do not understand that automation is code, and that it needs to have architecture and design just like production code. They do ...
Everything is mobile. What else can we say? Everything. If your product or service is currently not, it will be very soon. As Apple says: “There’s an app for that.” There is an app for everything. The race for mobile apps has consumed the software development world. I did a few projects at Palm Computing in the ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe