Get High Performance out of Your Testing Team

Testing is often looked upon by many as an unmanageable, unpredictable, unorganized practice with little structure. It is common to hear questions or complaints from development including:

  • What are test teams doing?
  • Testing takes too long
  • Testers have negative attitudes

Testers know that these complaints and questions are often unfair and untrue. Setting aside the development/testing debate, there can always be room for improvement. The first step in improving strategy and turning a test team into a higher performance test team is getting a grasp on where you are now. You want to address the following:

  • What type of testing is effective?
  • Are we testing the right things at the right time?
  • Do we need a staffing upgrade?
  • What training does our team need?

How does the product team value the test effort?
In this article, we provide a framework for assessing your team: planning your assessment, executing the assessment and judging your current performance, using the information, and charting an improvement plan towards higher performance.

The Test Process Assessment

The goal of doing a test process assessment is to get a clear picture of what is going on in testing: the positive aspects, the problems, and the possible paths to improvement. Fundamentally, a test assessment is a data gathering process. To make effective decisions we need data about the current test process. If done properly, the assessment will probably cross many organizational and management boundaries.
It is important to note when embarking upon such an assessment that this effort is much larger than the test team alone. Issues will arise over who owns quality as well as what is the goal of testing? It is also important to note that a possible result of the assessment is that work may actually increase. Some issues that may arise are:

  • More demands for documentation
  • More metrics
  • More responsibility for communication and visibility into testing.

For such an assessment process to succeed requires:

  • Executive sponsorship
  • A measurement program
  • Tools to support change
  • An acceptance of some level of risk
  • Avoidance of blaming testing for project-wide failures
  • Commitment about the goal of testing
  • An understanding of testing or quality assurance across the product team
  • Responsibility for quality

Components of a Test Strategy – SP3
A test strategy has three components that need to work together to produce an effective test effort. We developed a model called SP3, based on a framework developed by Mitchell Levy of the Value Framework Institute. The strategies (S) components consist of:

  • People (P1) – everyone on your team
  • Process (P2) – the software development and test process
  • Practice (P3) – the methods and tools your team employs to accomplish the testing task

Phase 1: Pre-Assessment Planning

The goals for this phase are to set expectations, plan the project, set a timeline, and obtain executive sponsorship. The actions that occur in phase one include meeting with the management of various groups, laying out expectations for the results of the process, describing the plan, and establishing a timeline.
The intended result is to obtain agreement on expectations and buy-in on the assessment process and the follow-up commitment for improvement. The phase one deliverable is a schedule and a project plan. It is important at this stage to:

  • Get executive buy-in
  • Create a schedule and adhere to it
  • Give a presentation of your plans discussing the objectives
  • State goals or outline work as a commitment
  • Make a scope document a pre-approval/budget deliverable

It is important to note up front that assessment is only the beginning of the process.

Phase 2: Information Gathering
The goal of phase two is to develop interview questions and surveys which become the backbone of your findings. Actions in phase two include gathering documentation, developing interview questions, and developing a test team survey.
The result of this phase is that you will be ready to begin your assessment of the materials.
Examples of the documentation to be collected include: SDLC, engineering requirements, and testing documents (e.g. test plan templates and examples, test case templates and examples, status reports, and test summary reports).
Interview questions need to cover a wide range of issues including (but not limited to): the development process, test process, requirements, change control, automation, tool use, developer unit testing, opinions about the test team from other groups, expectation of the test effort, political problems, communication issues, and more.

Phase 3: Assessment
The goal of phase three is to conduct the interviews and develop preliminary findings. Actions include gathering and reviewing documentation, conducting interviews, and distribution and collection of surveys. As a result of this phase there will be a significant amount of material and information for review.

Phase 4: Post-Assessment
Synthesize all information into a list of findings in phase four. Actions include reviewing, collating, analyzing, and making postulations. The result of this phase is that you will develop a list of findings from all of the gathered information, reviewed documentation, interviews, and the survey. Phase four deliverable is a package of collated survey answers, interview responses, a staff assessment, and a test group maturity ranking.
The findings can be categorized into:

  • People
  • Technical skills
  • Interpersonal skills
  • Process
  • Documentation
  • Test process
  • SDLC
  • Practice
  • Strategy
  • Automation
  • Environment
  • Tools

More subcategories may also be developed to suit your needs.

Phase 5: Presentation of Findings with Project Sponsor, Executive Sponsor and Team
Phase five presents preliminary findings to executives and the project sponsor, and to obtain agreement on the highest priority improvement areas.
It is important in this phase to be prepared for a very different interpretation of the findings than you perceived. The deliverable for phase five is an improvement roadmap.

Phase 6: Implementation of Roadmap
Phase six establishes goals with timelines and milestones and sub tasks to accomplish the tasks agreed upon for improvement. The action of phase six is to develop a schedule for implementation of the improvement plan.
It is helpful at this point to get some aspect of the project implemented immediately so people can see tangible results right away─even if they are the smallest or easiest improvement tasks. The deliverable for phase six is implementation of items in the roadmap according to the developed schedule.

Phase 7: Is it different for Agile?
Yes.
Process improvement is built into most agile processes. Scrum, for example, has sprint retrospectives. If you are not doing sprint retrospectives, you are not doing Scrum. This practice serves to foster very regular self-examination to quickly fail and immediately fix any efficiency. Remember the Scrum Master’s primary objective is removing obstacles from people’s work.
An Agile approach to product development relies on self-forming teams, always optimizing a dynamic process.
With a regular and quick process improvement built into most agile practices, large scale assessment and improvement processes do happen, however less frequently than in traditional projects. The new name for a “process consultant” is a scrum coach.

Conclusion
A test strategy is a holistic plan that starts with a clear understanding of the core objective of testing, from which we derive a structure for testing by selecting from many testing styles and approaches available to help us meet our objectives.

Performing an assessment helps to provide “clear comprehension” and “understanding of the core objective of testing.” Implementing the resulting roadmap for improvement can help to substantially improve the performance of your software testing organization and help to solidify your test strategy.

Michael Hackett

Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006).
He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

Armed with the right tool or set of tools, a development team can incorporate ALM into its Agile process and start reaping the benefits of Agile ALM. As the software development industry matures, it is devising methods for ushering products from inception to completion—a process that has come to be known by the buzzword ALM ...
This article presents ten tips for Agile testing based on our experience. However, don’t expect to find the perfect test approach for your company or software project in this article. That is still something you will have to find out yourself! Several years ago I started as test manager on a J2EE project. The project ...
Distinguishing these terms from each other can be rather confusing. In an attempt to go back to the basics, Nadine Schaeffer explains in detail the benefits and the necessity of using realistic situations.
There is a multitude of Agile testing techniques that are quite sophisticated. The DAD process can help guide your process of tailoring decisions. Agile developers are said to be quality infected, and disciplined agilists strive to validate their work to the best of their ability. As a result they are finding ways to bring testing and ...
Our comprehensive issue on Agile, which was set to be released in June, has been moved to early July. We’ve made this decision in order to accommodate an article from one of our industry’s thought leaders. We’re really excited about this piece and we’re sure you will be too! LogiGear Magazine is dedicated to bringing ...
How to fit automated testing into scrum, and keep testers in sync with other teams One of the benefits of the approaches of agile projects is their friendliness towards testing. The testing activities, and the testers with it, are integrated into the teams, and testing and quality are redefined as team responsibilities. Automation nowadays is a must-have ...
One of the features of using Agile methods is the opportunity for continuous improvement within a project. There are a number of improvement opportunities throughout a typical iteration or sprint─over the next few weeks I’m going to walk through a few, starting this week with the Retrospective. Retrospectives are one of the many tools in ...
This is part 2 of a 2-part article series; part 1 was featured in the September 2020 issue of the LogiGear Magazine, and you can check it out here. Part 1 discussed the mindset required for Agile, as well as explored the various quadrants of the Agile Testing Quadrants model. Part 2 will delve into ...
Take our quick survey on Testing in an Agile Development Team! Agile‘s impact on software development teams is huge. For test teams it can be even more pronounced — and good, especially if your existing projects have been problematic. There are many positive things about the move to be more Agile and responsive in software ...
In the decade since the Agile Manifesto, the movement has encouraged a number of best practices like test-driven development, user-centered design, iterative development, clean code, refactoring, continuous integration, and—arguably—cloud computing. I’m a card-carrying Agile zealot, and to me its benefits are unarguable. Is your IT organization ready to be Agile, seriously? Score yourself on these ...
If your Agile implementation is not about people, you’ve missed the boat! The most profound impact to becoming more Agile is happier teams! Agile manifesto Value #1: * Individuals and interactions over processes and tools Words like these do not show up in Waterfall or RUP SDLC process descriptions. Agile cannot get more basic than ...
Agile is a philosophy focused on delivering constant value to customers incrementally and frequently, based on communication and feedback. These two ingredients are vital to a successful Agile recipe. Agile is no longer a buzzword or an unknown territory in the industry. Agile has progressed leaps and bounds the last few years and has matured to ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe