Formulating a Software Test Strategy

This article was adapted from a presentation titled “How to Optimize Your Web Testing Strategy” to be presented by Hung Q. Nguyen, CEO and founder of LogiGear Corporation, at the Software Test & Performance Conference 2006 at the Hyatt Regency Cambridge, Massachusetts (November 7 – 9, 2006).
Click here to jump to more information on STP CON.

Introduction

The following article provides a brief overview of the process for formulating a software test strategy, the key things that need to be included, and the many critical questions that you should be asking yourself.

Formulating a Test Strategy

Some of the key things to remember when formulating a software test strategy are:

  1. It is teamwork, not something done by an individual or developed “on-high” and passed down to be implemented
  2. It requires all stakeholders to participate
  3. It requires executive support
  4. It requires that participants think outside-of-the-box––in essence, they should start with a blank piece of paper and not start the process with preconceived notions or approaches that represent the way things have always been done
  5. It requires a lot of asking, “Why?”
  6. It requires thinking from the bottom-up, and starting from the end

A formulated software test strategy should include many key things, including:

  1. Identifying different product development styles from inception through maintenance, so that we can eventually map the appropriate test strategy to each
  2. Mapping out phases, milestones, and relevant activities on a timeline
  3. Identifying the equivalent type of test strategies for each development method
  4. Prescribing what is involved in each test strategy

When undertaking the process of formulating a test strategy you should be asking yourself:

  1. What are your quality objectives or characteristics? Examples of quality objectives include: functionality, usability, performance, security, compatibility, scalability, and recovery.
  2. What are the requirements for each characteristic?
  3. What are the types of bugs that affect each quality characteristic?
  4. What are the test types or activities needed to support finding problems described in #3? These may include things such as: design reviews, code inspection/reviews, code walk through, design walk through, unit testing, API testing, external functional testing, usability testing, accessibility testing, configuration testing, compatibility testing, regression testing, performance testing, load testing, stress testing, failover/recovery testing, installation testing, security testing, and compliance testing.
  5. What are the most effective approaches to finding specific types of bugs as early as possible? Approaches may include: requirement-based testing, scenario-based testing, story-based testing, soap opera testing, model-based testing, attack-based testing, risk-based testing, fault injection, Diagnostic Approach to Software Testing (DAST), exploratory testing, and so on.
  6. What is the required application maturity to support #4?
  7. How would #5 and #6 be mapped to the various phases in the Software Development Life Cycle (SDLC)?
  8. How would you qualify the maturity of the software to determine that it has reached its milestone?
  9. How do you quantify and measure your work?
  10. What tools can help you improve your work and which framework is needed to implement the tool successfully?

The results of such a strategy formulation process can be:

  • A reduction in the number of missed bugs
  • Few or no missed critical bugs
  • Test Automation frameworks that are deployed for better visibility, maintainability and productivity

Conclusion

“Strategy without tactics is the slowest route to victory. Tactics without strategy is the noise before defeat.”.

– Sun Tzu

LogiGear Software Test & Performance Conference 2006 Presentations

Presentations to be delivered by LogiGear at the Software Test & Performance Conference 2006 include:

  • Wednesday, Nov. 8, 8:30 am to 10:00 am – “Effectively Training Your Offshore Test Team” by Michael Hackett
  • Wednesday, Nov. 8, 1:15 pm to 2:30 pm – “How to Optimize Your Web Testing Strategy” by Hung Q. Nguyen
  • Wednesday, Nov. 8, 3:00 pm to 4:15 pm – “Agile Test Development” by Hans Buwalda
  • Thursday, Nov. 9, 8:30 am to 10:00 am – “Strategies and Tactics for Global Test Automation, Part 1” by Hung Q. Nguyen
  • Thursday, Nov. 9, 10:30 am to 12:00 pm – “Strategies and Tactics for Global Test Automation, Part 2” by Hung Q. Nguyen
  • Thursday, Nov. 9, 2:00 pm to 3:15 pm – “The 5% Challenges of Test Automation” by Hans Buwalda

To register or for more information on STP CON, see: http://www.stpcon.com/

Hung Nguyen

Hung Nguyen co-founded LogiGear in 1994, and is responsible for the company’s strategic direction and executive business management. His passion and relentless focus on execution and results has been the driver for the company’s innovative approach to software testing, test automation, testing tool solutions and testing education programs.

Hung is co-author of the top-selling book in the software testing field, “Testing Computer Software,” (Wiley, 2nd ed. 1993) and other publications including, “Testing Applications on the Web,” (Wiley, 1st ed. 2001, 2nd ed. 2003), and “Global Software Test Automation,” (HappyAbout Publishing, 2006). His experience prior to LogiGear includes leadership roles in software development, quality, product and business management at Spinnaker, PowerUp, Electronic Arts and Palm Computing.

Hung holds a Bachelor of Science in Quality Assurance from Cogswell Polytechnical College, and completed a Stanford Graduate School of Business Executive Program.

Rob Pirozzi

Over 20 years of sales, marketing, management, and technology experience in high technology with exposure to industries including financial services, healthcare, higher education, government, and manufacturing; demonstrating a strong track record of success. Proven ability to build and maintain strong relationships, contribute to target organization success, and deliver results. Website: http://www.robpirozzi.com/

Hung Q. Nguyen
Hung Nguyen co-founded LogiGear in 1994, and is responsible for the company’s strategic direction and executive business management. His passion and relentless focus on execution and results has been the driver for the company’s innovative approach to software testing, test automation, testing tool solutions and testing education programs. Hung is co-author of the top-selling book in the software testing field, “Testing Computer Software,” (Wiley, 2nd ed. 1993) and other publications including, “Testing Applications on the Web,” (Wiley, 1st ed. 2001, 2nd ed. 2003), and “Global Software Test Automation,” (HappyAbout Publishing, 2006). His experience prior to LogiGear includes leadership roles in software development, quality, product and business management at Spinnaker, PowerUp, Electronic Arts and Palm Computing. Hung holds a Bachelor of Science in Quality Assurance from Cogswell Polytechnical College, and completed a Stanford Graduate School of Business Executive Program.
Hung Q. Nguyen on Linkedin
Rob Pirozzi
Over 20 years of sales, marketing, management, and technology experience in high technology with exposure to industries including financial services, healthcare, higher education, government, and manufacturing; demonstrating a strong track record of success.

The Related Post

People rely on software more every year, so it’s critical to test it. But one thing that gets overlooked (that should be tested regularly) are smoke detectors. As the relatively young field of software quality engineering matures with all its emerging trends and terminology, software engineers often overlook that the software they test has parallels ...
With complex software systems, you can never test all of the functionality in all of the conditions that your customers will see. Start with this as a fact: You will never test enough! Step 2 in getting started is to read and re-read The Art of Software Testing by Glenford Myers. This classic will set the ...
Think you’re up for a challenge? Print this word search out! See if you can find all the words and learn a few new software testing terms in the process. To see how you’ve done, check your answers in the answer key below. *You can check the answer key here.
LogiGear Magazine – May 2011 – The Test Process Improvement Issue
The V-Model for Software Development specifies 4 kinds of testing: Unit Testing Integration Testing System Testing Acceptance Testing You can find more information here (Wikipedia): http://en.wikipedia.org/wiki/V-Model_%28software_development%29#Validation_Phases What I’m finding is that of those only the Unit Testing is clear to me. The other kinds maybe good phases in a project, but for test design it ...
There are many ways to approach test design. These approaches range from checklists to very precise algorithms in which test conditions are combined to achieve the most efficiency in testing. There are situations, such as in testing mobile applications, complex systems and cyber security, where tests need to be creative, cover a lot of functionality, ...
For mission-critical applications, it’s important to frequently develop, test, and deploy new features, while maintaining high quality. To guarantee top-notch quality, you must have the right testing approach, process, and tools in place.
First, let me ask you a few questions. Are your bugs often rejected? Are your bugs often assigned back to you and discussed back and forth to clarify information? Do your leaders or managers often complain about your bugs?
Trying to understand why fails, errors, or warnings occur in your automated tests can be quite frustrating. TestArchitect relieves this pain.  Debugging blindly can be tedious work—especially when your test tool does most of its work through the user interface (UI). Moreover, bugs can sometimes be hard to replicate when single-stepping through a test procedure. ...
Companies generally consider the software they own, whether it is created in-house or acquired, as an asset (something that could appear on the balance sheet). The production of software impacts the profit and loss accounts for the year it is produced: The resources used to produce the software result in costs, and methods, tools, or ...
LogiGear Magazine – July 2011 – The Test Methods & Strategies Issue
“Combinatorial testing can detect hard-to-find software faults more efficiently than manual test case selection methods.” Developers of large data-intensive software often notice an interesting—though not surprising—phenomenon: When usage of an application jumps dramatically, components that have operated for months without trouble suddenly develop previously undetected errors. For example, newly added customers may have account records ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe