Test Methods and Strategies Glossary

Test Strategy

A test strategy describes how the test effort will reach the quality goals set out by the development team.

Sometimes called the test approach, test strategy includes, among other things, the testing objective, methods and techniques of testing and the testing environment.

Test strategies describe how the product risks of the stakeholders are mitigated at the test-level and which types of test are to be performed. The strategy can be documented on its own or is more commonly included as part of a test plan. Test strategies layout plans for how much manual and automated testing will happen at what phases and using which methods, such as unit testing, code review, UI validation, API testing, regression testing, etc.

A Test Plan is…

A document describing the scope, approach or strategy, resources, and schedule of intended testing activities. It defines test items, the features to be tested, the testing tasks, who will do each task, and any risks requiring contingency planning.

The ANSI/IEEE Standard 829 for Software Test Documentation.

Test Design is…

Thinking about what you are testing and examining the product you are about to develop. It is the process of analyzing test requirements and arriving at test objectives and then test cases. It starts with an analysis of what areas will be tested then later, how they will be tested.

Test design could require all or one of:

  • Knowledge of the software, and the business area it operates on.
  • Knowledge of the functionality being tested.
  • Knowledge of testing techniques and heuristics.

Test Methods

Test methods are structures, ideas, or approaches to how you will design the test cases to execute the test strategy. Test methods may be determined by standards, regulatory agencies, or contractual agreements. They may be dependent on available documentation- or lack of documentation. Test methods often go hand-in-hand with the test strategy as how you will design and execute the test cases.

Black Box Testing — The technique of testing without having any knowledge of the interior workings of the application. The tester is oblivious to the system architecture and does not have access to the source code. Typically, when performing a black box test, a tester will interact with the system’s user interface by providing inputs and examining outputs without knowing how and where the inputs are worked upon.

White Box Testing — The detailed investigation of internal logic and structure of the code. White box testing is also called glass testing or clear box testing. In order to perform white box testing on an ap-plication, the programmer or tester needs to possess detailed knowledge of the internal working of the code.

Grey Box Testing — A technique to test the application with limited knowledge of the internal workings of an application, system, or platform. In software testing, the term the more you know the better carries a lot of weight when testing an application.

Coverage

Test coverage is a measurement of the extent of testing based on some criteria. Common measurements are code coverage, platform coverage, requirements coverage, user story coverage, form coverage, data coverage. There are many ways to measure coverage and report back to the team on testing progress and confidence.

Sources: Wikipedia, Tutorials Point

LogiGear Corporation

LogiGear Corporation provides global solutions for software testing, and offers public and corporate software-testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast and cost-effective results. Since 1994, LogiGear has worked with hundreds of companies from the Fortune 500 to early-stage startups, creating unique solutions to exactly meet their needs. With facilities in the US and Vietnam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

For more information, contact Joe Hughes + 01 650.572.1400

LogiGear Corporation
LogiGear Corporation provides global solutions for software testing, and offers public and corporate software testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast, cost-effective results. Since 1994, LogiGear has worked with Fortune 500 companies to early-stage start-ups in, creating unique solutions to meet their clients’ needs. With facilities in the US and Viet Nam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

The Related Post

I got some comments on my post “Test Everything all the Time” — most notably people commenting that it’s impossible to test “everything”. I can’t agree more. The intention of the post was to make the point that we need to be able to test “everything we can” all the time. That is, you should ...
In order to make the right choices among tools, you must be able to classify them. Otherwise, any choice would be at best haphazard. Without functioning classification, you would not be able to understand new tools fast, nor come up with ideas of using, or creating new tools.
A short-list of selection criteria and popular automation tools. There are a lot of test automation tools available in the market, from heavy-duty enterprise level tools to quick and dirty playback-and-record tools for browser testing. For anyone just starting their research we’ve put together a short list of requirements and tools to consider.
LogiGear Magazine – The Big Testing Issue – April 2012
What is the Automation ROI ticker? The LogiGear Automation Return on Investment (ROI) ticker, the set of colored numbers that you see above the page, shows how much money we presumably save our customers over time by employing test automation as compared to doing those same tests manually, both at the design and execution level.
Introduction Many executives have some very basic questions about Software Testing. These questions address the elements of quality (customer satisfaction) and money (spending the least amount of money to prevent future loss). The basic questions that executive have about Software Testing include: Why care about and spend money on testing? Why should testing be treated ...
Framework: An abstraction in which software providing generic functionality can be selectively changed by additional user written code, thus providing application specific software. A software framework is a universal, reusable software platform used to develop applications, products and solutions. Harness: A collection of software and test data configured to test a program unit by running it under varying conditions and monitoring ...
Introduction In many of the Test Automation projects that we are involved with using our Action-Based Testing methodology, management has expressed a need to relate tests and test results to system requirements. The underlying thought is that automation will create extra possibilities to control the level of compliance to requirements of the system under test. ...
We’re celebrating the 1st birthday of our Agile eBook! It has been one year since we launched our eBook on Agile Automation. To celebrate, we’ve updated the foreword and included a brand new automation checklist! As we take the moment to mark this occasion, we wanted to take some time to reflect on the State ...
Recently while teaching a workshop on Testing Dirty Systems, I uttered this “Randyism” off the top of my head, “Test automation is not automatic.” I realized immediately that I had just concisely stated the problem in making test automation a reality in many organizations. Most testers know that test automation is not automatic. (Wouldn’t it be great?) However, ...
An Overview of Four Methods for Systematic Test Design Strategy Many people test, but few people use the well-known black-box and white-box test design techniques. The technique most used, however, seems to be testing randomly chosen valid values, followed by error guessing, exploratory testing and the like. Could it be that the more systematic test ...
Jenkins is a Continuous Integration (CI) tool that controls repeatable tasks in software development. Check out this guide to see how TestArchitect seamlessly integrates with Jenkins to establish a CI environment for Automated Testing.

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe