Developing A Mobile Testing Strategy

In today’s mobile-first world, a good app is important, meaning an effective Mobile Testing strategy is  essential.  

We recently started working with a new client on a Mobile Testing project. As with many mobile-first and mobile-only companies, their first question was how to develop a Mobile Testing strategy for ensuring quality in this constantly shifting mobile landscape. For starters, building out a Mobile Testing strategy requires several dimensions including:

  • Functional
  • Platform Compatibility (OS/Devices)
  • Network Variances
  • Performance
  • Test Automation
  • Integration
  • Usability and User Experience

Each of these mobile QA and test strategy dimensions are summarized below.

Mobile Functional Testing

When you approach Mobile Functional Testing, you need to start with the type(s) of mobile application (Pre-Installed Mobile Applications, Native Mobile Applications, Mobile Hybrid, Mobile WebApp, Mobile Website, etc.) you’ll be working on and then build out the important characteristics to be tested for each type. Functionality is assumed across platforms, but there are many other platform specific functionality differences and considerations.

Mobile Platform Compatibility

Because a mobile application must be compatible with native device features and not interfere with or inhibit common functions, mobile QA needs to incorporate the capabilities and limitations of different device/OS platforms in order to differentiate defects from platform limitations. With so many permutations and combinations to test, it’s critical to have a strategy for prioritizing the combinations to be tested. With such a large number of test permutations, simulators and remote devices provide reasonable alternatives. In the end, you’ll need a combination of real, emulated, and remote devices and have to figure out when it’s best to use each option.

Network Variances

One of the special aspects of Mobile App Testing is that it involves more than the mobile phone or application. Network configurations can significantly impact your application’s performance and impact your test environment. Network variations including 2G, 3G, 4G, LTE, CDMA, GPRS, GSM, HSCSD, SIM, and WAP should make up a critical part of your test matrix depending on your target market. Adding 5G will only increase complexities.

Mobile Performance

Performance is much more complicated with mobile applications as the pieces are disjointed and not well integrated. There are 3 main components: server, network, and mobile device with application. You need to be cognizant of each component while determining your strategy based on the type of mobile application discussed above. Many don’t prioritize Performance Testing as they should, only to realize way too late.

Mobile Test Automation

As with regular Automation, Test Automation for mobile follows the same rules; it makes no sense to automate where it’s not economical. Don’t automate tests that aren’t run often or tests that will need to be changed frequently due to an application that is changing often. There are many Automation tools available, some open source and commercial. In the end, Mobile Automation concerns are much deeper than tools.

Integration

With the popularity of wearables and IoT devices, the importance of integration comes to the forefront. Almost all wearables are dependent on the mobile smartphone as a communications and processing hub. Inherent in their functionality is communication with the smartphone either through WIFI, Bluetooth or NFC, and sometimes a combination. The usage of these interfaces and the gathering of data broadens the concerns for security and privacy.

Usability and User Experience

Getting a product out that is functional is not enough. Touch enabled and haptic interfaces make the interaction between the user and the device more direct and personal. The distance between user and device is reduced not just physically but also emotionally, and users create a relationship with the device, hence the importance of user experience in mobile applications.

Summary

If you’re developing a mobile app, you probably didn’t realize all the things that go into assuring its quality. In the end, it takes more than the ‘wow’ factor in screen design.

Philip Lew
Philip Lew is the CEO at XBOSoft. As a Corporate Executive, Development Manager, Product Manager, and Software Engineer, Philip has managed teams to tackle broken processes, develop solutions to difficult problems, and coached others to be leaders, managers, and experts. He leverages his academic background in Operations Research and Computer Science combined with hands-on work experience in programming, predictive modeling, and algorithm development to work with clients and colleagues around the world in improving their software processes.

The Related Post

To start with, we need a Test schedule. The same is created in the process of developing the Test plan. In this schedule, we have to estimate the time required for testing of the entire Data Warehouse system. There are different methodologies available to create a Test schedule. None of them are perfect because the ...
This article will cover 10 common mobile app testing mistakes to avoid when you are a software tester working in a mobile app testing and development environment. The 10 points may help you to start your mobile testing activities if you are new to mobile testing or they may help you to recap your existing mobile testing ...
Plan your Test Cases with these Seven Simple Steps What is a mind map? A mind map is a diagram used to visually organize information. It can be called a visual thinking tool. A mind map allows complex information to be presented in a simplified visual format. A mind map is created around a single ...
From cross-device testing, to regression testing, to load testing, to data-driven testing, check out the types of testing that are suitable for Test Automation. Scene: Interior QA Department. Engineering is preparing for a final product launch with a deadline that is 12 weeks away. In 6 weeks, there will be a 1 week quality gate, ...
Will testers be among the first IT professionals to shift their toolset and workflows from desktops and laptops to tablets and smartphones? As I’m sure you already know, a monumental shift from desktop to mobile is upon us. Not only have consumer applications started leaving the desktop behind, but B2B applications are also starting their ...
“Combinatorial testing can detect hard-to-find software faults more efficiently than manual test case selection methods.” Developers of large data-intensive software often notice an interesting—though not surprising—phenomenon: When usage of an application jumps dramatically, components that have operated for months without trouble suddenly develop previously undetected errors. For example, newly added customers may have account records ...
Introduction Software Testing 3.0 is a strategic end-to-end framework for change based upon a strategy to drive testing activities, tool selection, and people development that finally delivers on the promise of Software Testing. For more details on the evolution of Software Testing and Software Testing 3.0 see: The Early Evolution of Software Testing Software Testing ...
This is the second part of a two part article that analyzes the impact of product development for the internet of things (IoT) on software testing.  Part one of this article (LogiGear Magazine, Sept 2014) gave a wide view on the IoT, embedded systems, and the device development aspects of testing on these projects. This ...
Great mobile testing requires creativity to find problems that matter. I’d like to take you through the thought process of testers and discuss the types of things they consider when testing a mobile app. The intention here is to highlight their thought processes and to show the coverage and depth that testers often go to.
I am not a big fan of concepts which moves industry standards to IT. I am rather a Agile and Scrum guy. Managing multiple projects at once and trying to set a highest quality standard is a challenge and this book shows how industrial language can be translated into software development. I do not think that it ...
Don’t make the mistake of assuming too many similarities. It is common knowledge that mobile applications don’t function in the same way as their web-based counterparts. The user experience is affected by a few other factors such as device and network capability. If you are building out a performance testing strategy for your mobile website ...
Internet-based per-use service models are turning things upside down in the software development industry, prompting rapid expansion in the development of some products and measurable reduction in others. (Gartner, August 2008) This global transition toward computing “in the Cloud” introduces a whole new level of challenge when it comes to software testing.

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe