Letter from the Editor – August 2014

Testing Embedded systems and testing the Internet of Things could each have their own issue of LogiGear magazine. But these days they are referred to presupposing knowledge of the other, so we thought it would be a good idea to tackle the two together in this issue to give a broad understanding of the landscape as well as help you get started testing smarter and become more informed.

The Internet of Things (IoT) is getting more and more press and attention every day. There is nothing new about the idea, everyone knew it was “the future.” But that future is here. Efficient wireless protocols, sensors to sense everything, and cheaper processors are making the future now. The number of things with embedded systems is already staggering, and it’s estimated there will be tens of billions of embedded system devices connected by 2020. 

Although often used interchangeably, embedded systems are not equal to the IoT. The difference is that embedded systems do not have to be connected to anything while the things in the IoT are connected via the internet. Devices now do things like monitor your glucose level and send a constant stream of data to your doctor. Others count the steps you take, your refrigerator can order milk when the carton is near-empty. and self-driving cars are in prototype.

My early embedded systems testing experience focused on medical device testing and mobile communication/mobile phone testing. In each case, as is common with embedded systems, the functionality was important but very limited, the UI was very limited or non-existent. The testing started with validating requirements. We then made models of expected behaviors and tested as thoroughly as we had time to do.

The IoT is a big leap ahead from closed system embedded devices with limited functionality and no connectivity. Even for embedded system experienced testers connectivity is a big change. There are potentially large data being produced, connection to other devices and APIs to other services. This opens the door to such things as interoperability, security and performance issues not normally seen in embedded system testing. All with speed of delivery demands in an industry with few and often competing standards.

As is always the case with new or more pervasive technologies: how do you test it? What are the new testing concerns? What skills do you have to learn to respond to this staggering growth? That is what this issue begins to explore.

In this issue I discuss the landscape of the Internet of Things with Joe Luthy; Jon Hagar gives expert recommendations for testing the IoT; I explain new areas for traditional testers working in the IoT; Phillip Koopman suggests that those performing embedded testing have software specific test plan; Auriga’s Andrey Pronin writes about the importance of a highly organized testing process and Essensium/Mind’s Arnout Vandecappelle reminds us that team collaboration is essential for testing embedded systems. Welcome to the IoT.

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

Integrated teams Something we’ve learned in the Covid-19 pandemic is that we have to work together-whatever together means. Very few teams stayed co-located; even teams in the same town worked at home. We’re all working remote. Hopefully all the thinking, tools, work and effort we put into having offshore teams work together benefited us here. ...
Everything is mobile. What else can we say? Everything. If your product or service is currently not, it will be very soon. As Apple says: “There’s an app for that.” There is an app for everything. The race for mobile apps has consumed the software development world. I did a few projects at Palm Computing in the ...
In our continuing effort to be the best source of information for keeping testers and test teams current, we have another issue to explore testing in Agile development. As Agile evolves, systemic problems arise and common rough situations become apparent. We want to provide solutions. For anyone who has worked on Agile projects, especially if ...
A lot has changed since I began staffing test projects. From hiring college students and interns for summer testing programs, to building networks of offshore teams around the world, and from having 24-hour work schedules to having instant crowdsourced public beta or bug bounty testing—things have changed.
Every organization goes through times when the internal, or home team, cannot execute the testing project easily or quickly enough. The reasons are many, from the lack of an effective test strategy to low automation engineering skill, to staff positions going unfilled due to a great job market. With everyone working and very few people ...
As part of my work, I spend a lot of time at client’s sites and talk to various software development organizations. I am beginning to see a problem arise regarding Test Automation. There is too much automation! Surprised? While there are still many teams struggling to make progress with Test Automation, many teams have been doing ...
I was just recently at a company that had a beautiful test architecture, framework, and Cucumber with tons of well-automated tests. But there was no good test management on top of the Cucumber tests, and they did not do a good job tagging the tests. Although almost everybody on the team could write and maintain ...
What is testing in Agile? It’s analogous to three blind men attempting to describe an elephant by the way it feels to them. Agile is difficult to define and everyone has their own perspective of what Agile is. When it comes to testing and Agile the rules are what you make them. Agile is ideas ...
Software development projects are multifaceted. There is staffing and budget work. There are communication and team dynamics. There are project and process issues from what the customer wants, when they want it, revenue projections, and production dates. As part of my work in helping people deliver software, I get involved in all aspects mentioned above. ...
As we settle into autumn, we’re taking the time to start some new traditions. This is LogiGear magazine’s first issue on SMAC. SMAC—social, mobile, analytics and cloud. We will be doing more issues in the next few years on these topics since so much of the product world is moving to this development stack.
In the November 2011 issue: Mobile Application Testing, I began my column with the statement, “Everything is mobile.” One year later the statement is even more true. More devices, more platforms, more diversity, more apps. It boggles the mind how fast the landscape changes. Blackberry has been kicked to the curb by cooler and slicker ...
DevOps can be a big scary thing. Culture change, constant collaboration— whatever that means— a big new set of tools… it’s a lot. What most teams want is to have a smooth running software development pipeline. I have stopped using the phrase “DevOps,” and now I say “Continuous Delivery.” There are many reasons for this.

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe