Glossary: Big Testing

Ultra-large-scale system

An ultra-large-scale systems (ULSS) is one which has the characteristics of:

  • operationally independent sub-systems;
  • managerially independent components and sub-systems;
  • evolutionary development;
  • emergent behavior; and
  • geographic distribution.

In addition to these attributes, a Northrop report argues that a ULSS:

  • features decentralized data, development, evolution and operational control;
  • addresses inherently conflicting, unknowable, and diverse requirements;
  • evolves continuously while operating, with different capabilities being deployed and removed as warranted;
  • contains heterogeneous, inconsistent and changing elements; and
  • treats failure as the norm, rather than the exception, with it being extremely unlikely that all components are functioning at any one time.

Examples of ultra-large-scale systems include: the US healthcare system, US energy smart grids and global financial markets.

Real-time system

A system is said to be real-time if the total correctness of an operation depends not only upon its logical correctness, but also upon the time in which it is performed. Real-time systems, as well as their deadlines, are classified by the consequence of missing a deadline:

  • Hard: Missing a deadline is a total system failure.
  • Firm: Infrequent deadline misses are tolerable but may degrade the system’s quality of service.
  • Soft: The usefulness of a result degrades after its deadline, thereby degrading the system’s quality of service.

Soft real-time systems are typically used where there is some issue of concurrent access and a need to keep a number of connected systems up to date with changing situations. A good example of this is software that maintains and updates the flight plans of commercial airliners. Such plans must be kept reasonably current, but can operate with a latency of seconds.

Massively multiplayer online game

A massively multiplayer online game (also called MMO or MMOG) is a multiplayer video game which is capable of supporting hundreds or thousands of players concurrently.

High volume and high capacity

The primary goal of volume and capacity testing is to ensure that IT capacity meets current and future business requirements in a cost-effective manner.

High availability system

High availability is a system design approach and associated service implementation that ensures a prearranged level of operational performance will be met during a contractual measurement period.

Unavailability is most often called “downtime” and its avoidance requires redundancy, fail-over, or load balancing.

People commonly refer to 24/7, but a high availability system is characterized by its specified availability level. A typical spec, what’s popularly known as “four nines availability”, is 99.99% uptime, allowing for 52.56 minutes of downtime per year. Systems such as these are used worldwide in the most important applications such as medical informatics, nuclear power, financial institutions, aeronautics, airlines, news reporting, e-commerce, online transaction processing and persistent online games.

Life-critical system or Safety-critical system

A life-critical system or safety-critical system is a system whose failure or malfunction may result in one or more of the following:

  • death or serious injury to people
  • loss or severe damage to equipment
  • environmental harm

Risks of this sort are usually managed with the methods and tools of safety engineering. A life-critical system is designed to lose less than one life per billion (109) hours of operation. Typical design methods include probabilistic risk assessment, a method that combines failure mode and effects analysis (FMEA) with fault tree analysis. Safety-critical systems are increasingly computer-based.

Innovation

The act of introducing something new, such as a new method or device.

Predictability

To state, tell about, or make known in advance, especially on the basis of special knowledge.

Innovation and predictability are often seen at odds since innovation and change will reduce predictability and increase risk. The amount of added risk will increase significantly due to their size, complexity and emergent nature.

Sources: Webster’s Dictionary, Wikipedia

LogiGear Corporation

LogiGear Corporation provides global solutions for software testing, and offers public and corporate software-testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast and cost-effective results. Since 1994, LogiGear has worked with hundreds of companies from the Fortune 500 to early-stage startups, creating unique solutions to exactly meet their needs. With facilities in the US and Vietnam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

For more information, contact Joe Hughes + 01 650.572.1400

 

LogiGear Corporation
LogiGear Corporation provides global solutions for software testing, and offers public and corporate software testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast, cost-effective results. Since 1994, LogiGear has worked with Fortune 500 companies to early-stage start-ups in, creating unique solutions to meet their clients’ needs. With facilities in the US and Viet Nam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

The Related Post

Check out the glossary for definitions on testing essentials, and DevOps related terms. Action Based Testing (ABT) A modular-design and action-driven test method that provides a systematic approach to increase the success of automated testing. Modular-design addresses the challenges of test planning and test case management through efficient test organization. Action-driven test development eliminates the ...
Scrum Board A Scrum Board is a tool that helps Teams make Sprint Backlog items visible. The board can take many physical and virtual forms but it performs the same function regardless of how it looks. The board is updated by the Team and shows all items that need to be completed for the current ...
Closed System – In the context of embedded systems this relates closely to the engineering context where every input and every response (or output) can be known and can include a specific time. In addition the software is purposely designed for restricted access.
Behavior Driven Development (BDD) A software development methodology in which an application is specified and designed by describing how its behavior should appear to an outside observer. BDD combines the general techniques and principles of test-driven development (TDD) with ideas from domain-driven design and object-oriented analysis and design to provide software development and management teams ...
Tcl/Tk Language Tcl (Tool Command Language) is a very powerful but easy to learn dynamic programming language, suitable for a very wide range of uses, including web and desktop applications, networking, administration, testing and many more. Open source and business-friendly, Tcl is a mature yet evolving language that is truly cross platform, easily deployed and ...
Alexa Voice Service (AVS):  Amazon’s service offering for a voice controlled AI assistant. Offered in different products. Source: https://whatis.techtarget.com/definition/Alexa-Voice-Services-AVS Blockchain Infrastructure: A complex, decentralized architecture that orchestrates many systems running asynchronously over the internet in order to create a secured database that records sensitive data of certain users into forms of transactions, Source: https://blockgeeks.com/guides/what-is-blockchain-technology/ Chatbot: ...
A list of terms that are either found in the articles of the December 2015 edition, or are related to concepts relevant to those articles.
Agile – Characterized by quickness, lightness, and ease of movement; nimble. Not necessarily characterized by fast speed. Agile software development is a software development practice based on iterative and incremental development where requirements and solutions evolve through collaboration between self-organizing, cross-functional teams. It promotes adaptive planning, evolutionary development and delivery, a time-boxed iterative approach, and ...
Virtualization: Virtualization (or virtualisation) is the simulation of the software and/or hardware upon which other software runs. This simulated environment is called a virtual machine . There are many forms of virtualization, distinguished primarily by computing architecture layer. Virtualized components may include hardware platforms, operating systems (OS), storage devices, network devices or other resources.
Extreme Programming (XP) XP is a software development methodology which is intended to improve software quality and responsiveness to changing customer cycles. A type of Agile software development, it advocates frequent “releases” in short development cycles, which is intended to improve productivity and introduce checkpoints at which new customer requirements can be adopted. Source: https://en.wikipedia.org/wiki/Extreme_programming ...
ALM (Application Lifecycle Management): A continuous process of managing the life of an application through governance, development and maintenance. ALM is the marriage of business management to software engineering made possible by tools that facilitate and integrate requirements management, architecture, coding, testing, tracking, and release management. Source Control: There are many source control tools, and ...
Artificial Intelligence is here. AI is already being used in development, testing, tool development, and products. Its use will undoubtedly grow and become more pervasive. At LogiGear Magazine we regularly include a glossary of terms on the issue topic. In this issue, the glossary is unique. If you are just beginning to learn about AI ...

Leave a Reply

Your email address will not be published.

Stay in the loop with the lastest
software testing news

Subscribe