Multiple Tiers of Testing
Approaches to Testing
Terms
Challenges for Testing Cyber-Physical Systems
Miscellaneous
100

A technique that involves testing individual units of a system in isolation from the rest of the system.

What is unit testing?

100

This testing approach includes 5 phases:  1) Convert requirement to test  2) Run test; let it fail  3) Write code to pass the test  4) Run test  5) Refactor/repeat

What is Test-first development (TFD)or test-driven development (TDD)?

100

This term refers to the practice of shifting processes from the far right-hand side of the Vee-Model development process to the left.

What is "shift left"?

100

Testing method where software components are tested in either a simulated or virtual environment, with the hardware components replaced by models or simulations.

What is Software-in-the-Loop (SIL)?

100

This is critical for effectively testing cyber-physical systems to improve efficiency, accuracy, and consistency in testing.

What is automation?

200

This testing involves testing the entire system to assess it against the end-to-end system specifications. This is performed after a completely integrated system is complete.

What is system testing?

200

This testing approach focuses on describing the behavior of the system and writing tests to ensure that the system behaves as expected.

What is Behavior-Driven Development?

200

A simplified representation or framework that individuals use to understand, interpret, and navigate the world around them.

What is a mental model?

200

These types of vehicles generate upward of four terabytes of data in ninety minutes.

What are autonomous vehicles?

Data cannot be treated as a side concern teams need a complete data strategy in order to succeed.

200

What type of testing is this an example of?  Performing vibration testing to ensure the spacecraft can withstand the vibrations and shock it will experience during launch.

What is performance testing?

300

Testing applied that ensures it is user friendly and easy to use, and that is meets the needs and expectations of the end users.

What is usability testing?

300

This testing prioritizes testing efforts based on the levels of risk associated with different features or components of a system.

What is Risk-Based testing?

300

This model is named after the shape and defines a sequence of activities, beginning with requirements and ending with test.

What is the Vee Model?

300

Factors aiding in managing complexity during end-to-end system testing.

What are well-defined interfaces and simulated environments?


300

What type of testing is this an example of?  Testing Verifying that a spacecraft can communicate with the ground station.

What is functional testing?

400

This testing ensures combinations of the components of the system work together.

What is Integration Testing?

400

This testing approach uses models to design, generate, and execute test cases.

What is Model-Based testing?

400

An organizational structure where one group is gathering requirements, another group is interpreting the requirements and creating the design, another group implementing the solution, and yet another group testing the implementation against the requirements.

What is a role-based or function oriented organization?

400

A testing method where physical hardware components are integrated with simulated components to validate and test a system or software in a realistic environment.


What is Hardware-in-the-Loop (HIL)?

400

The unpredictable behavior of a system that is based not on an individual component but on the relationships between components; interaction of simpler components within a complex system.

What is emergent behavior?

500

This type of testing manages the scope while defining the validation of what has been developed to ensure the right thing is being built (vs. building the thing right - requirements verification).

What is acceptance testing?

500

This testing approach leverages a virtual replica of the physical system to simulate the behavior of the physical system and test its performance.

What is Digital Twin-Based testing?

500

This approach is a demonstration of how to write acceptance criteria, which are defined by the team before the work begins.

What is the given-when-then approach?

500

This type of feedback helps optimize test processes by identifying areas that are time-consuming, difficult to test or assemble.

What is manufacturing feedback?

500

A discipline aimed at proactively experimenting on a system in order to uncover potential weaknesses, vulnerabilities, or unexpected behaviors, with the ultimate goal of improving system resilience and reliability in complex distributed systems.

What is Chaos Engineering?