Automotive Industry Insights

ISO 29119 “Software Testing” and ISO JTC1/SC 7 WG 26

Standard: ISO/IEC/IEEE 29119-1 Concepts and Definitions

Description
ISO 29119-1 describes general approaches in software testing

Status
Published 2013, republication expected later in 2021

Current role and relevance with regard to ADAS/AD
Describing test approaches which can be applied in any industry. No specific relationship with ADAS/AD. Typically, industry-related standards (e.g. ISO 26262 family) state requirements on using for example test techniques (such as equivalence partitioning) or processes (such as test planning) without giving detailed advice on how to apply them. This gap can be closed using the ISO 29119 family of standards. 

Study group findings on ISO/IEC/IEEE 29119-1
Definitions in this part (or one of the other parts) could be used instead of creating new definitions. Use definitions from those standards whenever possible; if necessary, complement with comments or proposals on how to apply or read definitions in detail

Standard: ISO/IEC/IEEE 29119-2 Test Processes

Description
ISO 29119-2 provides a set of generic processes, one of them on test design, which includes the creation of test cases and test specifications.

Status
Published 2013, republication expected 2021

Current role and relevance with regard to ADAS/AD
Processes can be instantiated to describe scenario-based testing as well as requirements-based testing or other approaches in ADAS/AD.

Study group findings on ISO/IEC/IEEE 29119-2
ISTQB-based process has been referenced; however, this process is coarser than ISO processes.

Recommendation on how to deal with the standard based on the study group (preliminary) results
Refer to ISO process family.

Standard: ISO/IEC/IEEE 29119-3 Test Documentation

Description
ISO 29119-3 provides the content of test specifications, test cases, and other documents created in testing (no details on scenarios)

Status
Published 2013, reissue expected in 2021

Current role and relevance with regard to ADAS/AD
Test specifications and test cases are elaborated and examples given.

Study group findings on ISO/IEC/IEEE 29119-3
Alignment with the terms defined herein is completed

Standard: ISO/IEC/IEEE 29119-4 Test Techniques

Description
ISO 29119-4 provides descriptions of test techniques – but bear in mind that test techniques are understood very differently from the examples in Milestone 0. In ISO 29119, a test technique is a structured way to derive test cases from a test basis. The examples in Milestone 0 would in ISO lingo be test approaches, test levels, or test practices

Status
Published 2015, republication expected 2021

Current role and relevance with regard to ADAS/AD
One of the described techniques is “scenario testing,” which is related to scenario-based testing in automotive.

Study group findings on ISO/IEC/IEEE 29119-4
The concept in the standard is quite generic, but could be referenced. The study group recommends to reference the test technique in the standard and elaborate differences, and explain how this is applied/different in automotive scenario-based testing.