By the same authors

TACO: An industrial case study of Test Automation for COverage

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Standard

TACO: An industrial case study of Test Automation for COverage. / Lesage, Benjamin Michael Jean-Rene; Law, Stephen Andrew; Bate, Iain John.

Proceedings of the 26th International Conference on Real-Time Networks and Systems. ACM, 2018. p. 114-124 (RTNS'18).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Harvard

Lesage, BMJ-R, Law, SA & Bate, IJ 2018, TACO: An industrial case study of Test Automation for COverage. in Proceedings of the 26th International Conference on Real-Time Networks and Systems. RTNS'18, ACM, pp. 114-124, 26th International Conference on Real-Time Networks and Systems, Poitiers, France, 10/10/18. https://doi.org/10.1145/3273905.3273910

APA

Lesage, B. M. J-R., Law, S. A., & Bate, I. J. (2018). TACO: An industrial case study of Test Automation for COverage. In Proceedings of the 26th International Conference on Real-Time Networks and Systems (pp. 114-124). (RTNS'18). ACM. https://doi.org/10.1145/3273905.3273910

Vancouver

Lesage BMJ-R, Law SA, Bate IJ. TACO: An industrial case study of Test Automation for COverage. In Proceedings of the 26th International Conference on Real-Time Networks and Systems. ACM. 2018. p. 114-124. (RTNS'18). https://doi.org/10.1145/3273905.3273910

Author

Lesage, Benjamin Michael Jean-Rene ; Law, Stephen Andrew ; Bate, Iain John. / TACO: An industrial case study of Test Automation for COverage. Proceedings of the 26th International Conference on Real-Time Networks and Systems. ACM, 2018. pp. 114-124 (RTNS'18).

Bibtex - Download

@inproceedings{1daaa5530574483690faee9f67096af7,
title = "TACO:: An industrial case study of Test Automation for COverage",
abstract = "Timing analysis is an important part of the development of critical real-time systems. It stems from the need to provide evidence on the behaviour of the system, compliance to requirements and timing bounds. The formal testing process is complicated, and includes tests to achieve compliance with certification requirements. Where possible, testing should be performed on a host and then validated on the target. This is especially important for real systems where the target may not be available early in the project or target-based testing is expensive and time consuming. Meaningful host-based testing is difficult when it comes to timing analysis. Automation helps reduce the costs and move testing earlier in the application development cycle. Moving testing earlier in the development cycle not only enables the testing to scale to whole systems, it allows the risks of projects to be managed and software to be optimised before target-based testing is performed.In this paper, we extend existing work achieving reliable coverage and High WaterMark (HWM) measurement, to scale its application to the analysis of a full system software build, automate the test process, and minimise the set of tests deployed on target. Our case study demonstrates the successful application of the approach on a large code base, i.e. an existing controls system software code. The paper ends with a position statement about how this work is instrumental for both future research but also as part of industry practically analysing the timing behaviour of systems automatically and certifying mixed-criticality systems.",
author = "Lesage, {Benjamin Michael Jean-Rene} and Law, {Stephen Andrew} and Bate, {Iain John}",
note = "{\circledC} 2018 Copyright held by the owner/author(s). Publication rights licensed to ACM.",
year = "2018",
month = "10",
day = "10",
doi = "10.1145/3273905.3273910",
language = "English",
isbn = "978-1-4503-6463-8",
series = "RTNS'18",
publisher = "ACM",
pages = "114--124",
booktitle = "Proceedings of the 26th International Conference on Real-Time Networks and Systems",

}

RIS (suitable for import to EndNote) - Download

TY - GEN

T1 - TACO:

T2 - An industrial case study of Test Automation for COverage

AU - Lesage, Benjamin Michael Jean-Rene

AU - Law, Stephen Andrew

AU - Bate, Iain John

N1 - © 2018 Copyright held by the owner/author(s). Publication rights licensed to ACM.

PY - 2018/10/10

Y1 - 2018/10/10

N2 - Timing analysis is an important part of the development of critical real-time systems. It stems from the need to provide evidence on the behaviour of the system, compliance to requirements and timing bounds. The formal testing process is complicated, and includes tests to achieve compliance with certification requirements. Where possible, testing should be performed on a host and then validated on the target. This is especially important for real systems where the target may not be available early in the project or target-based testing is expensive and time consuming. Meaningful host-based testing is difficult when it comes to timing analysis. Automation helps reduce the costs and move testing earlier in the application development cycle. Moving testing earlier in the development cycle not only enables the testing to scale to whole systems, it allows the risks of projects to be managed and software to be optimised before target-based testing is performed.In this paper, we extend existing work achieving reliable coverage and High WaterMark (HWM) measurement, to scale its application to the analysis of a full system software build, automate the test process, and minimise the set of tests deployed on target. Our case study demonstrates the successful application of the approach on a large code base, i.e. an existing controls system software code. The paper ends with a position statement about how this work is instrumental for both future research but also as part of industry practically analysing the timing behaviour of systems automatically and certifying mixed-criticality systems.

AB - Timing analysis is an important part of the development of critical real-time systems. It stems from the need to provide evidence on the behaviour of the system, compliance to requirements and timing bounds. The formal testing process is complicated, and includes tests to achieve compliance with certification requirements. Where possible, testing should be performed on a host and then validated on the target. This is especially important for real systems where the target may not be available early in the project or target-based testing is expensive and time consuming. Meaningful host-based testing is difficult when it comes to timing analysis. Automation helps reduce the costs and move testing earlier in the application development cycle. Moving testing earlier in the development cycle not only enables the testing to scale to whole systems, it allows the risks of projects to be managed and software to be optimised before target-based testing is performed.In this paper, we extend existing work achieving reliable coverage and High WaterMark (HWM) measurement, to scale its application to the analysis of a full system software build, automate the test process, and minimise the set of tests deployed on target. Our case study demonstrates the successful application of the approach on a large code base, i.e. an existing controls system software code. The paper ends with a position statement about how this work is instrumental for both future research but also as part of industry practically analysing the timing behaviour of systems automatically and certifying mixed-criticality systems.

U2 - 10.1145/3273905.3273910

DO - 10.1145/3273905.3273910

M3 - Conference contribution

SN - 978-1-4503-6463-8

T3 - RTNS'18

SP - 114

EP - 124

BT - Proceedings of the 26th International Conference on Real-Time Networks and Systems

PB - ACM

ER -