StressBench: A Configurable Full System Network and I/O Benchmark Framework

Dean Chester; Taylor Groves; Simon D. Hammond; Timothy R. Law; Steven A. Wright; Richard Smedley-Stevenson; Suhaib A. Fahmy; Gihan R. Mudalige; Stephen Jarvis

StressBench: A Configurable Full System Network and I/O Benchmark Framework

Dean Chester, Taylor Groves, Simon D. Hammond, Timothy R. Law, Steven A. Wright, Richard Smedley-Stevenson, Suhaib A. Fahmy, Gihan R. Mudalige, Stephen Jarvis

Computer Science

Research output: Contribution to conference › Paper › peer-review

Abstract

We present StressBench, a network benchmarking framework written for testing MPI operations and file I/O concurrently. It is designed specifically to execute MPI communication and file access patterns that are representative of real-world scientific applications. Existing tools consider either the worst case congestion with small abstract patterns or peak performance with simplistic patterns. StressBench allows for a richer study of congestion by allowing orchestration of network load scenarios that are representative of those typically seen at HPC centres, something that is difficult to achieve with existing tools. We demonstrate the versatility of the framework from microbenchmarks through to finely controlled congested runs across a cluster. Validation of the results using four proxy application communication schemes within StressBench against parent applications shows a maximum difference of 15%. Using the I/O modeling capabilities of StressBench, we are able to quantify the impact of file I/O on application traffic showing how it can be used in procurement and performance studies.

Original language	English
Number of pages	8
Publication status	Published - 22 Sept 2021
Event	IEEE High Performance Extreme Computing Conference - Duration: 20 Sept 2021 → 24 Sept 2021 Conference number: 25 https://www.ieee-hpec.org/

Conference

Conference	IEEE High Performance Extreme Computing Conference
Abbreviated title	HPEC
Period	20/09/21 → 24/09/21
Internet address	https://www.ieee-hpec.org/

Access to Document

StressBench-camerareadyAccepted author manuscript, 188 KBLicence: Other

Cite this

@conference{3721a0268b06458b91bbaf938cf8b1ae,

title = "StressBench: A Configurable Full System Network and I/O Benchmark Framework",

abstract = "We present StressBench, a network benchmarking framework written for testing MPI operations and file I/O concurrently. It is designed specifically to execute MPI communication and file access patterns that are representative of real-world scientific applications. Existing tools consider either the worst case congestion with small abstract patterns or peak performance with simplistic patterns. StressBench allows for a richer study of congestion by allowing orchestration of network load scenarios that are representative of those typically seen at HPC centres, something that is difficult to achieve with existing tools. We demonstrate the versatility of the framework from microbenchmarks through to finely controlled congested runs across a cluster. Validation of the results using four proxy application communication schemes within StressBench against parent applications shows a maximum difference of 15%. Using the I/O modeling capabilities of StressBench, we are able to quantify the impact of file I/O on application traffic showing how it can be used in procurement and performance studies.",

author = "Dean Chester and Taylor Groves and Hammond, {Simon D.} and Law, {Timothy R.} and Wright, {Steven A.} and Richard Smedley-Stevenson and Fahmy, {Suhaib A.} and Mudalige, {Gihan R.} and Stephen Jarvis",

year = "2021",

month = sep,

day = "22",

language = "English",

note = "IEEE High Performance Extreme Computing Conference, HPEC ; Conference date: 20-09-2021 Through 24-09-2021",

url = "https://www.ieee-hpec.org/",

}

TY - CONF

T1 - StressBench: A Configurable Full System Network and I/O Benchmark Framework

AU - Chester, Dean

AU - Groves, Taylor

AU - Hammond, Simon D.

AU - Law, Timothy R.

AU - Wright, Steven A.

AU - Smedley-Stevenson, Richard

AU - Fahmy, Suhaib A.

AU - Mudalige, Gihan R.

AU - Jarvis, Stephen

N1 - Conference code: 25

PY - 2021/9/22

Y1 - 2021/9/22

N2 - We present StressBench, a network benchmarking framework written for testing MPI operations and file I/O concurrently. It is designed specifically to execute MPI communication and file access patterns that are representative of real-world scientific applications. Existing tools consider either the worst case congestion with small abstract patterns or peak performance with simplistic patterns. StressBench allows for a richer study of congestion by allowing orchestration of network load scenarios that are representative of those typically seen at HPC centres, something that is difficult to achieve with existing tools. We demonstrate the versatility of the framework from microbenchmarks through to finely controlled congested runs across a cluster. Validation of the results using four proxy application communication schemes within StressBench against parent applications shows a maximum difference of 15%. Using the I/O modeling capabilities of StressBench, we are able to quantify the impact of file I/O on application traffic showing how it can be used in procurement and performance studies.

AB - We present StressBench, a network benchmarking framework written for testing MPI operations and file I/O concurrently. It is designed specifically to execute MPI communication and file access patterns that are representative of real-world scientific applications. Existing tools consider either the worst case congestion with small abstract patterns or peak performance with simplistic patterns. StressBench allows for a richer study of congestion by allowing orchestration of network load scenarios that are representative of those typically seen at HPC centres, something that is difficult to achieve with existing tools. We demonstrate the versatility of the framework from microbenchmarks through to finely controlled congested runs across a cluster. Validation of the results using four proxy application communication schemes within StressBench against parent applications shows a maximum difference of 15%. Using the I/O modeling capabilities of StressBench, we are able to quantify the impact of file I/O on application traffic showing how it can be used in procurement and performance studies.

M3 - Paper

T2 - IEEE High Performance Extreme Computing Conference

Y2 - 20 September 2021 through 24 September 2021

ER -