Replication Data for: Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization (ICPSR doi:10.26165/JUELICH-DATA/BDFBPQ)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

(external link)

Document Description

Citation

Title:

Replication Data for: Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization

Identification Number:

doi:10.26165/JUELICH-DATA/BDFBPQ

Distributor:

Jülich DATA

Date of Distribution:

2024-11-29

Version:

1

Bibliographic Citation:

Maloney, Samuel; Suarez, Estela; Eicker, Norbert; Guimarães, Filipe; Frings, Wolfgang, 2024, "Replication Data for: Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization", https://doi.org/10.26165/JUELICH-DATA/BDFBPQ, Jülich DATA, V1

Study Description

Citation

Title:

Replication Data for: Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization

Identification Number:

doi:10.26165/JUELICH-DATA/BDFBPQ

Authoring Entity:

Maloney, Samuel (JSC)

Suarez, Estela (JSC)

Eicker, Norbert (JSC)

Guimarães, Filipe (JSC)

Frings, Wolfgang (JSC)

Distributor:

Jülich DATA

Access Authority:

Maloney, Samuel

Depositor:

Maloney, Samuel

Date of Deposit:

2024-11-29

Study Scope

Keywords:

Computer and Information Science, Runtime; High performance computing; Graphics processing units; Bandwidth; Computer architecture; Supercomputers; Robustness; Hardware; Resource management; Monitoring; HPC; Dynamic/Adaptive scheduling; Predictive analytics

Abstract:

Replication Data for the analysis described in the IEEE/SBC SBAC-PAD 2024 paper "Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization". Specifically, it contains the data and Python scripts used to generate Figures 2 through 9 in the paper, by computing the relevant cumulative distribution functions (CDFs) or other aggregations (for Figure 4) and then generating the associated plot. The data is contained in parquet files, using zstd compression; see the README file for more details.

Time Period:

2023-11-01-2023-11-302024-01-01-2024-01-01

Methodology and Processing

Sources Statement

Data Access

Notes:

CC0 Waiver

Other Study Description Materials

Related Publications

Citation

Identification Number:

10.1109/SBAC-PAD63648.2024.00023

Bibliographic Citation:

S. Maloney, E. Suarez, N. Eicker, F. Guimarães, and W. Frings, “Analyzing HPC monitoring data with a view towards efficient resource utilization,” in 2024 IEEE 36th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD), Hilo, HI, USA, Nov. 13–15, 2024, pp. 170–181, https://doi.org/10.1109/SBAC-PAD63648.2024.00023

Other Study-Related Materials

Label:

booster_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

booster_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

cluster_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

cluster_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

gpu_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

gpu_data.parquet

Notes:

application/octet-stream

Other Study-Related Materials

Label:

__init__.cpython-311.pyc

Notes:

application/octet-stream

Other Study-Related Materials

Label:

__init__.cpython-312.pyc

Notes:

application/octet-stream

Other Study-Related Materials

Label:

__init__.py

Notes:

text/x-python

Other Study-Related Materials

Label:

paper.mplstyle

Notes:

application/octet-stream

Other Study-Related Materials

Label:

paper.pdf

Notes:

application/pdf

Other Study-Related Materials

Label:

plot_cdf_cpu.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_durations.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_gpu_power.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_gpu.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_IC.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_mem.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_cdf_sizes.py

Notes:

text/x-python

Other Study-Related Materials

Label:

plot_mem_intensity.py

Notes:

text/x-python

Other Study-Related Materials

Label:

README.md

Notes:

text/markdown