New developments in cost modeling for the LHC computing

Catherine Biscarat; Tommaso Boccali; Daniele Bonacorsi; Concezio Bozzi; Davide Costanzo; Dirk Duellmann; Johannes Elmsheuser; Eric Fede; José Flix Molina; Domenico Giordano; Costin Grigoras; Jan Iven; Michel Jouvin; Yves Kemp; David Lange; Riccardo Maganza; Helge Meinhard; Michele Michelotto; Gareth Douglas Roy; Andrew Sansum; Andrea Sartirana; Markus Schulz; Andrea Sciabà; Oxana Smirnova; Graeme Stewart; Andrea Valassi; Renaud Vernet; Torre Wenaus; Frank Wuerthwein

doi:10.1051/epjconf/202024503014

New developments in cost modeling for the LHC computing

Catherine Biscarat, Tommaso Boccali, Daniele Bonacorsi, Concezio Bozzi, Davide Costanzo, Dirk Duellmann, Johannes Elmsheuser, Eric Fede, José Flix Molina, Domenico Giordano, Costin Grigoras, Jan Iven, Michel Jouvin, Yves Kemp, David Lange, Riccardo Maganza, Helge Meinhard, Michele Michelotto, Gareth Douglas Roy, Andrew SansumAndrea Sartirana, Markus Schulz, Andrea Sciabà, Oxana Smirnova, Graeme Stewart, Andrea Valassi, Renaud Vernet, Torre Wenaus, Frank Wuerthwein

Research output: Contribution to journal › Article › peer-review

Abstract

The increase in the scale of LHC computing during Run 3 and Run 4 (HL-LHC) will certainly require radical changes to the computing models and the data processing of the LHC experiments. The working group established by WLCG and the HEP Software Foundation to investigate all aspects of the cost of computing and how to optimise them has continued producing results and improving our understanding of this process. In particular, experiments have developed more sophisticated ways to calculate their resource needs, we have a much more detailed process to calculate infrastructure costs. This includes studies on the impact of HPC and GPU based resources on meeting the computing demands. We have also developed and perfected tools to quantitatively study the performance of experiments workloads and we are actively collaborating with other activities related to data access, benchmarking and technology cost evolution. In this contribution we expose our recent developments and results and outline the directions of future work.

Original language	English
Pages (from-to)	03014
Journal	EPJ Web of Conferences
Volume	245
DOIs	https://doi.org/10.1051/epjconf/202024503014
Publication status	Published - 2020 Jan 1

Subject classification (UKÄ)

Subatomic Physics
Other Computer and Information Science

Access to Document

10.1051/epjconf/202024503014Licence: CC BY

https://www.epj-conferences.org/10.1051/epjconf/202024503014

Cite this

Biscarat, C., Boccali, T., Bonacorsi, D., Bozzi, C., Costanzo, D., Duellmann, D., Elmsheuser, J., Fede, E., Flix Molina, J., Giordano, D., Grigoras, C., Iven, J., Jouvin, M., Kemp, Y., Lange, D., Maganza, R., Meinhard, H., Michelotto, M., Roy, G. D., ... Wuerthwein, F. (2020). New developments in cost modeling for the LHC computing. EPJ Web of Conferences, 245, 03014. https://doi.org/10.1051/epjconf/202024503014

@article{f572c7d8a91d4fd69040e85957bf8d11,

title = "New developments in cost modeling for the LHC computing",

abstract = "The increase in the scale of LHC computing during Run 3 and Run 4 (HL-LHC) will certainly require radical changes to the computing models and the data processing of the LHC experiments. The working group established by WLCG and the HEP Software Foundation to investigate all aspects of the cost of computing and how to optimise them has continued producing results and improving our understanding of this process. In particular, experiments have developed more sophisticated ways to calculate their resource needs, we have a much more detailed process to calculate infrastructure costs. This includes studies on the impact of HPC and GPU based resources on meeting the computing demands. We have also developed and perfected tools to quantitatively study the performance of experiments workloads and we are actively collaborating with other activities related to data access, benchmarking and technology cost evolution. In this contribution we expose our recent developments and results and outline the directions of future work.",

author = "Catherine Biscarat and Tommaso Boccali and Daniele Bonacorsi and Concezio Bozzi and Davide Costanzo and Dirk Duellmann and Johannes Elmsheuser and Eric Fede and {Flix Molina}, Jos{\'e} and Domenico Giordano and Costin Grigoras and Jan Iven and Michel Jouvin and Yves Kemp and David Lange and Riccardo Maganza and Helge Meinhard and Michele Michelotto and Roy, {Gareth Douglas} and Andrew Sansum and Andrea Sartirana and Markus Schulz and Andrea Sciab{\`a} and Oxana Smirnova and Graeme Stewart and Andrea Valassi and Renaud Vernet and Torre Wenaus and Frank Wuerthwein",

year = "2020",

month = jan,

day = "1",

doi = "10.1051/epjconf/202024503014",

language = "English",

volume = "245",

pages = "03014",

journal = "EPJ Web of Conferences",

issn = "2100-014X",

publisher = "EDP Sciences",

}

Biscarat, C, Boccali, T, Bonacorsi, D, Bozzi, C, Costanzo, D, Duellmann, D, Elmsheuser, J, Fede, E, Flix Molina, J, Giordano, D, Grigoras, C, Iven, J, Jouvin, M, Kemp, Y, Lange, D, Maganza, R, Meinhard, H, Michelotto, M, Roy, GD, Sansum, A, Sartirana, A, Schulz, M, Sciabà, A, Smirnova, O, Stewart, G, Valassi, A, Vernet, R, Wenaus, T & Wuerthwein, F 2020, 'New developments in cost modeling for the LHC computing', EPJ Web of Conferences, vol. 245, pp. 03014. https://doi.org/10.1051/epjconf/202024503014

TY - JOUR

T1 - New developments in cost modeling for the LHC computing

AU - Biscarat, Catherine

AU - Boccali, Tommaso

AU - Bonacorsi, Daniele

AU - Bozzi, Concezio

AU - Costanzo, Davide

AU - Duellmann, Dirk

AU - Elmsheuser, Johannes

AU - Fede, Eric

AU - Flix Molina, José

AU - Giordano, Domenico

AU - Grigoras, Costin

AU - Iven, Jan

AU - Jouvin, Michel

AU - Kemp, Yves

AU - Lange, David

AU - Maganza, Riccardo

AU - Meinhard, Helge

AU - Michelotto, Michele

AU - Roy, Gareth Douglas

AU - Sansum, Andrew

AU - Sartirana, Andrea

AU - Schulz, Markus

AU - Sciabà, Andrea

AU - Smirnova, Oxana

AU - Stewart, Graeme

AU - Valassi, Andrea

AU - Vernet, Renaud

AU - Wenaus, Torre

AU - Wuerthwein, Frank

PY - 2020/1/1

Y1 - 2020/1/1

N2 - The increase in the scale of LHC computing during Run 3 and Run 4 (HL-LHC) will certainly require radical changes to the computing models and the data processing of the LHC experiments. The working group established by WLCG and the HEP Software Foundation to investigate all aspects of the cost of computing and how to optimise them has continued producing results and improving our understanding of this process. In particular, experiments have developed more sophisticated ways to calculate their resource needs, we have a much more detailed process to calculate infrastructure costs. This includes studies on the impact of HPC and GPU based resources on meeting the computing demands. We have also developed and perfected tools to quantitatively study the performance of experiments workloads and we are actively collaborating with other activities related to data access, benchmarking and technology cost evolution. In this contribution we expose our recent developments and results and outline the directions of future work.

AB - The increase in the scale of LHC computing during Run 3 and Run 4 (HL-LHC) will certainly require radical changes to the computing models and the data processing of the LHC experiments. The working group established by WLCG and the HEP Software Foundation to investigate all aspects of the cost of computing and how to optimise them has continued producing results and improving our understanding of this process. In particular, experiments have developed more sophisticated ways to calculate their resource needs, we have a much more detailed process to calculate infrastructure costs. This includes studies on the impact of HPC and GPU based resources on meeting the computing demands. We have also developed and perfected tools to quantitatively study the performance of experiments workloads and we are actively collaborating with other activities related to data access, benchmarking and technology cost evolution. In this contribution we expose our recent developments and results and outline the directions of future work.

U2 - 10.1051/epjconf/202024503014

DO - 10.1051/epjconf/202024503014

M3 - Article

SN - 2100-014X

VL - 245

SP - 03014

JO - EPJ Web of Conferences

JF - EPJ Web of Conferences

ER -

New developments in cost modeling for the LHC computing

Abstract

Subject classification (UKÄ)

Access to Document

Fingerprint

Cite this