Leonardo (supercomputer)
{{Short description|Supercomputer in Italy}}
{{Infobox custom computer|Image=|Storage=110 petabytes|Website={{URL|https://leonardo-supercomputer.cineca.eu|Leonardo Pre-exascale Supercomputer}}|Emulators=|Legacy=|Purpose=|ChartDate=|ChartPosition=|ChartName=|Cost=€240 million|Speed=250 petaFLOPS (peak)|Memory=2.8 petabytes|Image_Size=|Space=900+ m2|OS=|Power=6 MW|Architecture=13,824 Nvidia Ampere GPU cores|Location=Bologna, Italy|Operators=CINECA|Sponsors=European High-Performance Computing Joint Undertaking|Dates=November 24, 2022|Caption=|Alt=|Sources=|os=Red Hat Enterprise Linux (RHEL){{Cite journal |last=Turisini |first=Matteo |last2=Cestari |first2=Mirko |last3=Amati |first3=Giorgio |date=2024-01-15 |title=LEONARDO: A Pan-European Pre-Exascale Supercomputer for HPC and AI applications |url=https://jlsrf.org/index.php/lsf/article/view/186 |journal=Journal of Large-scale Research Facilities JLSRF |volume=9 |issue=1 |doi=10.17815/jlsrf-8-186 |issn=2364-091X|doi-access=free }}}}
Leonardo is a petascale supercomputer located at the CINECA datacenter in Bologna, Italy. The system consists of an Atos BullSequana XH2000 computer, with close to 14,000 Nvidia Ampere GPUs and 200 Gbit/s Nvidia Mellanox HDR InfiniBand connectivity.{{Cite web|date=October 15, 2020|title=Leonardo: The European HPC path toward the digital Era|url=http://www.cineca.it/en/hot-topics/Leonardo-announce|access-date=2021-07-14|website=Cineca|language=}} Inaugurated in November 2022, Leonardo is capable of 250 petaflops (250 quadrillion operations per second), making it one of the top five fastest supercomputers in the world.{{cite press release |date=2022-11-24 |title=LEONARDO is inaugurated: Europe welcomes a new world-leading supercomputer |url=https://eurohpc-ju.europa.eu/leonardo-inaugurated-europe-welcomes-new-world-leading-supercomputer-2022-11-24_en |website=European High-Performance Computing Joint Undertakin}}{{Cite web |date=2022-07-21 |title=Arriva Leonardo, 30 tir per portare il supercomputer del Tecnopolo |url=https://bologna.repubblica.it/cronaca/2022/07/21/news/arriva_leonardo_30_tir_per_portare_il_supercomputer_del_tecnopolo-358655058/ |access-date=2022-08-11 |website=la Repubblica |language=it}} It debuted on the TOP500 in November 2022 ranking fourth in the world, and second in Europe.{{Cite web |title=November 2022 {{!}} TOP500 |url=https://www.top500.org/lists/top500/2022/11/ |access-date=2023-04-16 |website=TOP500}}
Architecture
The system is constructed as three separate "modules".{{Cite web|date=May 21, 2021|title=EuroHPC Systems Leonardo, Lumi Share More Details as Finish Lines Near|url=https://www.hpcwire.com/2021/05/20/eurohpc-systems-leonardo-lumi-share-more-details-as-finish-lines-near/|access-date=2021-08-24|website=HPCwire|language=en-US}} The first, known as the "booster module", consists of 13,824 Nvidia A100 GPUs, grouped four per node, for a total of 3,456 nodes. This module will be capable of 240.50 LINPACK petaflops, and is expected to be online by autumn 2022. The second module, called the "data centric module", is made up of 1,536 Intel Sapphire Rapids CPUs,{{Cite web|last=|first=|date=October 15, 2020|title=Nvidia and Cineca Team Up to Create World's Fastest AI Supercomputer|url=https://www.tomshardware.com/uk/news/leonardo-worlds-fastest-ai-supercomputer|access-date=2021-08-03|website=Tom's Hardware|language=en}} and will be capable of 8.97 LINPACK petaflops.{{Cite web|date=May 31, 2021|title=Leonardo, the new Italian answer to the high performance computing demand|url=https://www.acrossproject.eu/leonardo-the-new-italian-answer-to-the-high-performance-computing-demand/|access-date=2021-08-24|website=ACROSS Project}} These two computing modules will be complemented by a "front-end & service module", and backed by two storage systems; 5 PB of high IOPS storage with 1 TB/s bandwidth and 100 PB of high capacity storage with {{val|500|u=GB/s}} bandwidth. The components will be joined up by a 200 Gbit/s InfiniBand interconnect.{{cite speech|title=Towards ExcascaleComputing in Europe|first=Erwin|last=Laure|event=Lecture Series of the Research Center HPC|location=Universität Innsbruck (online)|date=January 27, 2021|url=https://www.uibk.ac.at/fz-hpc/events/resources/exascale-ibk-27012021.pdf#page=14}}
= Booster Module =
The 3,456 individual nodes which make up the "booster module" are custom BullSequana X2135 "Da Vinci" blade servers, each composed of:
- 1x Intel Xeon 8358 CPU, with 32 cores running at 2.6 GHz
- 512 GB RAM DDR4 3200 MHz
- 4x NVidia custom Ampere GPU, 64 GB HBM2
- 2x NVidia HDR InfiniBand network adapters, each with two 100 Gbit/s ports
Each node is expected to deliver 89.4 TFLOPs peak.{{Cite web |date=April 27, 2022 |title=Technical Info {{!}} Leonardo Pre-exascale Supercomputer |url=https://leonardo-supercomputer.cineca.eu/hpc-system/ |access-date=2022-08-11 |language=en-GB}}
= Data Centric Module =
The "data centric module" consists of 1536 nodes, each comprising a BullSequana X2610 compute blade with:
- 2x Intel Sapphire Rapids CPUs, with 56 cores
- 512 GB RAM DDR5 4800 MHz
- 1x NVidia HDR InfiniBand network adapter, with one 100 Gbit/s port
- 8 TB NVM storage
= Front-end & Service Module =
This module is responsible for login handling, visualisation and system service and management. It consists of 16 nodes, each having:
- 2x Ice Lake CPUs, with 32 cores
- 512 GB RAM
- 1x NVidia HDR InfiniBand network adapter, with two 100 Gbit/s ports
- 6 TB disk storage in RAID-1 configuration
16 additional nodes are also equipped with:
- 2x NVidia Quadro RTX8000 48 GB (for visualisations)
- 6.4 TB NVMe disk array
= Storage =
Leonardo will have access to two storage tiers:
Funding
Leonardo is part of the European High-Performance Computing Joint Undertaking, and receives €120 million in funding from the EU. This is matched by a further €120 million from the Italian Ministry of Education, University and Research.{{Cite web |date=February 23, 2022 |title=Ricerca: la commissaria UE Gabriel e il Ministro Messa all'hub dei big data del tecnopolo di Bologna |url=https://www.mur.gov.it/it/news/mercoledi-23022022/ricerca-la-commissaria-ue-gabriel-e-il-ministro-messa-allhub-dei-big-data |access-date=2022-08-11 |website=Ministero dell'Università e della Ricerca |language=it}}
Bologna Technopole
The building housing Leonardo is known as the Bologna Technopole, and used to be home to a tobacco factory.{{Cite web |date=May 9, 2022 |title=Technopole {{!}} Leonardo Pre-exascale Supercomputer |url=https://leonardo-supercomputer.cineca.eu/technopole/ |access-date=2022-08-11 |language=en-GB}} It was built in 1952 by Pier Luigi Nervi, who was famous for his innovative use of reinforced concrete. In addition to Leonardo, the building also houses the European Centre for Medium-Range Weather Forecasts' new supercomputer, consisting of four Atos BullSequana XH2000 clusters, which replaces their earlier facility in Reading, England.{{Cite web |last=Smolaks |first=Max |date=June 23, 2017 |title=Italy chosen to host meteorological supercomputer |url=https://www.datacenterdynamics.com/en/news/italy-chosen-to-host-meteorological-supercomputer/ |access-date=2022-08-11 |website=www.datacenterdynamics.com |language=en}}