Trinity (supercomputer)

{{Infobox custom computer

| Image = Trinity (supercomputer).jpg

| Caption = Trinity in August 2015

| Dates =

| Operators = National Nuclear Security Administration

| Sponsors =

| Location = Los Alamos National Laboratory

| Architecture =

| Memory =

| Storage =

| Speed =

| OS =

| Power =

| Space =

| Cost = US$174M{{cite press |date=July 10, 2014 | url=http://investors.cray.com/phoenix.zhtml?c=98390&p=irol-newsArticle&ID=1946457 | title=Cray Awarded $174 Million Supercomputer Contract From the National Nuclear Security Administration | accessdate=2014-08-24 | archive-date=2017-10-18 | archive-url=https://web.archive.org/web/20171018220220/http://investors.cray.com/phoenix.zhtml?c=98390&p=irol-newsArticle&ID=1946457 | url-status=dead }}

| ChartName =

| ChartPosition =

| ChartDate =

| Purpose = Primarily utilized to perform milestone weapons calculations

| Legacy =

| Emulators =

| Website = {{URL|https://lanl.gov/projects/trinity/}}

| Sources =

}}

Trinity (or ATS-1) is a United States supercomputer built by the National Nuclear Security Administration (NNSA) for the Advanced Simulation and Computing Program (ASC).{{cite news |last1=Morgan |first1=Timothy Prickett |title=With "Crossroads" Supercomputer, HPE Notches Another DOE Win |url=https://www.nextplatform.com/2020/10/01/with-crossroads-supercomputer-hpe-notches-another-doe-win/ |accessdate=5 November 2020 |work=The Next Platform |date=1 October 2020}} The aim of the ASC program is to simulate, test, and maintain the United States nuclear stockpile.

History

  • Trinity succeeded Cielo
  • December 2013, The National Energy Research Scientific Computing Center (NERSC) and The Alliance for Computing at Extreme Scale (ACES) releases a joint RFP with technical requirements for Trinity.{{Cite web |url=http://www.nersc.gov/users/computational-systems/cori/nersc-8-procurement/trinity-nersc-8-rfp/ |title=Trinity / NERSC-8 RFP |access-date=2018-11-26 |archive-date=2018-11-26 |archive-url=https://web.archive.org/web/20181126134854/http://www.nersc.gov/users/computational-systems/cori/nersc-8-procurement/trinity-nersc-8-rfp/ |url-status=dead }}
  • July 2014, Cray announces that they were awarded the $174 Million contract by the National Nuclear Security Administration to provide a next generation supercomputer to Los Alamos National Laboratory.
  • June 2015, Haswell Partition installation begins.{{Cite web|url=https://www.hpcwire.com/2017/07/19/trinity-supercomputers-haswell-knl-partitions-merged/|title = Trinity Supercomputer's Haswell and KNL Partitions Are Merged|date = 19 July 2017}}
  • November 2015, Trinity appears on the Supercomputing Top500 list at #6.{{Cite web|url=https://www.top500.org/lists/2015/11/|title = Novermber [sic] 2015 | TOP500}}
  • June 2016, Knights Landing Partition installation begins.{{Cite web|url=https://insidehpc.com/2017/07/lanl-adds-capacity-trinity-supercomputer-stockpile-stewardship/|title=LANL Adds Capacity to Trinity Supercomputer for Stockpile Stewardship|date=24 July 2017}}
  • November 2016, Trinity falls to #10 on the Top500 list.{{Cite web|url=https://www.top500.org/lists/2016/11/|title = November 2016 | TOP500}}
  • July 2017, The Haswell and KNL partitions are merged.
  • November 2018, Trinity regains #6 spot on the Top500 list.{{Cite web|url=https://www.top500.org/lists/2018/11/|title = November 2018 | TOP500}}
  • December 2020, Trinity falls to #13 on the Top500 list.{{Cite web |date=December 3, 2020|title=NNSA supercomputers recognized worldwide for speed and performance |url=https://www.energy.gov/nnsa/articles/nnsa-supercomputers-recognized-worldwide-speed-and-performance |access-date=2023-11-13 |website=Energy.gov |language=en}}
  • Trinity's successor will be Crossroads.

Trinity technical specifications

class="wikitable"

!Trinity High-Level Technical Specifications

!{{Cite web|url=https://www.lanl.gov/projects/trinity/specifications.php|title = Technical Specifications}}

Operational Lifetime

|2015 to 2020

Architecture

|Cray XC40

Memory Capacity

|2.07 PiB

Peak Performance

|41.5 PF/s

Number of Compute Nodes

|19,420

Parallel File System Capacity

|78 PB (69 PiB)

Burst Buffer Capacity

|3.7 PB

Footprint

|4606 sq ft

power requirement

|8.6 MW

Compute Tier

Trinity was built in 2 stages. The first stage incorporated the Intel Xeon Haswell processor while the second stage added a significant performance increase using the Intel Xeon Phi Knights Landing Processor.

There are 301,952 Haswell and 678,912 Knights Landing processors in the combined system, yielding a total peak performance of over 40 PF/s (petaflops)

Storage Tiers

There are 5 primary storage tiers; Memory, Burst Buffer, Parallel File System, Campaign Storage, and Archive.{{Cite conference | book-title=Storage Developer Conference | date=2018 | url=https://www.snia.org/sites/default/files/SDC/2018/presentations/General_Session/Grider_Gary_Storage_Lessons_from_HPC_A_Multi-Decadal_Struggle.pdf | title=Storage Lessons from HPC: A Multi-Decadal Struggle | website=www.snia.org | first=Gary | last=Grider}}

= Memory =

2 PiB of DDR4 DRAM provide physical memory for the machine. Each processor also has DRAM built on to the tile, providing additional memory capacity. The data in this tier is highly transient and is typically in residence for only a few seconds, being overwritten continuously.

= Burst Buffer =

Cray supplies the three hundred XC40 Data Warp blades that each contain 2 Burst Buffer nodes and 4 SSD drives. There is a total of 3.78 PB of storage in this tier, capable of moving data at a rate of up to 2 TB/s. In this tier, data is typically resident for a few hours, with data being overwritten in approximately that same time frame.

= Parallel File System =

Trinity uses a Sonexion based Lustre file system with a total capacity of 78 PB. Throughput on this tier is about 1.8 TB/s (1.6 TiB/s). It is used to stage data in preparation for HPC operations.

Data residence in this tier is typically several weeks.

= Campaign Storage =

The MarFS Filesystem fits into the Campaign Storage tier and combines properties of POSIX and Object storage models.

The capacity of this tier is growing at a rate of about 30 PB/year, with a current capacity of over 100 PB.

In testing, LANL scientists were able to create 968 billion files in a single directory at a rate of 835 million file creations per second.

This storage is designed to be more robust than typical object storage, while sacrificing some of the end user functionality that you would get from a POSIX system.

Performance of this tier is between 100-300 GB/s of throughput.

Data residence in this tier is longer term, typically lasting several months.

== Key Design goals ==

  • Transparency
  • Data protection
  • Recoverability
  • Ease of administration

MarFS is an open source filesystem.{{Cite web | url=https://github.com/mar-file-system/marfs | title=MarFS | website=github.com | access-date=2024-07-22}}

= Archive =

The final layer of storage is the Archive. This is a HPSS tape file system that holds approximately 100 PB of data.

File:Trinity Storage Tiers image.jpg

See also

References