Torsten Hoefler

Hoefler received his Diplom in Computer Science from TU Chemnitz where he received the best student award in 2005.{{Cite web|url=https://www.tu-chemnitz.de/tu/pressestelle/aktuell/316|title=Leistung, die sich auszahlt|website=www.tu-chemnitz.de|access-date=22 June 2023}} He worked on high-performance computing systems from the very beginning of his career. He continued his studies at Indiana University, the home of Open MPI, under the guidance of Prof. Andrew Lumsdaine. He received his PhD in Computer Science in 2008 from Indiana University and was subsequently honored with the university's Young Alumni Award{{Cite web|url=https://honorsandawards.iu.edu/awards/honoree/7318.html|title=Torsten Hoefler: University Honors and Awards: Indiana University|website=University Honors & Awards|access-date=22 June 2023}} as well as Distinguished Alumni Award{{Cite web|url=https://news.luddy.indiana.edu/story.html?story=Luddy-School-honors-2023-alumni-award-winners|title=Luddy School honors 2023 alumni award winners|website=IU News Archive|access-date=6 Nov 2023}}

He continued his work on the Message Passing Interface standard as a key member of the MPI Forum{{Cite web|url=https://www.mpi-forum.org/|title=MPI Forum|website=www.mpi-forum.org|access-date=22 June 2023}} responsible for the chapters on Collective Communication and Process Topologies as well as co-authoring the chapter on One-Sided Communications.{{cite web |title=MPI 3.1 Specification|url=https://www.mpi-forum.org/docs/mpi-3.1/mpi31-report.pdf}}

In 2010, he joined the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign (UIUC). As lead for application performance analysis and support, he supported the design and deployment of the Blue Waters Supercomputer.{{Cite web |title=Blue Waters staff, partners bring home awards from SC10 |url=https://www.ncsa.illinois.edu/archive/blue-waters-staff-partners-bring-home-awards-from-sc10/ |access-date=2023-02-17 |website=NCSA |date=24 November 2010 |language=en-US}} He also held a position as adjunct professor at UIUC's Computer Science department. He accepted a position as assistant professor at ETH Zurich in 2011,{{Cite web|url=https://www.ethlife.ethz.ch/archive_articles/111202_Neue_Professoren/index_EN.html|title=16 new professors at the ETH Zurich|website=www.ethlife.ethz.ch|access-date=22 June 2023}} where he received tenure in 2017,{{Cite web |title=18 professors appointed at ETH Zurich and EPFL |url=https://www.admin.ch/gov/en/start/documentation/media-releases.msg-id-66750.html |access-date=2023-02-17 |website=www.admin.ch}} and is full professor from 2020.{{Cite web|url=https://www.admin.ch/gov/en/start/documentation/media-releases.msg-id-80506.html|title=11 new professors appointed at ETH Zurich and EPFL|website=www.admin.ch|access-date=22 June 2023}}

Hoefler has held various visiting researcher positions at French Alternative Energies and Atomic Energy Commission in France, CINECA in Italy, as well as Argonne National Laboratory, Sandia National Laboratory, and Microsoft in the United States. As a consultant, he supported Cray Inc. in the area of high-performance networking and Microsoft Corporation in the areas of quantum computing and large-scale artificial intelligence systems. He spent his sabbatical in 2019 at Microsoft helping to establish various AI supercomputing efforts including the Maia 100 system.{{cite patent |country=US |number=11076210|pubdate=2021-07-27|title=Distributed processing architecture|assign1=Microsoft Technology Licensing LLC|inventor1-last=Hoefler|inventor1-first=Torsten |inventor2-last=Heddes|inventor2-first=Mattheus C.|inventor3-last=Belk|inventor3-first=Jonathan R.}}{{cite patent |country=US |number=11886938|pubdate=2021-03-11|title=Message communication between integrated computing devices|assign1=Microsoft Technology Licensing LLC|inventor1-last=Goel|inventor1-first=Deepak |inventor2-last=Heddes|inventor2-first=Mattheus C.|inventor3-last=Hoefler|inventor3-first=Torsten|inventor4-last=Xu|inventor4-first=Xialing}}{{Cite web|url=https://news.microsoft.com/source/features/ai/in-house-chips-silicon-to-service-to-meet-ai-demand/|title=With a systems approach to chips, Microsoft aims to tailor everything 'from silicon to service' to meet AI demand

|access-date=11 February 2024}}

Hoefler has been an elected member of the ACM SIGHPC executive committee since its founding in 2011.{{Cite web|url=https://www.sighpc.org/about/executive-committee|title=Meeting Your Needs - Executive Committee|website=www.sighpc.org|access-date=22 June 2023}}

He was elected IEEE Fellow for “contributions to large-scale parallel processing systems and supercomputers”, ACM Fellow for “foundational contributions to High-Performance Computing and the application of HPC techniques to machine learning”, and he received the IEEE Sidney Fernbach Award in 2022 for “application-aware design of HPC algorithms, systems and architectures, and transformative impact on scientific computing and industry”.

Hoefler received the inaugural Jack Dongarra award at ISC High Performance Conference in 2023.{{Cite web|url=https://www.hpcwire.com/off-the-wire/torsten-hoefler-earns-first-jack-dongarra-early-career-award/|title=Torsten Hoefler Earns First Jack Dongarra Early Career Award|website=HPCwire|access-date=22 June 2023}}{{Cite web|url=https://www.isc-hpc.com/press-releases/torsten-hoefler-earns-first-jack-dongarra-early-career-award.html|title=Torsten Hoefler Earns First Jack Dongarra Early Career Award - Welcome to ISC High Performance 2023|website=www.isc-hpc.com|access-date=22 June 2023}}{{Cite web|url=https://insidehpc.com/2023/04/torsten-hoefler-named-first-winner-of-jack-dongarra-early-career-award/|title=Torsten Hoefler Named First Winner of Jack Dongarra Early Career Award|date=17 April 2023|access-date=22 June 2023}} He was appointed as a senior fellow of the Abu Dhabi Investment Authority Labs in 2023.{{Cite web|url=https://www.hpcwire.com/off-the-wire/adia-lab-appoints-senior-fellows/|title=ADIA Lab Appoints Senior Fellows|access-date=15 February 2024}}{{Cite web|url=https://www.adialab.ae/fellows|title=Fellows|access-date=15 February 2024}}

Hoefler is known for his contributions to the Message Passing Interface (MPI) standard. He served as author for the chapters “Collective Communication” and “Process Topologies” in MPI-2.2 [https://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf] and the chapters “Collective Communication”, “One-Sided Communications”, and “Process Topologies” in MPI-3 [https://www.mpi-forum.org/docs/mpi-3.0/mpi30-report.pdf]. For the MPI-3 standardization, he chaired the Collective Communications and Topology working groups.{{Cite web|url=https://www.mpi-forum.org/mpi-30/collectives-wg|title=MPI 3.0 Collective Communications and Topology Working Group|access-date=8 November 2023}}

He developed principles for the implementation of nonblocking collective operations and remote memory access that are widely used in MPI implementations such as OpenMPI, MPICH, and derivatives.{{Cite web|url=https://htor.inf.ethz.ch/publications/index.php?pub=46|title=Implementation and Performance Analysis of Non-Blocking Collective Operations for MPI|access-date=8 November 2023}} Nonblocking collective operations such as allreduce, allgather, or broadcast form the basis of modern AI training systems.{{Cite web|url=https://cloud.google.com/blog/products/ai-machine-learning/how-to-optimize-google-cloud-for-deep-learning-training|title=Improving NCCL performance for cloud ML applications

|access-date=8 November 2023}}

After co-authoring a pioneering paper on parallel deep learning{{Cite journal|url=https://dl.acm.org/doi/abs/10.1145/3320060|title=Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis|journal=ACM Comput. Surv. |date=30 August 2019 |volume=52 |issue=4 |pages=65:1–65:43 |doi=10.1145/3320060 |s2cid=220247313 |access-date=8 November 2023 |last1=Ben-Nun |first1=Tal |last2=Hoefler |first2=Torsten }} and during his sabbatical at Microsoft, he coined the term “3D parallelism” in modern artificial intelligence training that organizes data parallelism, pipeline parallelism, and operator/tensor parallelism into one consistent view.{{Cite web|url=https://dl.acm.org/doi/10.5555/3571885.3571899|title=HammingMesh: a network topology for large-scale deep learning|date=18 November 2022 |pages=1–18 |access-date=8 November 2023}}

In his work on high-speed interconnects, he co-developed several award-winning network topologies{{Cite book|chapter-url=https://ieeexplore.ieee.org/document/7013016|chapter=Slim Fly: A Cost Effective Low-Diameter Network Topology|doi=10.1109/SC.2014.34 |arxiv=1912.08968 |s2cid=2149630 |access-date=8 November 2023 |title=SC14: International Conference for High Performance Computing, Networking, Storage and Analysis |date=2014 |last1=Besta |first1=Maciej |last2=Hoefler |first2=Torsten |pages=348–359 |isbn=978-1-4799-5500-8 }}{{Cite book|chapter-url=https://ieeexplore.ieee.org/document/5577310|chapter=The PERCS High-Performance Interconnect|doi=10.1109/HOTI.2010.16 |s2cid=16627945 |access-date=8 November 2023 |title=2010 18th IEEE Symposium on High Performance Interconnects |date=2010 |last1=Arimilli |first1=Baba |last2=Arimilli |first2=Ravi |last3=Chung |first3=Vicente |last4=Clark |first4=Scott |last5=Denzel |first5=Wolfgan |last6=Drerup |first6=Ben |last7=Hoefler |first7=Torsten |last8=Joyner |first8=Jody |last9=Lewis |first9=Jerry |last10=Li |first10=Jian |last11=Ni |first11=Nan |last12=Rajamony |first12=Ram |pages=75–82 |isbn=978-1-4244-8547-5 }} and contributed routing algorithms that are used in the OpenSM routing manager on InfiniBand computer clusters.{{Cite book|chapter-url=https://ieeexplore.ieee.org/document/5238677|chapter=Optimized Routing for Large-Scale InfiniBand Networks|doi=10.1109/HOTI.2009.9 |s2cid=12742852 |access-date=8 November 2023 |title=2009 17th IEEE Symposium on High Performance Interconnects |date=2009 |last1=Hoefler |first1=Torsten |last2=Schneider |first2=Timo |last3=Lumsdaine |first3=Andrew |pages=103–111 }}

On the application side, Hoefler focuses on improving the performance of climate simulations as a digital twin{{Cite web|url=https://c2sm.ethz.ch/research/past-projects/crCLIM.html|title=Convection-resolving climate modeling on future supercomputing platforms (crCLIM)|access-date=8 November 2023}}{{Cite web|url=https://ethz.ch/en/news-and-events/eth-news/news/2021/02/a-highly-accurate-digital-twin-of-our-planet.html|title=Scientists begin building highly accurate digital twin of our planet|date=23 February 2021 |access-date=8 November 2023}}{{Cite journal|url=https://www.nature.com/articles/s43588-021-00023-0|title=The digital revolution of Earth-system science|date=2021 |doi=10.1038/s43588-021-00023-0 |access-date=8 November 2023 |last1=Bauer |first1=Peter |last2=Dueben |first2=Peter D. |last3=Hoefler |first3=Torsten |last4=Quintino |first4=Tiago |last5=Schulthess |first5=Thomas C. |last6=Wedi |first6=Nils P. |journal=Nature Computational Science |volume=1 |issue=2 |pages=104–113 }} and machine learning for climate simulations.{{Cite journal|url=https://www.nature.com/articles/s43017-023-00468-z|title=Deep learning and a changing economy in weather and climate prediction|date=2023 |doi=10.1038/s43017-023-00468-z |access-date=8 November 2023 |last1=Bauer |first1=Peter |last2=Dueben |first2=Peter |last3=Chantry |first3=Matthew |last4=Doblas-Reyes |first4=Francisco |last5=Hoefler |first5=Torsten |last6=McGovern |first6=Amy|author6-link=Amy McGovern |last7=Stevens |first7=Bjorn |journal=Nature Reviews Earth & Environment |volume=4 |issue=8 |pages=507–509 |bibcode=2023NRvEE...4..507B }} He has been a convener of the Berlin Summit in Earth Virtualization Engines{{Cite web|url=https://eve4climate.org/participants|title=Participants|access-date=8 November 2023}} to develop strategies to enable global access to high-resolution climate simulations.{{Cite journal|url=https://essd.copernicus.org/preprints/essd-2023-376/|title=Earth Virtualization Engines (EVE)|date=2024 |doi=10.5194/essd-16-2113-2024 |doi-access=free |access-date=8 November 2023 |last1=Stevens |first1=Bjorn |last2=Adami |first2=Stefan |last3=Ali |first3=Tariq |last4=Anzt |first4=Hartwig |last5=Aslan |first5=Zafer |last6=Attinger |first6=Sabine |last7=Bäck |first7=Jaana |last8=Baehr |first8=Johanna |last9=Bauer |first9=Peter |last10=Bernier |first10=Natacha |last11=Bishop |first11=Bob |last12=Bockelmann |first12=Hendryk |last13=Bony |first13=Sandrine |last14=Brasseur |first14=Guy |last15=Bresch |first15=David N. |last16=Breyer |first16=Sean |last17=Brunet |first17=Gilbert |last18=Buttigieg |first18=Pier Luigi |last19=Cao |first19=Junji |last20=Castet |first20=Christelle |last21=Cheng |first21=Yafang |last22=Dey Choudhury |first22=Ayantika |last23=Coen |first23=Deborah |last24=Crewell |first24=Susanne |last25=Dabholkar |first25=Atish |last26=Dai |first26=Qing |last27=Doblas-Reyes |first27=Francisco |last28=Durran |first28=Dale |last29=El Gaidi |first29=Ayoub |last30=Ewen |first30=Charlie |journal=Earth System Science Data |volume=16 |issue=4 |pages=2113–2122 |bibcode=2024ESSD...16.2113S |display-authors=1 |hdl=20.500.11850/671027 |hdl-access=free }}{{Cite web|url=https://www.computer.org/csdl/magazine/cs/2023/03/10301438/1RFBSF5ALWE|title=Earth Virtualization Engines: A Technical Perspective|access-date=8 November 2023}}

Hoefler has been vocal about improving reproducibility of performance measurements in high-performance computing{{Cite web|url=https://ieeexplore.ieee.org/document/7832847|title=Scientific benchmarking of parallel computing systems: twelve ways to tell the masses when reporting performance results|doi=10.1145/2807591.2807644 |s2cid=165618 |access-date=8 November 2023}} and later machine learning. The latter is featured in IEEE Computer Journal as a cover feature on Research Reproducibility.{{Cite journal|url=https://ieeexplore.ieee.org/document/9847318|title=Benchmarking Data Science: 12 Ways to Lie With Statistics and Performance on Parallel Computers|date=2022 |doi=10.1109/MC.2022.3152681 |s2cid=251294669 |access-date=8 November 2023 |last1=Hoefler |first1=Torsten |journal=Computer |volume=55 |issue=8 |pages=49–56 }}

As Technical Papers chair of ACM/IEEE Supercomputing Conference (SC18), he introduced a new revision-based review process to the conference to improve the quality of the publications.{{Cite web|url=https://insidehpc.com/2018/03/breaking-news-major-enhancements-sc18-papers-submission-process-planned/|title=SC18 Papers Submissions Open Today with New Review Process

|date=March 2018

|access-date=8 November 2023}}

His group received the SIGHPC Certificate of Appreciation for reproducible methods at the ACM/IEEE Supercomputing Conference (SC22) ACM student cluster competition.{{Cite web|url=https://sc22.supercomputing.org/2022/12/05/congratulations-to-all-of-this-years-sc-and-society-awardees/|title=Congratulations to All of This Year's SC and Society Awardees

|access-date=8 November 2023}} His paper on HammingMesh received the ACM/IEEE Supercomputing Conference (SC22) Best Reproducibility Advancement Award.{{Cite web|url=https://news.iu.edu/live/news/30536-luddy-alum-receives-prestigious-award-for|title=Luddy alum receives prestigious award for contributions to high performance computing|access-date=8 November 2023}} He also presented the opening keynote at the first ACM Conference on Reproducibility and Replicability.{{Cite web|url=https://acm-rep.github.io/2023/keynotes/|title=Featured Keynote Speakers|date=31 March 2023 |access-date=8 November 2023}}

Hoefler and his team received six best (student) paper awards at the ACM/IEEE Supercomputing Conference between 2010 and 2023,{{Cite web|url=https://www.ncsa.illinois.edu/archive/blue-waters-staff-partners-bring-home-awards-from-sc10/|title=Blue Waters staff, partners bring home awards from SC10|date=24 November 2010 |access-date=11 February 2024}}{{Cite web|url=https://sc13.supercomputing.org/content/sc13-concludes-awards-outstanding-achievements-hpc.html|title=SC13 Concludes with Awards for Outstanding Achievements in HPC|access-date=11 February 2024}}{{Cite web|url=https://www.businesswire.com/news/home/20141121005943/en/Supercomputing-2014-Recognizes-Outstanding-Achievements-in-HPC|title=Supercomputing 2014 Recognizes Outstanding Achievements in HPC|access-date=11 February 2024}}{{Cite web|url=https://sc19.supercomputing.org/2019/11/25/congratulations-to-the-sc-and-society-awardees-for-sc19-in-denver/index.html|title=Congratulations to the SC and Society Awardees for SC19 in Denver

|date=25 November 2019

|access-date=11 February 2024}} the top conference in High-Performance Computing. Additional important awards are listed below.

2025

• ACM Prize in Computing

2024

• Max Planck Humboldt Medal jointly awarded by the Max Planck Society, the Alexander von Humboldt Foundation, and the German Federal Ministry of Education and Research.

2023

• ACM Fellow, class of 2022
• Jack Dongarra Early Career Award

2022

• IEEE CS Sidney Fernbach Award
• Luddy Distinguished Alumni Award{{Cite web |title=Luddy alum receives prestigious award for contributions to high performance computing |url=https://itnews.iu.edu/articles/2022/luddy-alum-receives-prestigious-award-sc22.php |access-date=2023-02-17 |website=Luddy alum receives prestigious award for contributions to high performance computing}}
• IEEE Fellow, class of 2021

2021

• HPCWire "People to Watch"{{Cite web |title=HPCwire Unveils Honorees for Its 2021 People to Watch Feature |url=https://www.hpcwire.com/off-the-wire/hpcwire-unveils-honorees-for-its-2021-people-to-watch-feature/ |access-date=2023-02-17 |website=HPCwire |language=en-US}}

2020

• ERC Consolidator Grant{{Cite web |title=ERC Consolidator Grants 2020 |url=https://erc.europa.eu/sites/default/files/document/file/erc-2020-cog-results-all-domains.pdf}}{{Cite web |title=Olga Sorkine-Hornung and Torsten Hoefler receive 2 ERC Consolidator Grants |url=https://inf.ethz.ch/news-and-events/spotlights/2020/12/sorkine-hornung-hoefler-erc-grant.html |access-date=2023-02-17 |website=inf.ethz.ch |language=en}}
• BenchCouncil Rising Star Award{{Cite web |title=Torsten Hoefler receives BenchCouncil Rising Star Award |url=https://inf.ethz.ch/news-and-events/spotlights/infk-news-channel/2020/11/rising-star-award-torsten-hoefler.html |access-date=2023-02-17 |website=inf.ethz.ch |date=18 November 2020 |language=en}}

2019

• ACM Gordon Bell Prize{{Cite web |title=ACM Names Recipients of 2019 Gordon Bell Prize |url=https://www.acm.org/media-center/2019/november/gordon-bell-prize-2019 |access-date=2023-02-17 |website=www.acm.org |language=en}}
• IEEE TCSC Award for Excellence in Scalable Computing (MCR){{Cite web |title=Middle Award |url=http://www.ieee-tcsc.org/middle.php |access-date=2023-02-17 |website=www.ieee-tcsc.org}}

2015

• Latsis Prize of ETH Zürich
• ERC Starting Grant{{Cite web |title=ERC Starting Grants 2015 |url=https://erc.europa.eu/sites/default/files/document/file/erc_2015_stg_results_all_domains.pdf}}

2014

• Young Alumni Award, Indiana University School of Informatics{{Cite web |title=Torsten Hoefler: University Honors and Awards: Indiana University |url=https://honorsandawards.iu.edu/awards/honoree/7318.html |access-date=2023-02-17 |website=University Honors & Awards |language=en-US}}

2013

• IEEE TCSC Young Achievers in Scalable Computing{{Cite web |title=Torsten Hoefler {{!}} IEEE Computer Society |date=3 October 2022 |url=https://www.computer.org/profiles/torsten-hoefler/ |access-date=2023-02-17 |language=en-US}}
• IBM Faculty Award{{Cite web|url=https://research.ibm.com/university/pdfs/2013_faculty_award_recipients.pdf|title=2013 Faculty Award recipients|access-date=22 June 2023}}

2012

• SIAM SIAG/SC Junior Scientist Prize{{Cite web |last=Black |first=Doug |date=2012-02-21 |title=Torsten Hoefler Wins 2012 SIAG/Supercomputing Junior Scientist Prize |url=https://insidehpc.com/2012/02/torsten-hoefler-wins-2012-siagsupercomputing-junior-scientist-prize/ |access-date=2023-02-17 |website=High-Performance Computing News Analysis {{!}} insideHPC |language=en-US}}

{{reflist}}

{{Authority control}}

{{Improve categories|date=September 2023}}

{{DEFAULTSORT:Hoefler, Torsten}}

Category:Year of birth missing (living people)

Category:Living people

Category:2022 fellows of the Association for Computing Machinery

Category:Fellows of the IEEE

Category:Members of Academia Europaea

Faculty

Category:Indiana University Bloomington alumni