floating point operations per second

{{Anchor|multipliers}}

Floating-point arithmetic is needed for very large or very small real numbers, or computations that require a large dynamic range. Floating-point representation is similar to scientific notation, except computers use base two (with rare exceptions), rather than base ten. The encoding scheme stores the sign, the exponent (in base two for Cray and VAX, base two or ten for IEEE floating point formats, and base 16 for IBM Floating Point Architecture) and the significand (number after the radix point). While several similar formats are in use, the most common is ANSI/IEEE Std. 754-1985. This standard defines the format for 32-bit numbers called single precision, as well as 64-bit numbers called double precision and longer numbers called extended precision (used for intermediate results). Floating-point representations can support a much wider range of values than fixed-point, with the ability to represent very small numbers and very large numbers.[http://www.dspguide.com/ch4/3.htm Floating Point] Retrieved on December 25, 2009.

The exponentiation inherent in floating-point computation assures a much larger dynamic range – the largest and smallest numbers that can be represented – which is especially important when processing data sets where some of the data may have extremely large range of numerical values or where the range may be unpredictable. As such, floating-point processors are ideally suited for computationally intensive applications.[http://www.analog.com/en/embedded-processing-dsp/content/Fixed-Point_vs_Floating-Point_DSP/fca.html Summary: Fixed-point (integer) vs floating-point] {{Webarchive|url=https://web.archive.org/web/20091231034504/http://www.analog.com/en/embedded-processing-dsp/content/Fixed-Point_vs_Floating-Point_DSP/fca.html |date=December 31, 2009 }} Retrieved on December 25, 2009.

FLOPS and MIPS are units of measure for the numerical computing performance of a computer. Floating-point operations are typically used in fields such as scientific computational research, as well as in machine learning. However, before the late 1980s floating-point hardware (it's possible to implement FP arithmetic in software over any integer hardware) was typically an optional feature, and computers that had it were said to be "scientific computers", or to have "scientific computation" capability. Thus the unit MIPS was useful to measure integer performance of any computer, including those without such a capability, and to account for architecture differences, similar MOPS (million operations per second) was used as early as 1970{{Cite book |url=https://books.google.com/books?id=ARwaAQAAMAAJ&pg=RA7-PA7 |title=NASA Technical Note |date=1970 |publisher=National Aeronautics and Space Administration. |language=en}} as well. Note that besides integer (or fixed-point) arithmetics, examples of integer operation include data movement (A to B) or value testing (If A = B, then C). That's why MIPS as a performance benchmark is adequate when a computer is used in database queries, word processing, spreadsheets, or to run multiple virtual operating systems.[http://www.dspguide.com/ch28/4.htm Fixed versus floating point.] Retrieved on December 25, 2009.[http://www.dspguide.com/ch28/1.htm Data manipulation and math calculation.] Retrieved on December 25, 2009. In 1974 David Kuck coined the terms flops and megaflops for the description of supercomputer performance of the day by the number of floating-point calculations they performed per second.{{Cite book |last=Kuck |first=D. J. |url=https://books.google.com/books?id=PFqzjuXL4YgC&pg=PA1 |title=Computer System Capacity Fundamentals |date=1974 |publisher=U.S. Department of Commerce, National Bureau of Standards |language=en}} This was much better than using the prevalent MIPS to compare computers as this statistic usually had little bearing on the arithmetic capability of the machine on scientific tasks.

File:Supercomputer Power (FLOPS), OWID.svg over time]]

FLOPS on an HPC-system can be calculated using this equation:{{Cite web |url=https://www.dell.com/support/article/fr/fr/frbsdt1/sln310893/nodes-sockets-cores-and-flops-oh-my |title="Nodes, Sockets, Cores and FLOPS, Oh, My" by Dr. Mark R. Fernandez, Ph.D. |access-date=February 12, 2019 |archive-date=February 13, 2019 |archive-url=https://web.archive.org/web/20190213005604/https://www.dell.com/support/article/fr/fr/frbsdt1/sln310893/nodes-sockets-cores-and-flops-oh-my |url-status=dead }}

: $\backslash text\{FLOPS\}\; =\; \backslash text\{racks\}\; \backslash times\; \backslash frac\{\backslash text\{nodes\}\}\{\backslash text\{rack\}\}\; \backslash times\; \backslash frac\{\backslash text\{sockets\}\}\{\backslash text\{node\}\}\; \backslash times\; \backslash frac\{\backslash text\{cores\}\}\{\backslash text\{socket\}\}\; \backslash times\; \backslash frac\{\backslash text\{cycles\}\}\{\; \backslash text\{second\}\}\; \backslash times\; \backslash frac\{\backslash text\{FLOPs\}\}\{\backslash text\{cycle\}\}.$

This can be simplified to the most common case: a computer that has exactly 1 CPU:

: $\backslash text\{FLOPS\}\; =\; \backslash text\{cores\}\; \backslash times\; \backslash frac\{\backslash text\{cycles\}\}\{\; \backslash text\{second\}\}\; \backslash times\; \backslash frac\{\backslash text\{FLOPs\}\}\{\backslash text\{cycle\}\}.$

FLOPS can be recorded in different measures of precision, for example, the TOP500 supercomputer list ranks computers by 64-bit (double-precision floating-point format) operations per second, abbreviated to FP64.{{cite web |title=FREQUENTLY ASKED QUESTIONS |url=https://www.top500.org/resources/frequently-asked-questions/ |website=top500.org |access-date=June 23, 2020}} Similar measures are available for 32-bit (FP32) and 16-bit (FP16) operations.

{{anchor|FLOPSforProcessors}}

{{Table alignment}}

{{sort-under}}

In June 1997, Intel's ASCI Red was the world's first computer to achieve one teraFLOPS and beyond. Sandia director Bill Camp said that ASCI Red had the best reliability of any supercomputer ever built, and "was supercomputing's high-water mark in longevity, price, and performance".{{cite web |title=Sandia's ASCI Red, world's first teraflop supercomputer, is decommissioned |url=http://www.jacobsequity.com/ASCI%20Red%20Supercomputer.pdf |access-date=November 17, 2011 |archive-url=https://web.archive.org/web/20101105131112/http://www.jacobsequity.com/ASCI%20Red%20Supercomputer.pdf |archive-date=November 5, 2010 }}

NEC's SX-9 supercomputer was the world's first vector processor to exceed 100 gigaFLOPS per single core.

In June 2006, a new computer was announced by Japanese research institute RIKEN, the MDGRAPE-3. The computer's performance tops out at one petaFLOPS, almost two times faster than the Blue Gene/L, but MDGRAPE-3 is not a general purpose computer, which is why it does not appear in the Top500.org list. It has special-purpose pipelines for simulating molecular dynamics.

By 2007, Intel Corporation unveiled the experimental multi-core POLARIS chip, which achieves 1 teraFLOPS at 3.13 GHz. The 80-core chip can raise this result to 2 teraFLOPS at 6.26 GHz, although the thermal dissipation at this frequency exceeds 190 watts.{{cite web|author=Richard Swinburne |url=http://www.bit-tech.net/hardware/2007/04/30/the_arrival_of_teraflop_computing/2 |title=The Arrival of TeraFLOP Computing |publisher=bit-tech.net |date=April 30, 2007 |access-date=February 9, 2012}}

In June 2007, Top500.org reported the fastest computer in the world to be the IBM Blue Gene/L supercomputer, measuring a peak of 596 teraFLOPS.{{cite news |url=http://top500.org/news/2007/06/23/29th_top500_list_world_s_fastest_supercomputers_released |title=29th TOP500 List of World's Fastest Supercomputers Released |date=June 23, 2007 |website=Top500.org |access-date=July 8, 2008 |archive-url=https://web.archive.org/web/20080509064814/http://www.top500.org/news/2007/06/23/29th_top500_list_world_s_fastest_supercomputers_released |archive-date=May 9, 2008 |df=mdy }} The Cray XT4 hit second place with 101.7 teraFLOPS.

On June 26, 2007, IBM announced the second generation of its top supercomputer, dubbed Blue Gene/P and designed to continuously operate at speeds exceeding one petaFLOPS, faster than the Blue Gene/L. When configured to do so, it can reach speeds in excess of three petaFLOPS.{{cite news |url=http://www.top500.org/lists/2008/06 |title=June 2008 |publisher=TOP500 |access-date=July 8, 2008 }}

On October 25, 2007, NEC Corporation of Japan issued a press release announcing its SX series model SX-9,{{cite news|url=http://www.nec.co.jp/press/en/0710/2501.html|title=NEC Launches World's Fastest Vector Supercomputer, SX-9|date=October 25, 2007|publisher=NEC|access-date=July 8, 2008}} claiming it to be the world's fastest vector supercomputer. The SX-9 features the first CPU capable of a peak vector performance of 102.4 gigaFLOPS per single core.

On February 4, 2008, the NSF and the University of Texas at Austin opened full scale research runs on an AMD, Sun supercomputer named Ranger,{{cite web

|url = http://www.tacc.utexas.edu/resources/hpcsystems/

|title = University of Texas at Austin, Texas Advanced Computing Center

|access-date = September 13, 2010

|quote = Any researcher at a U.S. institution can submit a proposal to request an allocation of cycles on the system.

|archive-url = https://web.archive.org/web/20090801102108/http://www.tacc.utexas.edu/resources/hpcsystems/

|archive-date = August 1, 2009

|df = mdy

}}

the most powerful supercomputing system in the world for open science research, which operates at sustained speed of 0.5 petaFLOPS.

On May 25, 2008, an American supercomputer built by IBM, named 'Roadrunner', reached the computing milestone of one petaFLOPS. It headed the June 2008 and November 2008 TOP500 list of the most powerful supercomputers (excluding grid computers).{{cite web |url=http://www.computerworld.com/action/article.do?command=viewArticleBasic&taxonomyName=hardware&articleId=9095318&taxonomyId=12&intsrc=kc_top |title=IBM's Roadrunner smashes 4-minute mile of supercomputing |access-date=June 10, 2008 |author=Sharon Gaudin |date=June 9, 2008 |publisher=Computerworld |archive-url=https://web.archive.org/web/20081224001155/http://www.computerworld.com/action/article.do?command=viewArticleBasic&taxonomyName=hardware&articleId=9095318&taxonomyId=12&intsrc=kc_top |archive-date=December 24, 2008 |df=mdy-all }}{{cite web|url=http://www.top500.org/lists/2008/11/press-release |title=Austin ISC08 |publisher=Top500.org |date=November 14, 2008 |access-date=February 9, 2012 |archive-url=https://web.archive.org/web/20120222023827/http://www.top500.org/lists/2008/11/press-release |archive-date=February 22, 2012 |df=mdy }} The computer is located at Los Alamos National Laboratory in New Mexico. The computer's name refers to the New Mexico state bird, the greater roadrunner (Geococcyx californianus).{{cite news|url=http://news.bbc.co.uk/1/hi/technology/7443557.stm|title=Supercomputer sets petaflop pace |last=Fildes|first=Jonathan |date=June 9, 2008|publisher=BBC News|access-date=July 8, 2008}}

In June 2008, AMD released ATI Radeon HD 4800 series, which are reported to be the first GPUs to achieve one teraFLOPS. On August 12, 2008, AMD released the ATI Radeon HD 4870X2 graphics card with two Radeon R770 GPUs totaling 2.4 teraFLOPS.

In November 2008, an upgrade to the Cray Jaguar supercomputer at the Department of Energy's (DOE's) Oak Ridge National Laboratory (ORNL) raised the system's computing power to a peak 1.64 petaFLOPS, making Jaguar the world's first petaFLOPS system dedicated to open research. In early 2009 the supercomputer was named after a mythical creature, Kraken. Kraken was declared the world's fastest university-managed supercomputer and sixth fastest overall in the 2009 TOP500 list. In 2010 Kraken was upgraded and can operate faster and is more powerful.

In 2009, the Cray Jaguar performed at 1.75 petaFLOPS, beating the IBM Roadrunner for the number one spot on the TOP500 list.{{cite news| url=https://www.forbes.com/2009/11/15/supercomputer-ibm-jaguar-technology-cio-network-cray.html?feed=rss_popstories | work=Forbes | first=Andy | last=Greenberg | title=Cray Dethrones IBM in Supercomputing | date=November 16, 2009}}

In October 2010, China unveiled the Tianhe-1, a supercomputer that operates at a peak computing rate of 2.5 petaFLOPS.{{cite news| url=https://www.bbc.co.uk/news/technology-11644252 | publisher=BBC News | title=China claims supercomputer crown | date=October 28, 2010}}{{cite web|last=Dillow |first=Clay |url=http://www.popsci.com/technology/article/2010-10/china-unveils-2507-petaflop-supercomputer-worlds-fastest |title=China Unveils 2507 Petaflop Supercomputer, the World's Fastest |website=Popsci.com |date=October 28, 2010 |access-date=February 9, 2012 }}

{{As of|2010}} the fastest PC processor reached 109 gigaFLOPS (Intel Core i7 980 XE){{Cite web |url=http://techgage.com/article/intels_core_i7-980x_extreme_edition_-_ready_for_sick_scores/8 |title=Intel's Core i7-980X Extreme Edition – Ready for Sick Scores?: Mathematics: Sandra Arithmetic, Crypto, Microsoft Excel |website=Techgage |date=March 10, 2010 |access-date=February 9, 2012}} in double precision calculations. GPUs are considerably more powerful. For example, Nvidia Tesla C2050 GPU computing processors perform around 515 gigaFLOPS{{cite web|url=http://www.nvidia.com/object/product_tesla_C2050_C2070_us.html |title=NVIDIA Tesla Personal Supercomputer |publisher=Nvidia.com |access-date=February 9, 2012}} in double precision calculations, and the AMD FireStream 9270 peaks at 240 gigaFLOPS.{{cite web|url=https://www.amd.com/us/products/workstation/firestream/firestream-9270/pages/firestream-9270.aspx |title=AMD FireStream 9270 GPU Compute Accelerator |publisher=Amd.com |access-date=February 9, 2012}}

In November 2011, it was announced that Japan had achieved 10.51 petaFLOPS with its K computer.{{cite web|url=http://www.fujitsu.com/global/news/pr/archives/month/2011/20111102-02.html |title='K computer' Achieves Goal of 10 Petaflops |publisher=Fujitsu.com |access-date=February 9, 2012}} It has 88,128 SPARC64 VIIIfx processors in 864 racks, with theoretical performance of 11.28 petaFLOPS. It is named after the Japanese word "kei", which stands for 10 quadrillion,See Japanese numbers corresponding to the target speed of 10 petaFLOPS.

On November 15, 2011, Intel demonstrated a single x86-based processor, code-named "Knights Corner", sustaining more than a teraFLOPS on a wide range of DGEMM operations. Intel emphasized during the demonstration that this was a sustained teraFLOPS (not "raw teraFLOPS" used by others to get higher but less meaningful numbers), and that it was the first general purpose processor to ever cross a teraFLOPS.{{cite web|url=http://www.tomshardware.com/news/intel-knights-corner-mic-co-processor,14002.html |title=Intel's Knights Corner: 50+ Core 22nm Co-processor|access-date=November 16, 2011|date=November 16, 2011}}{{cite web |url=http://www.eetimes.com/electronics-news/4230654/Intel-unveils-1-TFLOP-s-Knight-s-Corner |title=Intel unveils 1 TFLOP/s Knight's Corner |access-date=November 16, 2011 }}

On June 18, 2012, IBM's Sequoia supercomputer system, based at the U.S. Lawrence Livermore National Laboratory (LLNL), reached 16 petaFLOPS, setting the world record and claiming first place in the latest TOP500 list.{{cite news|last=Clark|first=Don|title=IBM Computer Sets Speed Record|url=https://www.wsj.com/articles/SB10001424052702303379204577472773983130902|access-date=June 18, 2012|newspaper=The Wall Street Journal|date=June 18, 2012}}

On November 12, 2012, the TOP500 list certified Titan as the world's fastest supercomputer per the LINPACK benchmark, at 17.59 petaFLOPS.{{cite news|url=https://www.bbc.co.uk/news/technology-20272810 |title=US Titan supercomputer clocked as world's fastest |publisher=BBC |date=November 12, 2012 |access-date=February 28, 2013}}{{cite web|url=http://top500.org/blog/lists/2012/11/press-release/ |title=Oak Ridge Claims No. 1 Position on Latest TOP500 List with Titan | TOP500 Supercomputer Sites |publisher=Top500.org |date=November 12, 2012 |access-date=February 28, 2013}} It was developed by Cray Inc. at the Oak Ridge National Laboratory and combines AMD Opteron processors with "Kepler" NVIDIA Tesla graphics processing unit (GPU) technologies.{{cite web |last=Montalbano |first=Elizabeth |url=http://www.informationweek.com/news/government/enterprise-architecture/231900554 |title=Oak Ridge Labs Builds Fastest Supercomputer |website=Informationweek |date=October 11, 2011 |access-date=February 9, 2012}}{{cite web |last=Tibken |first=Shara |url=http://news.cnet.com/8301-11386_3-57541791-76/titan-supercomputer-debuts-for-open-scientific-research/ |title=Titan supercomputer debuts for open scientific research | Cutting Edge |website=News.CNet.com |date=October 29, 2012 |access-date=February 28, 2013}}

On June 10, 2013, China's Tianhe-2 was ranked the world's fastest with 33.86 petaFLOPS.{{cite magazine|url=https://www.forbes.com/sites/alexknapp/2013/06/17/chinese-supercomputer-is-now-the-worlds-fastest-by-a-lot/ |title=Chinese Supercomputer Is Now The World's Fastest – By A Lot|magazine=Forbes Magazine |date=June 17, 2013 |access-date=June 17, 2013}}

On June 20, 2016, China's Sunway TaihuLight was ranked the world's fastest with 93 petaFLOPS on the LINPACK benchmark (out of 125 peak petaFLOPS). The system was installed at the National Supercomputing Center in Wuxi, and represented more performance than the next five most powerful systems on the TOP500 list did at the time combined.{{cite web|last=Feldman|first=Michael|title=China Races Ahead in TOP500 Supercomputer List, Ending US Supremacy|url=https://www.top500.org/news/china-races-ahead-in-top500-supercomputer-list-ending-us-supremacy/ |website=Top500.org |access-date=December 31, 2016 }}

In June 2019, Summit, an IBM-built supercomputer now running at the Department of Energy's (DOE) Oak Ridge National Laboratory (ORNL), captured the number one spot with a performance of 148.6 petaFLOPS on High Performance Linpack (HPL), the benchmark used to rank the TOP500 list. Summit has 4,356 nodes, each one equipped with two 22-core Power9 CPUs, and six NVIDIA Tesla V100 GPUs.{{Cite web |url=https://www.top500.org/lists/2018/06/ |title=June 2018 |website=Top500.org |access-date=2018-07-17 }}

In June 2022, the United States' Frontier was the most powerful supercomputer on TOP500, reaching 1102 petaFlops (1.102 exaFlops) on the LINPACK benchmarks.

{{cite web | url=https://en.wikipedia.org/wiki/TOP500 | title=TOP500 }}{{Circular reference|date=February 2025}}

In November 2024, the United States’ El Capitan exascale supercomputer, hosted at the Lawrence Livermore National Laboratory in Livermore, displaced Frontier as the world's fastest supercomputer in the 64th edition of the Top500 (Nov 2024).

Distributed computing uses the Internet to link personal computers to achieve more FLOPS:

• {{As of|2020|4}}, the Folding@home network has over 2.3 exaFLOPS of total computing power.{{Cite web|url=https://stats.foldingathome.org/os|title=Folding@Home Active CPUs & GPUs by OS|website=foldingathome.org|access-date=2020-04-08}}{{Cite web|url=https://twitter.com/foldingathome/status/1242918035788365830|title=Thanks to our AMAZING community, we've crossed the exaFLOP barrier! That's over a 1,000,000,000,000,000,000 operations per second, making us ~10x faster than the IBM Summit!pic.twitter.com/mPMnb4xdH3|last=Folding@home|date=March 25, 2020|website=@foldingathome|language=en|access-date=2020-04-04}}{{Cite web|url=https://www.extremetech.com/computing/308332-foldinghome-crushes-exascale-barrier-now-faster-than-dozens-of-supercomputers|title=Folding@Home Crushes Exascale Barrier, Now Faster Than Dozens of Supercomputers - ExtremeTech|website=extremetech.com|access-date=2020-04-04}}{{Cite web|url=https://www.techspot.com/news/84561-foldinghome-exceeds-15-exaflops-battle-against-covid-19.html|title=Folding@Home exceeds 1.5 ExaFLOPS in the battle against Covid-19|website=TechSpot|date=March 26, 2020 |language=en-US|access-date=2020-04-04}} It is the most powerful distributed computer network, being the first ever to break 1 exaFLOPS of total computing power. This level of performance is primarily enabled by the cumulative effort of a vast array of powerful GPU and CPU units.{{cite press release

|title = Sony Computer Entertainment's Support for Folding@home Project on PlayStation™3 Receives This Year's "Good Design Gold Award"

|url = http://www.scei.co.jp/corporate/release/081106de.html

|publisher = Sony Computer Entertainment Inc.

|date = November 6, 2008

|access-date = December 11, 2008

|url-status = dead

|archive-url = https://web.archive.org/web/20090131082202/http://www.scei.co.jp/corporate/release/081106de.html

|archive-date = January 31, 2009

|df = mdy

}}

• {{As of|2020|012}}, the entire BOINC network averages about 31 petaFLOPS.{{cite web |url=http://boinc.berkeley.edu/computing.php |title=BOINC Computing Power |publisher=BOINC |access-date=December 28, 2020}}
• {{As of|2018|06}}, SETI@home, employing the BOINC software platform, averages 896 teraFLOPS.{{cite web |url=http://boincstats.com/en/stats/0/project/detail |title=SETI@Home Credit overview |publisher=BOINC |access-date=June 15, 2018}}
• {{As of|2018|06}}, Einstein@Home, a project using the BOINC network, is crunching at 3 petaFLOPS.{{cite web |url=http://boincstats.com/en/stats/5/project/detail |title=Einstein@Home Credit overview |publisher=BOINC |access-date=June 15, 2018}}
• {{As of|2018|06}}, MilkyWay@home, using the BOINC infrastructure, computes at 847 teraFLOPS.{{cite web|url=http://boincstats.com/en/stats/61/project/detail|title=MilkyWay@Home Credit overview|publisher=BOINC|access-date=June 15, 2018}}
• {{As of|2020|06}}, GIMPS, searching for Mersenne primes, is sustaining 1,354 teraFLOPS.{{cite web |url=http://www.mersenne.org/primenet |title=Internet PrimeNet Server Distributed Computing Technology for the Great Internet Mersenne Prime Search |work=GIMPS |access-date=June 15, 2018 }}

{{div col|colwidth=20em}}

• Computer performance by orders of magnitude
• Exascale computing
• Gordon Bell Prize
• LINPACK benchmarks
• Moore's law
• Multiply–accumulate operation
• Performance per watt#FLOPS per watt
• SPECfp
• SPECint
• SUPS
• TOP500

{{div col end}}

{{clear}}

{{Reflist|refs=

}}

{{Graphics Processing Unit}}

{{CPU technologies}}

{{Authority control}}

{{DEFAULTSORT:Flops}}

Category:Benchmarks (computing)

Category:Floating point

Category:Units of frequency