Login
Login

Ada Lovelace (microarchitecture)

{{Short description|GPU microarchitecture by Nvidia}}

{{Use mdy dates|date=September 2022}}

{{For|the mathematician |Ada Lovelace}}

{{Primary sources|date=September 2022}}

{{Infobox GPU microarchitecture

| name = Ada Lovelace

| image =

| caption =

| alt =

| launched = {{Start date and age|2022|10|12}}

| discontinued =

| designfirm = Nvidia

| manuf1 = TSMC

| process = TSMC 4N

| codename = AD10x

| products-desktop1 = GeForce RTX 40 series

| products-hedt1 = RTX Ada Generation

| products-server1 = Tesla Ada (L4x)

| directx-version = DirectX 12 Ultimate (Feature Level 12_2)

| direct3d-version = Direct3D 12

| shadermodel-version = Shader Model 6.8

| opencl-version = OpenCL 3.0

| opengl-version = OpenGL 4.6

| opengles-version =

| cuda-version = Compute Capability 8.9

| optix-version =

| mantle-api =

| vulkan-api = Vulkan 1.3

| cuda-compute-version = CUDA Toolkit 11.6

| directcompute-version = Yes

| compute =

| slowest = 735

| slow-unit = MHz

| fastest = 2640

| fast-unit = MHz

| shader-clock =

| l0-cache =

| l1-cache = 128{{nbsp}}KB (per SM)

| l2-cache = 32{{nbsp}}MB to 96{{nbsp}}MB

| l3-cache =

| memory-support = {{ubl|GDDR6|GDDR6X}}

| memory-clock = 21-23{{nbsp}}Gbit/s

| pcie-support = PCIe 4.0

| encode-codec = {{hlist|H.264|H.265|AV1}}

| decode-codec = {{hlist|H.264|H.265|AV1}}

| color-depth = {{hlist|8-bit|10-bit}}

| encoders = NVENC

| display-outputs = {{ubl|DisplayPort 1.4a|HDMI 2.1}}

| predecessor = Ampere

| variant = Hopper {{small|(datacenter)}}

| successor = Blackwell

|support_status=Supported}}

Ada Lovelace, also referred to simply as Lovelace,{{cite web |last1=Freund |first1=Karl |date=September 20, 2022 |title=Nvidia Launches Lovelace GPU, Cloud Services, Ships H100 GPUs, New Drive Thor |url=https://www.forbes.com/sites/karlfreund/2022/09/20/nvidia-launches-cloud-services-ships-h100-gpus-announces-new-drive-thor-and-/?sh=307fd398b4ae |website=Forbes |language=en-US |access-date=November 18, 2022}} is a graphics processing unit (GPU) microarchitecture developed by Nvidia as the successor to the Ampere architecture, officially announced on September 20, 2022. It is named after the 19th century English mathematician Ada Lovelace,{{cite news |last=Mujtaba |first=Hassan |date=September 15, 2022 |title=Nvidia's Next-Gen Ada Lovelace Gaming GPU Architecture For GeForce RTX 40 Series Confirmed |url=https://wccftech.com/nvidia-ada-lovelace-gpu-architecture-for-next-gen-geforce-rtx-40-gaming-gpus-confirmed/ |work=Wccftech |language=en-US |access-date=November 18, 2022}} one of the first computer programmers. Nvidia announced the architecture along with the GeForce RTX 40 series consumer GPUs{{cite press release |title=Nvidia Delivers Quantum Leap in Performance, Introduces New Era of Neural Rendering with GeForce RTX 40 Series |url=http://nvidianews.nvidia.com/news/nvidia-delivers-quantum-leap-in-performance-introduces-new-era-of-neural-rendering-with-geforce-rtx-40-series |website=Nvidia Newsroom |language=en-US |date=September 20, 2022 |access-date=September 20, 2022}} and the RTX 6000 Ada Generation workstation graphics card.{{cite web |title=Nvidia's New Ada Lovelace RTX GPU Arrives for Designers and Creators |url=https://nvidianews.nvidia.com/news/nvidias-new-ada-lovelace-rtx-gpu-arrives-for-designers-and-creators |website=Nvidia Newsroom |language=en-US |date=September 20, 2022 |access-date=November 18, 2022}} The Lovelace architecture is fabricated on TSMC's custom 4N process which offers increased efficiency over the previous Samsung 8 nm and TSMC N7 processes used by Nvidia for its previous-generation Ampere architecture.{{cite news |last=Machkovec |first=Sam |date=September 20, 2022 |title=Nvidia's Ada Lovelace GPU generation: $1,599 for RTX 4090, $899 and up for 4080 |url=https://arstechnica.com/gadgets/2022/09/nvidias-ada-lovelace-gpu-generation-1599-for-rtx-4090-899-and-up-for-4080/ |work=Ars Technica |language=en-US |access-date=November 18, 2022}}

Background

The Ada Lovelace architecture follows on from the Ampere architecture that was released in 2020. The Ada Lovelace architecture was announced by Nvidia CEO Jensen Huang during a GTC 2022 keynote on September 20, 2022 with the architecture powering Nvidia's GPUs for gaming, workstations and datacenters.{{Cite web |last=Chiappetta |first=Marco |date=September 22, 2022 |title=NVIDIA GeForce RTX 40 Architecture Overview: Ada's Special Sauce Unveiled |url=https://hothardware.com/reviews/nvidia-geforce-rtx-40-architecture-overview |website=HotHardware |language=en-US |access-date=April 8, 2023}}

Architectural details

Architectural improvements of the Ada Lovelace architecture include the following:{{Cite web |title=NVIDIA Ada Lovelace Architecture |url=https://www.nvidia.com/en-us/geforce/ada-lovelace-architecture/ |website=NVIDIA |language=en-US |date=September 20, 2022 |access-date=September 20, 2022}}

  • CUDA Compute Capability 8.9{{Cite web|url=https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#compute-capability-8-x|title=CUDA C++ Programming Guide|website=docs.nvidia.com|accessdate=April 15, 2023}}
  • TSMC 4N{{nbsp}}process (custom designed for Nvidia) - not to be confused with TSMC's regular N4 node
  • 4th-generation Tensor Cores with FP8, FP16, bfloat16, TensorFloat-32 (TF32) and sparsity acceleration
  • 3rd-generation Ray Tracing Cores, plus concurrent ray tracing and shading and compute
  • Shader Execution Reordering (SER){{Cite web |title=Improve Shader Performance and In-Game Frame Rates with Shader Execution Reordering |url=https://developer.nvidia.com/blog/improve-shader-performance-and-in-game-frame-rates-with-shader-execution-reordering/ |website=NVIDIA Technical Blog |language=en-US |date=October 13, 2022 |access-date=April 6, 2023}}
  • Nvidia video encoder/decoder (NVENC/NVDEC) with 8K 10-bit 60FPS AV1 fixed function hardware encoding{{Cite web |last=Deigado |first=Gerado |date=September 20, 2022 |title=Creativity At The Speed of Light: GeForce RTX 40 Series Graphics Cards Unleash Up To 2X Performance in 3D Rendering, AI, and Video Exports For Gamers and Creators |url=https://www.nvidia.com/en-us/geforce/news/rtx-40-series-and-studio-updates-for-content-creation/ |website=NVIDIA |language=en-US |access-date=September 20, 2022}}{{cite web |title=Nvidia Video Codec SDK |url=https://developer.nvidia.com/nvidia-video-codec-sdk |website=NVIDIA Developer |language=en-US |date=September 20, 2022 |access-date=November 18, 2022}}
  • No NVLink support{{Cite web |author1=Chuong Nguyen |date=2022-09-21 |title=Nvidia kills off NVLink on RTX 4090 |url=https://www.windowscentral.com/hardware/computers-desktops/nvidia-kills-off-nvlink-on-rtx-4090 |access-date=2023-01-01 |website=Windows Central |language=en}}{{Cite news |author=btarunr |date=September 21, 2022 |title=Jensen Confirms: NVLink Support in Ada Lovelace is Gone |url=https://www.techpowerup.com/299107/jensen-confirms-nvlink-support-in-ada-lovelace-is-gone |website=TechPowerUp |language=en-US |access-date=November 18, 2022}}

= Streaming multiprocessors (SMs) =

== CUDA cores ==

128 CUDA cores are included in each SM.

== RT cores ==

Ada Lovelace features third-generation RT cores. The RTX 4090 features 128 RT cores compared to the 84 in the previous generation RTX 3090 Ti. These 128 RT cores can provide up to 191 TFLOPS of compute with 1.49 TFLOPS per RT core.{{Cite web |title=Nvidia Ada Lovelace GPU Architecture: Designed to deliver outstanding gaming and creating, professional graphics, AI, and compute performance |url=https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf |page=30 |website=Nvidia |language=en-US |access-date=April 5, 2023}}

A new stage in the ray tracing pipeline called Shader Execution Reordering (SER) is added in the Lovelace architecture which Nvidia claims provides a 2x performance improvement in ray tracing workloads.

== Tensor cores ==

Lovelace's new fourth-generation Tensor cores enable the AI technology used in DLSS 3's frame generation techniques. Much like Ampere, each SM contains 4 Tensor cores but Lovelace contains a greater number of Tensor cores overall given its increased number of SMs.

= Clock speeds =

There is a significant increase in clock speeds with the Ada Lovelace architecture with the RTX 4090's base clock speed being higher than the boost clock speed of the RTX 3090 Ti.

class="wikitable" style="text-align: center;"

!

! RTX 2080 Ti

! RTX 3090 Ti

! RTX 4090

style="text-align: left;" | {{resize|Architecture}}

| Turing

| Ampere

| Ada Lovelace

style="text-align: left;" | {{resize|Base clock speed
(MHz)}}

| 1350

| 1560

| 2235

style="text-align: left;" | {{resize|Boost clock speed
(MHz)}}

| 1635

| 1860

| 2520

= Cache and memory subsystem =

class="wikitable" style="text-align: center;"

!

! RTX 2080 Ti

! RTX 3090 Ti

! RTX 4090

style="text-align: left;" | {{resize|Architecture}}

| Turing

| Ampere

| Ada Lovelace

style="text-align: left;" | {{resize|L1 Data Cache}}

| 6.375{{nbsp}}MB
(96{{nbsp}}KB per SM)

| 10.5{{nbsp}}MB
(128{{nbsp}}KB per SM)

| 16{{nbsp}}MB
(128{{nbsp}}KB per SM)

style="text-align: left;" | {{resize|L2 Cache}}

| 5.5{{nbsp}}MB

| 6{{nbsp}}MB

| 72{{nbsp}}MB

The last enabled AD102 Lovelace die features 96{{nbsp}}MB of L2 cache, a 16x increase from the 6{{nbsp}}MB in the Ampere-based GA102 die.{{Cite web |title=Nvidia Ada Lovelace GPU Architecture: Designed to deliver outstanding gaming and creating, professional graphics, AI, and compute performance |url=https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf |page=12 |website=Nvidia |language=en-US |access-date=April 6, 2023}} The GPU having quick access to a high amount of L2 cache benefits complex operations like ray tracing compared to the GPU seeking data from the GDDR video memory which is slower. Relying less on accessing memory for storing important and frequently accessed data means that a narrower memory bus width can be used in tandem with a large L2 cache.

Each memory controller uses a 32-bit connection with up to 12 controllers present for a combined memory bus width of 384-bit. The Lovelace architecture can use either GDDR6 or GDDR6X memory. GDDR6X memory features on the desktop GeForce RTX 40 series while the more energy-efficient GDDR6 memory is used on its corresponding mobile versions and on RTX A6000 workstation GPUs.

= Power efficiency and process node =

The Ada Lovelace architecture is able to use lower voltages compared to its predecessor. Nvidia claims a 2x performance increase for the RTX 4090 at the same 450W used by the previous generation flagship RTX 3090 Ti.{{Cite web |title=Nvidia Ada Lovelace GPU Architecture: Designed to deliver outstanding gaming and creating, professional graphics, AI, and compute performance |url=https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf |page=12 |website=Nvidia |language=en-US |access-date=April 5, 2023}}

Increased power efficiency can be attributed in part to the smaller fabrication node used by the Lovelace architecture. The Ada Lovelace architecture is fabricated on TSMC's cutting-edge 4N process, a custom designed process node for Nvidia. The previous generation Ampere architecture used Samsung's 8nm-based 8N process node from 2018, which was two years old by the time of Ampere's launch.{{Cite web |last=James |first=Dave |date=September 1, 2020 |title=Nvidia confirms Samsung 8nm process for RTX 3090, RTX 3080, and RTX 3070 |url=https://www.pcgamer.com/nvidia-ampere-samsung-8nm-process/ |website=PC Gamer |language=en-US |access-date=April 5, 2023}}{{Cite web |last=Bosnjak |first=Dominik |date=September 1, 2020 |title=Samsung's old 8nm tech at the heart of NVIDIA's monstrous Ampere cards |url=https://www.sammobile.com/news/samsung-8nm-process-nvidia-geforce-rtx-30-ampere/ |website=SamMobile |language=en-US |access-date=April 5, 2023}} The AD102 die with its 76.3 billion transistors has a transistor density of 125.5 million per mm2, a 178% increase in density from GA102's 45.1 million per mm2.

= Media engine =

The Lovelace architecture utilizes the new 8th generation Nvidia NVENC video encoder and the 7th generation NVDEC video decoder introduced by Ampere returns.{{Cite web |title=Nvidia Ada Lovelace GPU Architecture: Designed to deliver outstanding gaming and creating, professional graphics, AI, and compute performance |url=https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf |page=25 |website=Nvidia |language=en-US |access-date=April 5, 2023}}

NVENC AV1 hardware encoding with support for up to 8K resolution at 60FPS in 10-bit color is added, enabling higher video fidelity at lower bit rates compared to the H.264 and H.265 codecs.{{Cite web |last1=Muthana |first1=Prathap |last2=Mishra |first2=Sampurnananda |last3=Patait |first3=Abhijit |date=January 18, 2023 |title=Improving Video Quality and Performance with AV1 and NVIDIA Ada Lovelace Architecture |url=https://developer.nvidia.com/blog/improving-video-quality-and-performance-with-av1-and-nvidia-ada-lovelace-architecture/ |website=Nvidia Developer |language=en-US |access-date=April 5, 2023}} Nvidia claims that its NVENC AV1 encoder featured in the Lovelace architecture is 40% more efficient than the H.264 encoder in the Ampere architecture.{{Cite web |title=Nvidia Ada Science: How Ada advances the science of graphics with DLSS 3 |url=https://images.nvidia.com/aem-dam/Solutions/geforce/ada/ada-lovelace-architecture/nvidia-ada-gpu-science.pdf |page=13 |website=Nvidia |language=en-US |access-date=April 5, 2023}}

The Lovelace architecture received criticism for not supporting the DisplayPort 2.0 connection that supports higher display data bandwidth and instead uses the older DisplayPort 1.4a which is limited to a peak bandwidth of 32 Gbit/s.{{Cite web |last=Garreffa |first=Anthony |date=September 25, 2022 |title=NVIDIA's next-gen GeForce RTX 40 series lack DP2.0 connectivity, silly |url=https://www.tweaktown.com/news/88606/nvidias-next-gen-geforce-rtx-40-series-lack-dp2-0-connectivity-silly/index.html |website=TweakTown |language=en-US |access-date=April 5, 2023}} As a result, Lovelace GPUs would be limited by DisplayPort 1.4a's supported refresh rates despite the GPU's performance being able to reach higher frame rates. Intel's Arc GPUs that also released in October 2022 included DisplayPort 2.0. AMD's competing RDNA 3 architecture released just two months after Lovelace included DisplayPort 2.1.{{Cite web |last=Judd |first=Will |date=November 3, 2022 |title=AMD announces 7900 XTX and 7900 XT graphics cards with FSR 3 |url=https://www.eurogamer.net/digitalfoundry-2022-amd-announces-7900-xtx-and-7900-xt-graphics-cards-with-fsr-3 |website=Eurogamer |language=en-GB |access-date=April 5, 2023}}

Ada Lovelace dies

class="wikitable" style="font-size:100%; text-align:center;"

! Die{{Cite web |title=NVIDIA confirms Ada 102/103/104 GPU specs, AD104 has more transistors than GA102 |url=https://videocardz.com/newz/nvidia-confirms-ada-102-103-104-gpu-specs-ad104-has-more-transistors-than-ga102 |website=VideoCardz |language=en-US |date=September 23, 2022 |access-date=September 23, 2022}}

! AD102{{Cite web |title=NVIDIA AD102 GPU Specs |url=https://www.techpowerup.com/gpu-specs/nvidia-ad102.g1005 |website=TechPowerUp |language=en-US |access-date=December 17, 2022}}

! AD103{{Cite web |title=NVIDIA AD103 GPU Specs |url=https://www.techpowerup.com/gpu-specs/nvidia-ad103.g1012 |website=TechPowerUp |language=en-US |access-date=July 16, 2024}}

! AD104{{Cite web |title=NVIDIA AD104 GPU Specs |url=https://www.techpowerup.com/gpu-specs/nvidia-ad104.g1013 |website=TechPowerUp |language=en-US |access-date=October 18, 2022}}

! AD106{{Cite web |title=NVIDIA AD106 GPU Specs |url=https://www.techpowerup.com/gpu-specs/nvidia-ad106.g1014 |website=TechPowerUp |language=en-US |access-date=December 17, 2022}}

! AD107{{Cite web |title=NVIDIA AD107 GPU Specs |url=https://www.techpowerup.com/gpu-specs/nvidia-ad107.g1015 |website=TechPowerUp |language=en-US |access-date=December 17, 2022}}

Die size

| 609 mm2

| 379 mm2

| 294 mm2

| 188 mm2

| 159 mm2

Transistors

| 76.3B

| 45.9B

| 35.8B

| 22.9B

| 18.9B

Transistor density

| 125.3 MTr/mm2

| 121.1 MTr/mm2

| 121.8 MTr/mm2

| 121.8 MTr/mm2

| 118.9 MTr/mm2

Graphics processing clusters

| 12

| 7

| 5

| 3

| 2

Streaming multiprocessors

| 144

| 80

| 60

| 36

| 24

CUDA cores

| 18432

| 10240

| 7680

| 4608

| 3072

Texture mapping units

| 576

| 320

| 240

| 144

| 96

Render output units

| 192

| 112

| 80

| 48

| 32

Tensor cores

| 576

| 320

| 240

| 144

| 96

RT cores

| 144

| 80

| 60

| 36

| 24

rowspan="2" | L1 cache

| 18{{nbsp}}MB

| 10{{nbsp}}MB

| 7.5{{nbsp}}MB

| 4.5{{nbsp}}MB

| 3{{nbsp}}MB

colspan="5" | 128{{nbsp}}KB per SM
L2 cache

| 96{{nbsp}}MB

| 64{{nbsp}}MB

| 48{{nbsp}}MB

| colspan="2" | 32{{nbsp}}MB

Ada Lovelace-based products

= Consumer =

== Desktop ==

{{see also|List of Nvidia graphics processing units#RTX 40 series|l1=List of Nvidia graphics processing units § Desktop GPUs § RTX 40 series}}

  • GeForce 40 series
  • GeForce RTX 4060 (AD107)
  • GeForce RTX 4060 Ti (AD106)
  • GeForce RTX 4070 (AD104)
  • GeForce RTX 4070 SUPER (AD104)
  • GeForce RTX 4070 Ti (AD104)
  • GeForce RTX 4070 Ti SUPER (AD103)
  • GeForce RTX 4080 (AD103)
  • GeForce RTX 4080 SUPER (AD103)
  • GeForce RTX 4090 D (AD102)
  • GeForce RTX 4090 (AD102)

== Mobile ==

{{see also|List of Nvidia graphics processing units#GeForce 40 series|l1=List of Nvidia graphics processing units § Mobile GPUs § GeForce 40 series}}

  • GeForce 40 series
  • GeForce RTX 4050 Laptop (AD107)
  • GeForce RTX 4060 Laptop (AD107)
  • GeForce RTX 4070 Laptop (AD106)
  • GeForce RTX 4080 Laptop (AD104)
  • GeForce RTX 4090 Laptop (AD103)

= Professional =

== Desktop workstation ==

{{see also|List of Nvidia graphics processing units#RTX Ada Generation|l1=List of Nvidia graphics processing units § Workstation GPUs § RTX Ada Generation}}

  • Nvidia Workstation GPUs (formerly Quadro)
  • Nvidia RTX 2000 Ada Generation (AD107)
  • Nvidia RTX 4000 Ada Generation (AD104)
  • Nvidia RTX 4000 SFF Ada Generation (AD104)
  • Nvidia RTX 4500 Ada Generation (AD104)
  • Nvidia RTX 5000 Ada Generation (AD102)
  • Nvidia RTX 5880 Ada Generation (AD102)
  • Nvidia RTX 6000 Ada Generation (AD102)

== Mobile workstation ==

{{see also|List of Nvidia graphics processing units#RTX Ada Generation 2|l1=List of Nvidia graphics processing units § Mobile Workstation GPUs § RTX Ada Generation}}

  • Nvidia Workstation GPUs (formerly Quadro)
  • Nvidia RTX 500 Ada Generation Laptop (AD107)
  • Nvidia RTX 1000 Ada Generation Laptop (AD107)
  • Nvidia RTX 2000 Ada Generation Laptop (AD107)
  • Nvidia RTX 3000 Ada Generation Laptop (AD106)
  • Nvidia RTX 3500 Ada Generation Laptop (AD104)
  • Nvidia RTX 4000 Ada Generation Laptop (AD104)
  • Nvidia RTX 5000 Ada Generation Laptop (AD103)

= Datacenter =

{{see also|List of Nvidia graphics processing units#Tesla|l1=List of Nvidia graphics processing units § Data Center GPUs § Tesla}}

class="wikitable" style="font-size:85%; text-align:left;"

|+ Products using Ada Lovelace (per die)

TypeAD107AD106AD104AD103AD102
GeForce 40 Series (Desktop)

|GeForce RTX 4060

| GeForce RTX 4060 Ti

| GeForce RTX 4070

GeForce RTX 4070 SUPER

GeForce RTX 4070 Ti

|GeForce RTX 4070 Ti Super

GeForce RTX 4080

GeForce RTX 4080 Super

|GeForce RTX 4090 D

GeForce RTX 4090

GeForce 40 Series (Mobile)

|GeForce RTX 4050

GeForce RTX 4060

|GeForce RTX 4070

|GeForce RTX 4080

|GeForce RTX 4090

|{{N/a}}

Nvidia Workstation GPUs (Desktop)

| RTX 2000 Ada Generation || {{N/a}} || RTX 4000 Ada Generation

RTX 4000 SFF Ada Generation

RTX 4500 Ada Generation

|{{N/a}}||

RTX 5000 Ada Generation

RTX 5880 Ada Generation

RTX 6000 Ada Generation

Nvidia Workstation GPUs (Mobile)

|RTX 500 Ada Generation

RTX 1000 Ada Generation

RTX 2000 Ada Generation

|RTX 3000 Ada Generation

|RTX 3500 Ada Generation

RTX 4000 Ada Generation

|RTX 5000 Ada Generation

|{{N/a}}

Nvidia Data Center GPUs

| || {{N/a}} || Nvidia L4{{cite web| title=NVIDIA L4 Specs | website=TechPowerUp | date=21 March 2023 | url=https://www.techpowerup.com/gpu-specs/l4.c4091 | access-date=15 April 2024}} || {{N/a}} || Nvidia L40

Nvidia L40G

Nvidia L40CNX

See also

References

{{Reflist}}

External links

  • [https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf NVIDIA ADA GPU ARCHITECTURE whitepaper]

{{Nvidia}}

Category:Computer-related introductions in 2022

Category:Nvidia microarchitectures

Nvidia Ada Lovelace

Category:Ada Lovelace