NVIDIA GeForce RTX 2080 Ti vs NVIDIA H100 SXM5 96 GB

GPU Specs Compare

Graphics Card

Release Date
Sep 2018
Mar 2023
Generation
GeForce 20
Server Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1350 MHz
1350 MHz
Boost Clock
1545 MHz
1980 MHz
Memory Clock
1750 MHz
1313 MHz

Memory

Memory Size
11GB
96GB
Memory Type
GDDR6
HBM3
Memory Bus
352bit
5120bit
Bandwidth
616.0GB/s
3.36TB/s

Render Config

SM Count
68
132
Shading Units
4352
16896
TMUs
272
528
ROPs
88
24
Tensor Cores
544
528
RT Cores
68
-
L1 Cache
64 KB (per SM)
256 KB (per SM)
L2 Cache
0 MB
50 MB

Theoretical Performance

Pixel Rate
136.0 GPixel/s
47.52 GPixel/s
Texture Rate
420.2 GTexel/s
1045 GTexel/s
FP16 (half)
26.90 TFLOPS
267.6 TFLOPS
FP32 (float)
13.45 TFLOPS
66.91 TFLOPS
FP64 (double)
420.2 GFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
TU102
GH100
GPU Variant
TU102-300A-K1-A1
-
Architecture
Turing
Hopper
Foundry
TSMC
TSMC
Process Size
12 nm
5 nm
Transistors
18.6 billion
80 billion
Die Size
754 mm²
814 mm²

Board Design

TDP
250W
700W
Suggested PSU
600 W
1100 W
Outputs
1x HDMI 2.03x DisplayPort 1.4a1x USB Type-C
No outputs
Power Connectors
2x 8-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.4
N/A
CUDA
7.5
9.0
Shader Model
6.8
N/A