NVIDIA Quadro RTX 4000 vs NVIDIA H100 SXM5 96 GB

GPU Specs Compare

G

NVIDIA Quadro RTX 4000

NVIDIA 2018-11
G

NVIDIA H100 SXM5 96 GB

NVIDIA 2023-03

Graphics Card

Release Date
Nov 2018
Mar 2023
Generation
Quadro Turing
Server Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1005 MHz
1350 MHz
Boost Clock
1545 MHz
1980 MHz
Memory Clock
1625 MHz
1313 MHz

Memory

Memory Size
8GB
96GB
Memory Type
GDDR6
HBM3
Memory Bus
256bit
5120bit
Bandwidth
416.0GB/s
3.36TB/s

Render Config

SM Count
36
132
Shading Units
2304
16896
TMUs
144
528
ROPs
64
24
Tensor Cores
288
528
RT Cores
36
-
L1 Cache
64 KB (per SM)
256 KB (per SM)
L2 Cache
4 MB
50 MB

Theoretical Performance

Pixel Rate
98.88 GPixel/s
47.52 GPixel/s
Texture Rate
222.5 GTexel/s
1045 GTexel/s
FP16 (half)
14.24 TFLOPS
267.6 TFLOPS
FP32 (float)
7.119 TFLOPS
66.91 TFLOPS
FP64 (double)
222.5 GFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
TU104
GH100
GPU Variant
TU104-850-A1
-
Architecture
Turing
Hopper
Foundry
TSMC
TSMC
Process Size
12 nm
5 nm
Transistors
13.6 billion
80 billion
Die Size
545 mm²
814 mm²

Board Design

TDP
160W
700W
Suggested PSU
450 W
1100 W
Outputs
3x DisplayPort 1.4a1x USB Type-C
No outputs
Power Connectors
1x 8-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
7.5
9.0
Shader Model
6.8
N/A

📊 Benchmark

3DMark Time Spy
7,853
-
3DMark Time Spy Extreme
3,696
-