Product Compare

NVIDIA GeForce RTX 4080 Max-Q vs NVIDIA H100 PCIe 96 GB

GPU GPU
Graphics Card
Release Date Jan 2023 Mar 2023
Generation GeForce 40 Mobile Tesla Hopper
Type Mobile AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 795 MHz 1665 MHz
Boost Clock 1350 MHz 1837 MHz
Memory Clock 1750 MHz 1313 MHz
Memory
Memory Size 12GB 96GB
Memory Type GDDR6 HBM3
Memory Bus 192bit 5120bit
Bandwidth 336.0GB/s 1681GB/s
Render Config
SM Count 58 132
Shading Units 7424 16896
TMUs 232 528
ROPs 80 24
Tensor Cores 232 528
RT Cores 58
L1 Cache 128 KB (per SM) 256 KB (per SM)
L2 Cache 48 MB 50 MB
Theoretical Performance
Pixel Rate 108.0 GPixel/s 44.09 GPixel/s
Texture Rate 313.2 GTexel/s 969.9 GTexel/s
FP16 (half) 20.04 TFLOPS 248.3 TFLOPS
FP32 (float) 20.04 TFLOPS 62.08 TFLOPS
FP64 (double) 313.2 GFLOPS 31.04 TFLOPS
Graphics Processor
GPU Name AD104 GH100
GPU Variant GN21-X9
Architecture Ada Lovelace Hopper
Foundry TSMC TSMC
Process Size 4 nm 4 nm
Transistors 35.8 billion 80 billion
Die Size 295 mm² 814 mm²
Board Design
TDP 60W 700W
Outputs Portable Device Dependent No outputs
Power Connectors None 8-pin EPS
Suggested PSU 1100 W
Graphics Features
DirectX 12 Ultimate (12_2) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 8.9 9.0
Shader Model 6.7 N/A