Product Compare

NVIDIA H100 SXM5 vs NVIDIA GeForce RTX 4070 GDDR6

GPU GPU
Graphics Card
Release Date Mar 2022 Aug 2024
Generation Tesla Hopper GeForce 40
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1590 MHz 1920 MHz
Boost Clock 1980 MHz 2475 MHz
Memory Clock 1313 MHz 2500 MHz
Memory
Memory Size 80GB 12GB
Memory Type HBM3 GDDR6
Memory Bus 5120bit 192bit
Bandwidth 3350GB/s 480.0GB/s
Render Config
SM Count 132 46
Shading Units 16896 5888
TMUs 528 184
ROPs 24 64
Tensor Cores 528 184
L1 Cache 256 KB (per SM) 128 KB (per SM)
L2 Cache 50 MB 36 MB
RT Cores 46
Theoretical Performance
Pixel Rate 47.52 GPixel/s 158.4 GPixel/s
Texture Rate 1045 GTexel/s 455.4 GTexel/s
FP16 (half) 267.6 TFLOPS 29.15 TFLOPS
FP32 (float) 66.91 TFLOPS 29.15 TFLOPS
FP64 (double) 33.45 TFLOPS 455.4 GFLOPS
Graphics Processor
GPU Name GH100 AD104
Architecture Hopper Ada Lovelace
Foundry TSMC TSMC
Process Size 4 nm 5 nm
Transistors 80 billion 35.8 billion
Die Size 814 mm² 294 mm²
GPU Variant AD104-2XX-A1
Board Design
TDP 700W 200W
Suggested PSU 1100 W 550 W
Outputs No outputs 1x HDMI 2.13x DisplayPort 1.4a
Power Connectors 8-pin EPS 1x 16-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 8.9
Shader Model N/A 6.8