Product Compare

NVIDIA H100 SXM5 vs NVIDIA GeForce RTX 4070 Ti

GPU GPU
Graphics Card
Release Date Mar 2022 Jan 2023
Generation Tesla Hopper GeForce 40
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1590 MHz 2310 MHz
Boost Clock 1980 MHz 2610 MHz
Memory Clock 1313 MHz 1313 MHz
Memory
Memory Size 80GB 12GB
Memory Type HBM3 GDDR6X
Memory Bus 5120bit 192bit
Bandwidth 3350GB/s 504.2GB/s
Render Config
SM Count 132 60
Shading Units 16896 7680
TMUs 528 240
ROPs 24 80
Tensor Cores 528 240
L1 Cache 256 KB (per SM) 128 KB (per SM)
L2 Cache 50 MB 48 MB
RT Cores 60
Theoretical Performance
Pixel Rate 47.52 GPixel/s 208.8 GPixel/s
Texture Rate 1045 GTexel/s 626.4 GTexel/s
FP16 (half) 267.6 TFLOPS 40.09 TFLOPS
FP32 (float) 66.91 TFLOPS 40.09 TFLOPS
FP64 (double) 33.45 TFLOPS 626.4 GFLOPS
Graphics Processor
GPU Name GH100 AD104
Architecture Hopper Ada Lovelace
Foundry TSMC TSMC
Process Size 4 nm 4 nm
Transistors 80 billion 35.8 billion
Die Size 814 mm² 295 mm²
GPU Variant AD104-400-A1
Board Design
TDP 700W 285W
Suggested PSU 1100 W 600 W
Outputs No outputs 1x HDMI 2.13x DisplayPort 1.4a
Power Connectors 8-pin EPS 1x 16-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 8.9
Shader Model N/A 6.7