Product Compare

NVIDIA H200 SXM 141 GB vs NVIDIA RTX 4000 Mobile Ada Generation

GPU GPU
Graphics Card
Release Date Nov 2024 Mar 2023
Generation Server Hopper Quadro Ada-M
Type AI GPU Mobile
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1500 MHz 1290 MHz
Boost Clock 1980 MHz 1665 MHz
Memory Clock 1593 MHz 2250 MHz
Memory
Memory Size 141GB 12GB
Memory Type HBM3e GDDR6
Memory Bus 6144bit 192bit
Bandwidth 4.89TB/s 432.0GB/s
Render Config
SM Count 132 58
Shading Units 16896 7424
TMUs 528 232
ROPs 24 80
Tensor Cores 528 232
L1 Cache 256 KB (per SM) 128 KB (per SM)
L2 Cache 50 MB 48 MB
RT Cores 58
Theoretical Performance
Pixel Rate 47.52 GPixel/s 133.2 GPixel/s
Texture Rate 1045.4 GTexel/s 386.3 GTexel/s
FP16 (half) 267.6 TFLOPS 24.72 TFLOPS
FP32 (float) 66.91 TFLOPS 24.72 TFLOPS
FP64 (double) 33.45 TFLOPS 386.3 GFLOPS
Graphics Processor
GPU Name GH100 AD104
Architecture Hopper Ada Lovelace
Foundry TSMC TSMC
Process Size 5 nm 5 nm
Transistors 80 billion 35.8 billion
Die Size 814 mm² 294 mm²
Board Design
TDP 700W 110W
Suggested PSU 1100 W
Outputs No outputs Portable Device Dependent
Power Connectors 8-pin EPS None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 8.9
Shader Model N/A 6.7