Product Compare

NVIDIA H200 SXM 141 GB vs NVIDIA H800 SXM5

GPU GPU
Graphics Card
Release Date Nov 2024 Mar 2023
Generation Server Hopper Server Hopper
Type AI GPU AI GPU
Bus Interface PCIe 5.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1500 MHz 1095 MHz
Boost Clock 1980 MHz 1755 MHz
Memory Clock 1593 MHz 1313 MHz
Memory
Memory Size 141GB 80GB
Memory Type HBM3e HBM3
Memory Bus 6144bit 5120bit
Bandwidth 4.89TB/s 3.36TB/s
Render Config
SM Count 132 132
Shading Units 16896 16896
TMUs 528 528
ROPs 24 24
Tensor Cores 528 528
L1 Cache 256 KB (per SM) 256 KB (per SM)
L2 Cache 50 MB 50 MB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 42.12 GPixel/s
Texture Rate 1045.4 GTexel/s 926.6 GTexel/s
FP16 (half) 267.6 TFLOPS 237.2 TFLOPS
FP32 (float) 66.91 TFLOPS 59.30 TFLOPS
FP64 (double) 33.45 TFLOPS 29.65 TFLOPS
Graphics Processor
GPU Name GH100 GH100
Architecture Hopper Hopper
Foundry TSMC TSMC
Process Size 5 nm 5 nm
Transistors 80 billion 80 billion
Die Size 814 mm² 814 mm²
Board Design
TDP 700W 700W
Suggested PSU 1100 W 1100 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS 8-pin EPS
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 9.0 9.0
Shader Model N/A N/A