Product Compare

H200 SXM vs NVIDIA GRID K520

GPU GPU
Graphics Card
Release Date Nov 2023 Jul 2013
Generation Hopper GRID
Type AI GPU Professional
Bus Interface PCIe 5.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1590 MHz
Boost Clock 1980 MHz
Memory Clock 1313 MHz 1250 MHz
Memory
Memory Size 141GB 4GB
Memory Type HBM3e GDDR5
Memory Bus 5120bit 256bit
Bandwidth 4800GB/s 160.0GB/s
Render Config
SM Count 132
Shading Units 16896 1536
TMUs 528 128
ROPs 24 32
Tensor Cores 528
L1 Cache 256 KB (per SM) 16 KB (per SMX)
L2 Cache 50 MB 512 KB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 23.84 GPixel/s
Texture Rate 1045 GTexel/s 95.36 GTexel/s
FP16 (half) 1979 TFLOPS
FP32 (float) 67 TFLOPS 2.289 TFLOPS
FP64 (double) 34 TFLOPS 95.36 GFLOPS
Graphics Processor
GPU Name GH200 GK104
Architecture Hopper Kepler
Foundry TSMC TSMC
Process Size 4 nm 28 nm
Transistors 80 billion 3.54 billion
Die Size 814 mm² 294 mm²
Board Design
TDP 700W 225W
Suggested PSU 1100 W 550 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS 1x 8-pin
Graphics Features
DirectX N/A 12 (11_0)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.1
CUDA 9.0 3.0
Shader Model N/A 5.1