Product Compare

NVIDIA H200 NVL vs NVIDIA GRID K2

GPU GPU
Graphics Card
Release Date Nov 2024 May 2013
Generation Server Hopper GRID
Type AI GPU Professional
Bus Interface PCIe 5.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1365 MHz
Boost Clock 1785 MHz
Memory Clock 1593 MHz 1250 MHz
Memory
Memory Size 141GB 4GB
Memory Type HBM3e GDDR5
Memory Bus 6144bit 256bit
Bandwidth 4.89TB/s 160.0GB/s
Render Config
SM Count 132
Shading Units 16896 1536
TMUs 528 128
ROPs 24 32
Tensor Cores 528
L1 Cache 256 KB (per SM) 16 KB (per SMX)
L2 Cache 50 MB 512 KB
Theoretical Performance
Pixel Rate 42.84 GPixel/s 23.84 GPixel/s
Texture Rate 942.5 GTexel/s 95.36 GTexel/s
FP16 (half) 241.3 TFLOPS
FP32 (float) 60.32 TFLOPS 2.289 TFLOPS
FP64 (double) 30.16 TFLOPS 95.36 GFLOPS
Graphics Processor
GPU Name GH100 GK104
Architecture Hopper Kepler
Foundry TSMC TSMC
Process Size 5 nm 28 nm
Transistors 80 billion 3.54 billion
Die Size 814 mm² 294 mm²
GPU Variant GK104-895-A2
Board Design
TDP 600W 225W
Suggested PSU 1000 W 550 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS 1x 6-pin + 1x 8-pin
Graphics Features
DirectX N/A 12 (11_0)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.2.175
CUDA 9.0 3.0
Shader Model N/A 6.5 (5.1)