NVIDIA GRID K2 vs NVIDIA H100 SXM5 96 GB

GPU Specs Compare

G

NVIDIA GRID K2

NVIDIA 2013-05
G

NVIDIA H100 SXM5 96 GB

NVIDIA 2023-03

Graphics Card

Release Date
May 2013
Mar 2023
Generation
GRID
Server Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Memory Clock
1250 MHz
1313 MHz
Base Clock
-
1350 MHz
Boost Clock
-
1980 MHz

Memory

Memory Size
4GB
96GB
Memory Type
GDDR5
HBM3
Memory Bus
256bit
5120bit
Bandwidth
160.0GB/s
3.36TB/s

Render Config

Shading Units
1536
16896
TMUs
128
528
ROPs
32
24
L1 Cache
16 KB (per SMX)
256 KB (per SM)
L2 Cache
512 KB
50 MB
SM Count
-
132
Tensor Cores
-
528

Theoretical Performance

Pixel Rate
23.84 GPixel/s
47.52 GPixel/s
Texture Rate
95.36 GTexel/s
1045 GTexel/s
FP32 (float)
2.289 TFLOPS
66.91 TFLOPS
FP64 (double)
95.36 GFLOPS
33.45 TFLOPS
FP16 (half)
-
267.6 TFLOPS

Graphics Processor

GPU Name
GK104
GH100
GPU Variant
GK104-895-A2
-
Architecture
Kepler
Hopper
Foundry
TSMC
TSMC
Process Size
28 nm
5 nm
Transistors
3.54 billion
80 billion
Die Size
294 mm²
814 mm²

Board Design

TDP
225W
700W
Suggested PSU
550 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
1x 6-pin + 1x 8-pin
8-pin EPS

Graphics Features

DirectX
12 (11_0)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.2.175
N/A
CUDA
3.0
9.0
Shader Model
6.5 (5.1)
N/A