Product Compare

NVIDIA H100 SXM5 vs NVIDIA GeForce GTX 960

GPU GPU
Graphics Card
Release Date Mar 2022 Jan 2015
Generation Tesla Hopper GeForce 900
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1590 MHz 1127 MHz
Boost Clock 1980 MHz 1178 MHz
Memory Clock 1313 MHz 1753 MHz
Memory
Memory Size 80GB 2GB
Memory Type HBM3 GDDR5
Memory Bus 5120bit 128bit
Bandwidth 3350GB/s 112.2GB/s
Render Config
SM Count 132
Shading Units 16896 1024
TMUs 528 64
ROPs 24 32
Tensor Cores 528
L1 Cache 256 KB (per SM) 48 KB (per SMM)
L2 Cache 50 MB 1024 KB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 37.70 GPixel/s
Texture Rate 1045 GTexel/s 75.39 GTexel/s
FP16 (half) 267.6 TFLOPS
FP32 (float) 66.91 TFLOPS 2.413 TFLOPS
FP64 (double) 33.45 TFLOPS 75.39 GFLOPS
Graphics Processor
GPU Name GH100 GM206
Architecture Hopper Maxwell 2.0
Foundry TSMC TSMC
Process Size 4 nm 28 nm
Transistors 80 billion 2.94 billion
Die Size 814 mm² 228 mm²
GPU Variant GM206-300-A1
Board Design
TDP 700W 120W
Suggested PSU 1100 W 300 W
Outputs No outputs 1x DVI1x HDMI 2.03x DisplayPort 1.4a
Power Connectors 8-pin EPS 1x 6-pin
Graphics Features
DirectX N/A 12 (12_1)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 5.2
Shader Model N/A 6.4