Product Compare

NVIDIA H100 SXM5 64 GB vs NVIDIA P104 101

GPU GPU
Graphics Card
Release Date Mar 2023 Jan 2018
Generation Tesla Hopper Mining GPUs
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1665 MHz 1506 MHz
Boost Clock 1980 MHz 1683 MHz
Memory Clock 1313 MHz 2002 MHz
Memory
Memory Size 64GB 4GB
Memory Type HBM3 GDDR5
Memory Bus 3072bit 256bit
Bandwidth 2.02TB/s 256.3GB/s
Render Config
SM Count 132 20
Shading Units 16896 2560
TMUs 528 160
ROPs 24 64
Tensor Cores 528
L1 Cache 256 KB (per SM) 48 KB (per SM)
L2 Cache 30 MB 2 MB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 107.7 GPixel/s
Texture Rate 1045 GTexel/s 269.3 GTexel/s
FP16 (half) 267.6 TFLOPS 134.6 GFLOPS
FP32 (float) 66.91 TFLOPS 8.617 TFLOPS
FP64 (double) 33.45 TFLOPS 269.3 GFLOPS
Graphics Processor
GPU Name GH100 GP104
Architecture Hopper Pascal
Foundry TSMC TSMC
Process Size 5 nm 16 nm
Transistors 80 billion 7.2 billion
Die Size 814 mm² 314 mm²
GPU Variant GP104-101-A1
Board Design
TDP 700W 125W
Suggested PSU 1100 W 200 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS 1x 8-pin
Graphics Features
DirectX N/A 12 (12_1)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 9.0 6.1
Shader Model N/A 6.4