Product Compare

NVIDIA H100 SXM5 96 GB vs AMD Radeon Pro 560X

GPU GPU
Graphics Card
Release Date Mar 2023 Jul 2018
Generation Server Hopper Radeon Pro Mac
Type AI GPU Mobile
Bus Interface PCIe 5.0 x16 PCIe 3.0 x8
Clock Speeds
Base Clock 1350 MHz
Boost Clock 1980 MHz
Memory Clock 1313 MHz 1470 MHz
Memory
Memory Size 96GB 4GB
Memory Type HBM3 GDDR5
Memory Bus 5120bit 128bit
Bandwidth 3.36TB/s 94.08GB/s
Render Config
SM Count 132
Shading Units 16896 1024
TMUs 528 64
ROPs 24 16
Tensor Cores 528
L1 Cache 256 KB (per SM) 16 KB (per CU)
L2 Cache 50 MB 1024 KB
Compute Units 16
Theoretical Performance
Pixel Rate 47.52 GPixel/s 16.06 GPixel/s
Texture Rate 1045 GTexel/s 64.26 GTexel/s
FP16 (half) 267.6 TFLOPS 2.056 TFLOPS
FP32 (float) 66.91 TFLOPS 2.056 TFLOPS
FP64 (double) 33.45 TFLOPS 128.5 GFLOPS
Graphics Processor
GPU Name GH100 Polaris 21
Architecture Hopper GCN 4.0
Foundry TSMC GlobalFoundries
Process Size 5 nm 14 nm
Transistors 80 billion 3 billion
Die Size 814 mm² 123 mm²
GPU Variant Polaris 21 XT(215-0908004)
Board Design
TDP 700W 75W
Suggested PSU 1100 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS None
Graphics Features
DirectX N/A 12 (12_0)
OpenGL N/A 4.6
OpenCL 3.0 2.1
Vulkan N/A 1.2
CUDA 9.0
Shader Model N/A 6.4