Product Compare

AMD Radeon Instinct MI6 vs NVIDIA H100 SXM5 80 GB

GPU GPU
Graphics Card
Release Date Dec 2016 Oct 2022
Generation Radeon Instinct Server Hopper
Type Professional AI GPU
Bus Interface PCIe 3.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1120 MHz 1590 MHz
Boost Clock 1233 MHz 1980 MHz
Memory Clock 1750 MHz 1313 MHz
Memory
Memory Size 8GB 80GB
Memory Type GDDR5 HBM3
Memory Bus 256bit 5120bit
Bandwidth 224.0GB/s 3.36TB/s
Render Config
Compute Units 36
Shading Units 2304 16896
TMUs 144 528
ROPs 32 24
L1 Cache 16 KB (per CU) 256 KB (per SM)
L2 Cache 2 MB 50 MB
SM Count 132
Tensor Cores 528
Theoretical Performance
Pixel Rate 39.46 GPixel/s 47.52 GPixel/s
Texture Rate 177.6 GTexel/s 1045 GTexel/s
FP16 (half) 5.682 TFLOPS 267.6 TFLOPS
FP32 (float) 5.682 TFLOPS 66.91 TFLOPS
FP64 (double) 355.1 GFLOPS 33.45 TFLOPS
Graphics Processor
GPU Name Ellesmere GH100
GPU Variant Ellesmere XT
Architecture GCN 4.0 Hopper
Foundry GlobalFoundries TSMC
Process Size 14 nm 5 nm
Transistors 5.7 billion 80 billion
Die Size 232 mm² 814 mm²
Board Design
TDP 150W 700W
Suggested PSU 450 W 1100 W
Outputs No outputs No outputs
Power Connectors 1x 6-pin None
Graphics Features
DirectX 12 (12_0) N/A
OpenGL 4.6 N/A
OpenCL 2.1 3.0
Vulkan 1.2 N/A
Shader Model 6.4 N/A
CUDA 9.0