Product Compare

AMD Radeon Instinct MI300X vs NVIDIA H800 SXM5

GPU GPU
Graphics Card
Release Date Dec 2023 Mar 2023
Generation Radeon Instinct Server Hopper
Type Professional AI GPU
Bus Interface PCIe 5.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1000 MHz 1095 MHz
Boost Clock 2100 MHz 1755 MHz
Memory Clock 1300 MHz 1313 MHz
Memory
Memory Size 192GB 80GB
Memory Type HBM3 HBM3
Memory Bus 8192bit 5120bit
Bandwidth 5.32TB/s 3.36TB/s
Render Config
Compute Units 304
Shading Units 19456 16896
TMUs 1216 528
ROPs 0 24
Tensor Cores 1216 528
L1 Cache 16 KB (per CU) 256 KB (per SM)
L2 Cache 16 MB 50 MB
L3 Cache 256 MB
SM Count 132
Theoretical Performance
Pixel Rate 0 MPixel/s 42.12 GPixel/s
Texture Rate 2553.6 GTexel/s 926.6 GTexel/s
FP16 (half) 81.72 TFLOPS 237.2 TFLOPS
FP32 (float) 81.72 TFLOPS 59.30 TFLOPS
FP64 (double) 40.86 TFLOPS 29.65 TFLOPS
Graphics Processor
GPU Name Aqua Vanjaram GH100
Architecture CDNA 3.0 Hopper
Foundry TSMC TSMC
Process Size 5 nm 5 nm
Transistors 153 billion 80 billion
Die Size 1017 mm² 814 mm²
Board Design
TDP 750W 700W
Suggested PSU 1150 W 1100 W
Outputs No outputs No outputs
Power Connectors None 8-pin EPS
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
Shader Model N/A N/A
CUDA 9.0