AMD Radeon Instinct MI350X vs NVIDIA H100 SXM5 64 GB

GPU Specs Compare

Graphics Card

Release Date
Jun 2025
Mar 2023
Generation
Radeon Instinct
Tesla Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 5.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1000 MHz
1665 MHz
Boost Clock
2200 MHz
1980 MHz
Memory Clock
2000 MHz
1313 MHz

Memory

Memory Size
288GB
64GB
Memory Type
HBM3e
HBM3
Memory Bus
8192bit
3072bit
Bandwidth
8.19TB/s
2.02TB/s

Render Config

Compute Units
256
-
Shading Units
16384
16896
TMUs
1024
528
ROPs
0
24
Tensor Cores
1024
528
L1 Cache
16 KB (per CU)
256 KB (per SM)
L2 Cache
16 MB
30 MB
L3 Cache
256 MB
-
SM Count
-
132

Theoretical Performance

Pixel Rate
0 MPixel/s
47.52 GPixel/s
Texture Rate
2252.8 GTexel/s
1045 GTexel/s
FP16 (half)
72.09 TFLOPS
267.6 TFLOPS
FP32 (float)
72.09 TFLOPS
66.91 TFLOPS
FP64 (double)
36.04 TFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
MI350 256CU
GH100
Architecture
CDNA 4.0
Hopper
Foundry
TSMC
TSMC
Process Size
3 nm
5 nm
Transistors
185 billion
80 billion
Die Size
Unknown
814 mm²

Board Design

TDP
1000W
700W
Suggested PSU
1400 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
None
8-pin EPS

Graphics Features

DirectX
N/A
N/A
OpenGL
N/A
N/A
OpenCL
3.0
3.0
Vulkan
N/A
N/A
Shader Model
N/A
N/A
CUDA
-
9.0