AMD Radeon Instinct MI6 vs NVIDIA H100 SXM5 94 GB

GPU Specs Compare

Graphics Card

Release Date
Dec 2016
Mar 2023
Generation
Radeon Instinct
Server Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1120 MHz
1350 MHz
Boost Clock
1233 MHz
1980 MHz
Memory Clock
1750 MHz
1313 MHz

Memory

Memory Size
8GB
94GB
Memory Type
GDDR5
HBM3
Memory Bus
256bit
5120bit
Bandwidth
224.0GB/s
3.36TB/s

Render Config

Compute Units
36
-
Shading Units
2304
16896
TMUs
144
528
ROPs
32
24
L1 Cache
16 KB (per CU)
256 KB (per SM)
L2 Cache
2 MB
50 MB
SM Count
-
132
Tensor Cores
-
528

Theoretical Performance

Pixel Rate
39.46 GPixel/s
47.52 GPixel/s
Texture Rate
177.6 GTexel/s
1045.4 GTexel/s
FP16 (half)
5.682 TFLOPS
267.6 TFLOPS
FP32 (float)
5.682 TFLOPS
66.91 TFLOPS
FP64 (double)
355.1 GFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
Ellesmere
GH100
GPU Variant
Ellesmere XT
-
Architecture
GCN 4.0
Hopper
Foundry
GlobalFoundries
TSMC
Process Size
14 nm
5 nm
Transistors
5.7 billion
80 billion
Die Size
232 mm²
814 mm²

Board Design

TDP
150W
700W
Suggested PSU
450 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
1x 6-pin
8-pin EPS

Graphics Features

DirectX
12 (12_0)
N/A
OpenGL
4.6
N/A
OpenCL
2.1
3.0
Vulkan
1.2
N/A
Shader Model
6.4
N/A
CUDA
-
9.0