H200 SXM vs AMD Radeon RX 6500 XT

GPU Specs Compare

G

H200 SXM

2023-11

Graphics Card

Release Date
Nov 2023
Jan 2022
Generation
Hopper
Navi II
Type
AI GPU
Desktop
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x4

Clock Speeds

Base Clock
1590 MHz
2310 MHz
Boost Clock
1980 MHz
2815 MHz
Memory Clock
1313 MHz
2248 MHz

Memory

Memory Size
141GB
4GB
Memory Type
HBM3e
GDDR6
Memory Bus
5120bit
64bit
Bandwidth
4800GB/s
143.9GB/s

Render Config

SM Count
132
-
Shading Units
16896
1024
TMUs
528
64
ROPs
24
32
Tensor Cores
528
-
L1 Cache
256 KB (per SM)
128 KB per Array
L2 Cache
50 MB
1024 KB
Compute Units
-
16
RT Cores
-
16
L3 Cache
-
16 MB

Theoretical Performance

Pixel Rate
47.52 GPixel/s
90.08 GPixel/s
Texture Rate
1045 GTexel/s
180.2 GTexel/s
FP16 (half)
1979 TFLOPS
11.53 TFLOPS
FP32 (float)
67 TFLOPS
5.765 TFLOPS
FP64 (double)
34 TFLOPS
360.3 GFLOPS

Graphics Processor

GPU Name
GH200
Navi 24
Architecture
Hopper
RDNA 2.0
Foundry
TSMC
TSMC
Process Size
4 nm
6 nm
Transistors
80 billion
5.4 billion
Die Size
814 mm²
107 mm²
GPU Variant
-
Navi 24 XT(215-135000006)

Board Design

TDP
700W
107W
Suggested PSU
1100 W
300 W
Outputs
No outputs
1x HDMI 2.11x DisplayPort 1.4a
Power Connectors
8-pin EPS
1x 6-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
2.2
Vulkan
N/A
1.3
CUDA
9.0
-
Shader Model
N/A
6.6