Product Compare

NVIDIA H200 SXM 141 GB vs AMD Radeon RX 6500 XT

GPU GPU
Graphics Card
Release Date Nov 2024 Jan 2022
Generation Server Hopper Navi II
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 4.0 x4
Clock Speeds
Base Clock 1500 MHz 2310 MHz
Boost Clock 1980 MHz 2815 MHz
Memory Clock 1593 MHz 2248 MHz
Memory
Memory Size 141GB 4GB
Memory Type HBM3e GDDR6
Memory Bus 6144bit 64bit
Bandwidth 4.89TB/s 143.9GB/s
Render Config
SM Count 132
Shading Units 16896 1024
TMUs 528 64
ROPs 24 32
Tensor Cores 528
L1 Cache 256 KB (per SM) 128 KB per Array
L2 Cache 50 MB 1024 KB
Compute Units 16
RT Cores 16
L3 Cache 16 MB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 90.08 GPixel/s
Texture Rate 1045.4 GTexel/s 180.2 GTexel/s
FP16 (half) 267.6 TFLOPS 11.53 TFLOPS
FP32 (float) 66.91 TFLOPS 5.765 TFLOPS
FP64 (double) 33.45 TFLOPS 360.3 GFLOPS
Graphics Processor
GPU Name GH100 Navi 24
Architecture Hopper RDNA 2.0
Foundry TSMC TSMC
Process Size 5 nm 6 nm
Transistors 80 billion 5.4 billion
Die Size 814 mm² 107 mm²
GPU Variant Navi 24 XT(215-135000006)
Board Design
TDP 700W 107W
Suggested PSU 1100 W 300 W
Outputs No outputs 1x HDMI 2.11x DisplayPort 1.4a
Power Connectors 8-pin EPS 1x 6-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 2.2
Vulkan N/A 1.3
CUDA 9.0
Shader Model N/A 6.6