Product Compare

NVIDIA H100 SXM5 96 GB vs AMD Radeon RX 6300

GPU GPU
Graphics Card
Release Date Mar 2023 Unknown
Generation Server Hopper Navi II
Type AI GPU Desktop
Bus Interface PCIe 5.0 x16 PCIe 4.0 x4
Clock Speeds
Base Clock 1350 MHz 1000 MHz
Boost Clock 1980 MHz 2040 MHz
Memory Clock 1313 MHz 2000 MHz
Memory
Memory Size 96GB 2GB
Memory Type HBM3 GDDR6
Memory Bus 5120bit 32bit
Bandwidth 3.36TB/s 64.00GB/s
Render Config
SM Count 132
Shading Units 16896 768
TMUs 528 48
ROPs 24 32
Tensor Cores 528
L1 Cache 256 KB (per SM) 128 KB per Array
L2 Cache 50 MB 1024 KB
Compute Units 12
RT Cores 12
L3 Cache 8 MB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 65.28 GPixel/s
Texture Rate 1045 GTexel/s 97.92 GTexel/s
FP16 (half) 267.6 TFLOPS 6.267 TFLOPS
FP32 (float) 66.91 TFLOPS 3.133 TFLOPS
FP64 (double) 33.45 TFLOPS 195.8 GFLOPS
Graphics Processor
GPU Name GH100 Navi 24
Architecture Hopper RDNA 2.0
Foundry TSMC TSMC
Process Size 5 nm 6 nm
Transistors 80 billion 5.4 billion
Die Size 814 mm² 107 mm²
GPU Variant Navi 24 XL
Board Design
TDP 700W 32W
Suggested PSU 1100 W 200 W
Outputs No outputs 2x HDMI 2.1
Power Connectors 8-pin EPS None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 2.2
Vulkan N/A 1.3
CUDA 9.0
Shader Model N/A 6.7