Product Compare

NVIDIA Rubin Ultra GPU vs AMD Radeon Instinct MI300A

GPU GPU
Graphics Card
Release Date Jan 2027 Dec 2023
Generation Server Rubin Radeon Instinct
Type Desktop Desktop
Bus Interface PCIe 6.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 700 MHz 1000 MHz
Boost Clock 2267 MHz 2100 MHz
Memory Clock 1900 MHz 2525 MHz
Memory
Memory Size 1024GB 192GB
Memory Type HBM4e HBM3
Memory Bus 32768bit 8192bit
Bandwidth 31.1TB/s 10.3TB/s
Render Config
SM Count 448
Shading Units 57344 19456
TMUs 1792 1216
ROPs 24 0
Tensor Cores 1792 1216
L1 Cache 256 KB (per SM) 16 KB (per CU)
L2 Cache 128 MB 16 MB
Compute Units 304
L3 Cache 256 MB
Theoretical Performance
Pixel Rate 54.41 GPixel/s 0 MPixel/s
Texture Rate 4062.5 GTexel/s 2554 GTexel/s
FP16 (half) 520.0 TFLOPS 653.7 TFLOPS
FP32 (float) 260.0 TFLOPS 81.72 TFLOPS
FP64 (double) 65.00 TFLOPS 81.72 TFLOPS
Graphics Processor
GPU Name GR110 Aqua Vanjaram
Architecture Rubin Ultra CDNA 3.0
Foundry TSMC TSMC
Process Size 3 nm 5 nm
Transistors 670 billion 153 billion
Die Size 2912 mm² 1017 mm²
Board Design
TDP 3600W 750W
Suggested PSU 4000 W 1150 W
Outputs No outputs No outputs
Power Connectors None
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 10.7
Shader Model N/A N/A