Product Compare

AMD Radeon Instinct MI325X vs NVIDIA A40 PCIe

GPU GPU
Graphics Card
Release Date Oct 2024 Oct 2020
Generation Radeon Instinct Tesla
Type Professional Desktop
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1000 MHz 1305 MHz
Boost Clock 2100 MHz 1740 MHz
Memory Clock 1500 MHz 1812 MHz
Memory
Memory Size 256GB 48GB
Memory Type HBM3e GDDR6
Memory Bus 8192bit 384bit
Bandwidth 6.14TB/s 695.8GB/s
Render Config
Compute Units 304
Shading Units 19456 10752
TMUs 1216 336
ROPs 0 112
Tensor Cores 1216 336
L1 Cache 16 KB (per CU) 128 KB (per SM)
L2 Cache 16 MB 6 MB
L3 Cache 256 MB
SM Count 84
RT Cores 84
Theoretical Performance
Pixel Rate 0 MPixel/s 194.9 GPixel/s
Texture Rate 2553.6 GTexel/s 584.6 GTexel/s
FP16 (half) 81.72 TFLOPS 37.42 TFLOPS
FP32 (float) 81.72 TFLOPS 37.42 TFLOPS
FP64 (double) 40.86 TFLOPS 584.6 GFLOPS
Graphics Processor
GPU Name Aqua Vanjaram GA102
Architecture CDNA 3.0 Ampere
Foundry TSMC Samsung
Process Size 5 nm 8 nm
Transistors 153 billion 28.3 billion
Die Size 1017 mm² 628 mm²
Board Design
TDP 1000W 300W
Suggested PSU 1400 W 700 W
Outputs No outputs 3x DisplayPort 1.4a
Power Connectors None 8-pin EPS
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
Shader Model N/A 6.6
CUDA 8.6