NVIDIA L4 vs AMD Instinct MI300A
GPU Specs Compare
Graphics Card
Release Date
Mar 2023
Dec 2023
Generation
Tesla Ada(Lxx)
Radeon Instinct
Type
Professional
Professional
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16
Clock Speeds
Base Clock
795 MHz
1000 MHz
Boost Clock
2040 MHz
2100 MHz
Memory Clock
1563 MHz
1300 MHz
Memory
Memory Size
24GB
128GB
Memory Type
GDDR6
HBM3
Memory Bus
192bit
8192bit
Bandwidth
300.1GB/s
5.32TB/s
Render Config
SM Count
60
-
Shading Units
7424
14592
TMUs
240
912
ROPs
80
0
Tensor Cores
240
-
RT Cores
60
-
L1 Cache
128 KB (per SM)
16 KB (per CU)
L2 Cache
48 MB
16 MB
Compute Units
-
228
L3 Cache
-
256 MB
Theoretical Performance
Pixel Rate
163.2 GPixel/s
0 MPixel/s
Texture Rate
489.6 GTexel/s
1915.2 GTexel/s
FP16 (half)
30.29 TFLOPS
653.7 TFLOPS
FP32 (float)
30.29 TFLOPS
61.29 TFLOPS
FP64 (double)
473.3 GFLOPS
30.64 TFLOPS
Graphics Processor
GPU Name
AD104
Aqua Vanjaram
GPU Variant
AD104-???-A1
-
Architecture
Ada Lovelace
CDNA 3.0
Foundry
TSMC
TSMC
Process Size
5 nm
5 nm
Transistors
35.8 billion
153 billion
Die Size
294 mm²
1017 mm²
Board Design
TDP
72W
750W
Suggested PSU
250 W
1150 W
Outputs
No outputs
No outputs
Power Connectors
None
None
Graphics Features
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.9
-
Shader Model
6.8
N/A