NVIDIA A100 SXM4 40 GB vs AMD Instinct MI300A

GPU Specs Compare

G

NVIDIA A100 SXM4 40 GB

NVIDIA 2020-05
G

AMD Instinct MI300A

AMD 2023-12

Graphics Card

Release Date
May 2020
Dec 2023
Generation
Tesla Ampere
Radeon Instinct
Type
AI GPU
Professional
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1095 MHz
1000 MHz
Boost Clock
1410 MHz
2100 MHz
Memory Clock
1215 MHz
1300 MHz

Memory

Memory Size
40GB
128GB
Memory Type
HBM2e
HBM3
Memory Bus
5120bit
8192bit
Bandwidth
1555GB/s
5.32TB/s

Render Config

SM Count
108
-
Shading Units
6912
14592
TMUs
432
912
ROPs
160
0
Tensor Cores
432
-
L1 Cache
192 KB (per SM)
16 KB (per CU)
L2 Cache
40 MB
16 MB
Compute Units
-
228
L3 Cache
-
256 MB

Theoretical Performance

Pixel Rate
225.6 GPixel/s
0 MPixel/s
Texture Rate
609.1 GTexel/s
1915.2 GTexel/s
FP16 (half)
77.97 TFLOPS
653.7 TFLOPS
FP32 (float)
19.49 TFLOPS
61.29 TFLOPS
FP64 (double)
9.746 TFLOPS
30.64 TFLOPS

Graphics Processor

GPU Name
GA100
Aqua Vanjaram
Architecture
Ampere
CDNA 3.0
Foundry
TSMC
TSMC
Process Size
7 nm
5 nm
Transistors
54.2 billion
153 billion
Die Size
826 mm²
1017 mm²

Board Design

TDP
400W
750W
Suggested PSU
800 W
1150 W
Outputs
No outputs
No outputs
Power Connectors
None
None

Graphics Features

DirectX
N/A
N/A
OpenGL
N/A
N/A
OpenCL
3.0
3.0
Vulkan
N/A
N/A
CUDA
8.0
-
Shader Model
N/A
N/A

📊 Benchmark

Blender
2,186
-