Product Compare

NVIDIA A100 SXM4 40 GB vs NVIDIA GeForce RTX 4080 16 GB

GPU GPU
Graphics Card
Release Date May 2020 Sep 2022
Generation Tesla Ampere GeForce 40
Type AI GPU Desktop
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1095 MHz 2205 MHz
Boost Clock 1410 MHz 2505 MHz
Memory Clock 1215 MHz 1400 MHz
Memory
Memory Size 40GB 16GB
Memory Type HBM2e GDDR6X
Memory Bus 5120bit 256bit
Bandwidth 1555GB/s 716.8GB/s
Render Config
SM Count 108 76
Shading Units 6912 9728
TMUs 432 304
ROPs 160 112
Tensor Cores 432 304
L1 Cache 192 KB (per SM) 128 KB (per SM)
L2 Cache 40 MB 64 MB
RT Cores 76
Theoretical Performance
Pixel Rate 225.6 GPixel/s 280.6 GPixel/s
Texture Rate 609.1 GTexel/s 761.5 GTexel/s
FP16 (half) 77.97 TFLOPS 48.74 TFLOPS
FP32 (float) 19.49 TFLOPS 48.74 TFLOPS
FP64 (double) 9.746 TFLOPS 761.5 GFLOPS
Graphics Processor
GPU Name GA100 AD103
Architecture Ampere Ada Lovelace
Foundry TSMC TSMC
Process Size 7 nm 4 nm
Transistors 54.2 billion 45.9 billion
Die Size 826 mm² 379 mm²
GPU Variant AD103-300-A1
Board Design
TDP 400W 320W
Suggested PSU 800 W 700 W
Outputs No outputs 1x HDMI 2.13x DisplayPort 1.4a
Power Connectors None 1x 16-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 8.0 8.9
Shader Model N/A 6.6