Product Compare

NVIDIA L40S vs NVIDIA RTX A5000-12Q

GPU GPU
Graphics Card
Release Date Oct 2022 Apr 2021
Generation Server Ada Quadro Ampere
Type Professional Desktop
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1065 MHz 1170 MHz
Boost Clock 2520 MHz 1695 MHz
Memory Clock 2250 MHz 2000 MHz
Memory
Memory Size 48GB 12GB
Memory Type GDDR6 GDDR6
Memory Bus 384bit 384bit
Bandwidth 864.0GB/s 768.0GB/s
Render Config
SM Count 142 64
Shading Units 18176 8192
TMUs 568 256
ROPs 192 96
Tensor Cores 568 256
RT Cores 142 64
L1 Cache 128 KB (per SM) 128 KB (per SM)
L2 Cache 48 MB 6 MB
Theoretical Performance
Pixel Rate 483.8 GPixel/s 162.7 GPixel/s
Texture Rate 1431.4 GTexel/s 433.9 GTexel/s
FP16 (half) 91.61 TFLOPS 27.77 TFLOPS
FP32 (float) 91.61 TFLOPS 27.77 TFLOPS
FP64 (double) 1431.4 GFLOPS 433.9 GFLOPS
Graphics Processor
GPU Name AD102 GA102
GPU Variant AD102-896-A1
Architecture Ada Lovelace Ampere
Foundry TSMC Samsung
Process Size 5 nm 8 nm
Transistors 76.3 billion 28.3 billion
Die Size 609 mm² 628 mm²
Board Design
TDP 350W 230W
Suggested PSU 750 W 550 W
Outputs 4x DisplayPort 1.4a 4x DisplayPort 1.4a
Power Connectors 1x 16-pin 1x 8-pin
Graphics Features
DirectX 12 Ultimate (12_2) 12 Ultimate (12_2)
OpenGL 4.6 4.6
OpenCL 3.0 3.0
Vulkan 1.4 1.3
CUDA 8.9 8.6
Shader Model 6.9 6.7