Product Compare

NVIDIA L4 vs NVIDIA L40

GPU GPU
Graphics Card
Release Date Mar 2023 Oct 2022
Generation Tesla Ada(Lxx) Tesla Ada
Type Professional Professional
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 795 MHz 735 MHz
Boost Clock 2040 MHz 2490 MHz
Memory Clock 1563 MHz 2250 MHz
Memory
Memory Size 24GB 48GB
Memory Type GDDR6 GDDR6
Memory Bus 192bit 384bit
Bandwidth 300.1GB/s 864.0GB/s
Render Config
SM Count 60 142
Shading Units 7424 18176
TMUs 240 568
ROPs 80 192
Tensor Cores 240 568
RT Cores 60 142
L1 Cache 128 KB (per SM) 128 KB (per SM)
L2 Cache 48 MB 96 MB
Theoretical Performance
Pixel Rate 163.2 GPixel/s 478.1 GPixel/s
Texture Rate 489.6 GTexel/s 1414 GTexel/s
FP16 (half) 30.29 TFLOPS 90.52 TFLOPS
FP32 (float) 30.29 TFLOPS 90.52 TFLOPS
FP64 (double) 473.3 GFLOPS 1414 GFLOPS
Graphics Processor
GPU Name AD104 AD102
GPU Variant AD104-???-A1 AD102-895-A1
Architecture Ada Lovelace Ada Lovelace
Foundry TSMC TSMC
Process Size 5 nm 4 nm
Transistors 35.8 billion 76.3 billion
Die Size 294 mm² 608 mm²
Board Design
TDP 72W 300W
Suggested PSU 250 W 700 W
Outputs No outputs 4x DisplayPort 1.4a
Power Connectors None 1x 16-pin
Graphics Features
DirectX 12 Ultimate (12_2) 12 Ultimate (12_2)
OpenGL 4.6 4.6
OpenCL 3.0 3.0
Vulkan 1.3 1.3
CUDA 8.9 8.9
Shader Model 6.8 6.6