Product Compare

NVIDIA L40 CNX vs NVIDIA GeForce RTX 4060 Ti AD104

GPU GPU
Graphics Card
Release Date Oct 2022 Apr 2024
Generation Tesla Ada GeForce 40
Type Professional Desktop
Bus Interface PCIe 4.0 x16 PCIe 4.0 x8
Clock Speeds
Base Clock 1005 MHz 2310 MHz
Boost Clock 2475 MHz 2535 MHz
Memory Clock 2250 MHz 2250 MHz
Memory
Memory Size 24GB 8GB
Memory Type GDDR6 GDDR6
Memory Bus 384bit 128bit
Bandwidth 864.0GB/s 288.0GB/s
Render Config
SM Count 142 34
Shading Units 18176 4352
TMUs 568 136
ROPs 192 48
Tensor Cores 568 136
RT Cores 142 34
L1 Cache 128 KB (per SM) 128 KB (per SM)
L2 Cache 48 MB 32 MB
Theoretical Performance
Pixel Rate 475.2 GPixel/s 121.7 GPixel/s
Texture Rate 1406 GTexel/s 344.8 GTexel/s
FP16 (half) 89.97 TFLOPS 22.06 TFLOPS
FP32 (float) 89.97 TFLOPS 22.06 TFLOPS
FP64 (double) 1406 GFLOPS 344.8 GFLOPS
Graphics Processor
GPU Name AD102 AD104
GPU Variant AD102-???-A1 AD104-150-K1-A1
Architecture Ada Lovelace Ada Lovelace
Foundry TSMC TSMC
Process Size 4 nm 5 nm
Transistors 76.3 billion 35.8 billion
Die Size 608 mm² 294 mm²
Board Design
TDP 300W 160W
Suggested PSU 700 W 450 W
Outputs 1x HDMI 2.13x DisplayPort 1.4a 1x HDMI 2.13x DisplayPort 1.4a
Power Connectors 1x 16-pin 1x 16-pin
Graphics Features
DirectX 12 Ultimate (12_2) 12 Ultimate (12_2)
OpenGL 4.6 4.6
OpenCL 3.0 3.0
Vulkan 1.3 1.3
CUDA 8.9 8.9
Shader Model 6.6 6.7