Product Compare

NVIDIA A100 SXM4 40 GB vs NVIDIA GeForce RTX 4090 Max-Q

GPU GPU
Graphics Card
Release Date May 2020 Jan 2023
Generation Tesla Ampere GeForce 40 Mobile
Type AI GPU Mobile
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1095 MHz 930 MHz
Boost Clock 1410 MHz 1455 MHz
Memory Clock 1215 MHz 1750 MHz
Memory
Memory Size 40GB 16GB
Memory Type HBM2e GDDR6
Memory Bus 5120bit 256bit
Bandwidth 1555GB/s 448.0GB/s
Render Config
SM Count 108 76
Shading Units 6912 9728
TMUs 432 304
ROPs 160 112
Tensor Cores 432 304
L1 Cache 192 KB (per SM) 128 KB (per SM)
L2 Cache 40 MB 64 MB
RT Cores 76
Theoretical Performance
Pixel Rate 225.6 GPixel/s 163.0 GPixel/s
Texture Rate 609.1 GTexel/s 442.3 GTexel/s
FP16 (half) 77.97 TFLOPS 28.31 TFLOPS
FP32 (float) 19.49 TFLOPS 28.31 TFLOPS
FP64 (double) 9.746 TFLOPS 442.3 GFLOPS
Graphics Processor
GPU Name GA100 AD103
Architecture Ampere Ada Lovelace
Foundry TSMC TSMC
Process Size 7 nm 4 nm
Transistors 54.2 billion 45.9 billion
Die Size 826 mm² 379 mm²
GPU Variant GN21-X11
Board Design
TDP 400W 80W
Suggested PSU 800 W
Outputs No outputs Portable Device Dependent
Power Connectors None None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 8.0 8.9
Shader Model N/A 6.7