Product Compare

NVIDIA A100 SXM4 40 GB vs NVIDIA Tesla PG500 216

GPU GPU
Graphics Card
Release Date May 2020 Nov 2019
Generation Tesla Ampere Tesla
Type AI GPU Professional
Bus Interface PCIe 4.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1095 MHz 1260 MHz
Boost Clock 1410 MHz 1380 MHz
Memory Clock 1215 MHz 1106 MHz
Memory
Memory Size 40GB 32GB
Memory Type HBM2e HBM2
Memory Bus 5120bit 4096bit
Bandwidth 1555GB/s 1133GB/s
Render Config
SM Count 108 80
Shading Units 6912 5120
TMUs 432 320
ROPs 160 128
Tensor Cores 432 640
L1 Cache 192 KB (per SM) 128 KB (per SM)
L2 Cache 40 MB 6 MB
Theoretical Performance
Pixel Rate 225.6 GPixel/s 176.6 GPixel/s
Texture Rate 609.1 GTexel/s 441.6 GTexel/s
FP16 (half) 77.97 TFLOPS 28.26 TFLOPS
FP32 (float) 19.49 TFLOPS 14.13 TFLOPS
FP64 (double) 9.746 TFLOPS 7.066 TFLOPS
Graphics Processor
GPU Name GA100 GV100
Architecture Ampere Volta
Foundry TSMC TSMC
Process Size 7 nm 12 nm
Transistors 54.2 billion 21.1 billion
Die Size 826 mm² 815 mm²
Board Design
TDP 400W 250W
Suggested PSU 800 W 600 W
Outputs No outputs No outputs
Power Connectors None None
Graphics Features
DirectX N/A 12 (12_1)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 8.0 7.0
Shader Model N/A 6.6