Product Compare

NVIDIA TITAN Xp vs NVIDIA A100 SXM4 40 GB

GPU GPU
Graphics Card
Release Date Apr 2017 May 2020
Generation GeForce 10 Tesla Ampere
Type Desktop AI GPU
Bus Interface PCIe 3.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1405 MHz 1095 MHz
Boost Clock 1582 MHz 1410 MHz
Memory Clock 1426 MHz 1215 MHz
Memory
Memory Size 12GB 40GB
Memory Type GDDR5X HBM2e
Memory Bus 384bit 5120bit
Bandwidth 547.6GB/s 1555GB/s
Render Config
SM Count 30 108
Shading Units 3840 6912
TMUs 240 432
ROPs 96 160
L1 Cache 48 KB (per SM) 192 KB (per SM)
L2 Cache 3 MB 40 MB
Tensor Cores 432
Theoretical Performance
Pixel Rate 151.9 GPixel/s 225.6 GPixel/s
Texture Rate 379.7 GTexel/s 609.1 GTexel/s
FP16 (half) 189.8 GFLOPS 77.97 TFLOPS
FP32 (float) 12.15 TFLOPS 19.49 TFLOPS
FP64 (double) 379.7 GFLOPS 9.746 TFLOPS
Graphics Processor
GPU Name GP102 GA100
GPU Variant GP102-450-A1
Architecture Pascal Ampere
Foundry TSMC TSMC
Process Size 16 nm 7 nm
Transistors 11.8 billion 54.2 billion
Die Size 471 mm² 826 mm²
Board Design
TDP 250W 400W
Suggested PSU 600 W 800 W
Outputs 1x HDMI 2.03x DisplayPort 1.4a No outputs
Power Connectors 1x 6-pin + 1x 8-pin None
Graphics Features
DirectX 12 (12_1) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 6.1 8.0
Shader Model 6.8 N/A