Product Compare

NVIDIA A100 SXM4 40 GB vs NVIDIA Tesla T4

GPU GPU
Graphics Card
Release Date May 2020 Sep 2018
Generation Tesla Ampere Tesla
Type AI GPU Professional
Bus Interface PCIe 4.0 x16 PCIe 3.0 x16
Clock Speeds
Base Clock 1095 MHz 585 MHz
Boost Clock 1410 MHz 1590 MHz
Memory Clock 1215 MHz 1250 MHz
Memory
Memory Size 40GB 16GB
Memory Type HBM2e GDDR6
Memory Bus 5120bit 256bit
Bandwidth 1555GB/s 320.0GB/s
Render Config
SM Count 108 40
Shading Units 6912 2560
TMUs 432 160
ROPs 160 64
Tensor Cores 432 320
L1 Cache 192 KB (per SM) 64 KB (per SM)
L2 Cache 40 MB 4 MB
RT Cores 40
Theoretical Performance
Pixel Rate 225.6 GPixel/s 101.8 GPixel/s
Texture Rate 609.1 GTexel/s 254.4 GTexel/s
FP16 (half) 77.97 TFLOPS 65.13 TFLOPS
FP32 (float) 19.49 TFLOPS 8.141 TFLOPS
FP64 (double) 9.746 TFLOPS 254.4 GFLOPS
Graphics Processor
GPU Name GA100 TU104
Architecture Ampere Turing
Foundry TSMC TSMC
Process Size 7 nm 12 nm
Transistors 54.2 billion 13.6 billion
Die Size 826 mm² 545 mm²
GPU Variant TU104-895-A1
Board Design
TDP 400W 70W
Suggested PSU 800 W 250 W
Outputs No outputs No outputs
Power Connectors None None
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 8.0 7.5
Shader Model N/A 6.6
Benchmarks
Blender 2186 1652