Product Compare

NVIDIA A100 PCIe vs NVIDIA GeForce RTX 3070

GPU GPU
Graphics Card
Release Date Jun 2020 Sep 2020
Generation Tesla GeForce 30
Type AI GPU Desktop
Bus Interface PCIe 4.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 765 MHz 1500 MHz
Boost Clock 1410 MHz 1725 MHz
Memory Clock 1215 MHz 1750 MHz
Memory
Memory Size 40GB 8GB
Memory Type HBM2e GDDR6
Memory Bus 5120bit 256bit
Bandwidth 1555GB/s 448.0GB/s
Render Config
SM Count 108 46
Shading Units 6912 5888
TMUs 432 184
ROPs 160 96
Tensor Cores 432 184
L1 Cache 192 KB (per SM) 128 KB (per SM)
L2 Cache 40 MB 4 MB
RT Cores 46
Theoretical Performance
Pixel Rate 225.6 GPixel/s 165.6 GPixel/s
Texture Rate 609.1 GTexel/s 317.4 GTexel/s
FP16 (half) 77.97 TFLOPS 20.31 TFLOPS
FP32 (float) 19.49 TFLOPS 20.31 TFLOPS
FP64 (double) 9.746 TFLOPS 317.4 GFLOPS
Graphics Processor
GPU Name GA100 GA104
Architecture Ampere Ampere
Foundry TSMC Samsung
Process Size 7 nm 8 nm
Transistors 54.2 billion 17.4 billion
Die Size 826 mm² 392 mm²
GPU Variant GA104-300-A1
Board Design
TDP 250W 220W
Suggested PSU 600 W 550 W
Outputs No outputs 1x HDMI 2.13x DisplayPort 1.4a
Power Connectors 8-pin EPS 1x 12-pin
Graphics Features
DirectX N/A 12 Ultimate (12_2)
OpenGL N/A 4.6
OpenCL 3.0 3.0
Vulkan N/A 1.3
CUDA 8.0 8.6
Shader Model N/A 6.6