NVIDIA A100 SXM4 80 GB vs NVIDIA GeForce RTX 3060 Ti GDDR6X

GPU Specs Compare

Graphics Card

Release Date
Nov 2020
Oct 2022
Generation
Tesla Ampere
GeForce 30
Type
AI GPU
Desktop
Bus Interface
PCIe 4.0 x16
PCIe 4.0 x16

Clock Speeds

Base Clock
1275 MHz
1410 MHz
Boost Clock
1410 MHz
1665 MHz
Memory Clock
1593 MHz
1188 MHz

Memory

Memory Size
80GB
8GB
Memory Type
HBM2e
GDDR6X
Memory Bus
5120bit
256bit
Bandwidth
2039GB/s
608.3GB/s

Render Config

SM Count
108
38
Shading Units
6912
4864
TMUs
432
152
ROPs
160
80
Tensor Cores
432
152
L1 Cache
192 KB (per SM)
128 KB (per SM)
L2 Cache
40 MB
4 MB
RT Cores
-
38

Theoretical Performance

Pixel Rate
225.6 GPixel/s
133.2 GPixel/s
Texture Rate
609.1 GTexel/s
253.1 GTexel/s
FP16 (half)
77.97 TFLOPS
16.20 TFLOPS
FP32 (float)
19.49 TFLOPS
16.20 TFLOPS
FP64 (double)
9.746 TFLOPS
253.1 GFLOPS

Graphics Processor

GPU Name
GA100
GA104
Architecture
Ampere
Ampere
Foundry
TSMC
Samsung
Process Size
7 nm
8 nm
Transistors
54.2 billion
17.4 billion
Die Size
826 mm²
392 mm²
GPU Variant
-
GA104-202-A1

Board Design

TDP
400W
225W
Suggested PSU
800 W
550 W
Outputs
No outputs
1x HDMI 2.13x DisplayPort 1.4a
Power Connectors
None
1x 12-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.3
CUDA
8.0
8.6
Shader Model
N/A
6.7

📊 Benchmark

3DMark Time Spy
-
12,223
3DMark Time Spy Extreme
-
5,941
3DMark Speed Way
-
3,097