Product Compare

NVIDIA A100 SXM4 40 GB vs NVIDIA B200

GPU GPU
Graphics Card
Release Date May 2020 Jan 2024
Generation Tesla Ampere Server Blackwell
Type AI GPU Desktop
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1095 MHz 700 MHz
Boost Clock 1410 MHz 1965 MHz
Memory Clock 1215 MHz 2000 MHz
Memory
Memory Size 40GB 90GB
Memory Type HBM2e HBM3e
Memory Bus 5120bit 4096bit
Bandwidth 1555GB/s 4.10TB/s
Render Config
SM Count 108 148
Shading Units 6912 18944
TMUs 432 592
ROPs 160 24
Tensor Cores 432 592
L1 Cache 192 KB (per SM) 256 KB (per SM)
L2 Cache 40 MB 50 MB
Theoretical Performance
Pixel Rate 225.6 GPixel/s 47.16 GPixel/s
Texture Rate 609.1 GTexel/s 1163.3 GTexel/s
FP16 (half) 77.97 TFLOPS 1191.2 TFLOPS
FP32 (float) 19.49 TFLOPS 74.45 TFLOPS
FP64 (double) 9.746 TFLOPS 37.22 TFLOPS
Graphics Processor
GPU Name GA100 GB100
Architecture Ampere Blackwell
Foundry TSMC TSMC
Process Size 7 nm 5 nm
Transistors 54.2 billion 104 billion
Die Size 826 mm² Unknown
Board Design
TDP 400W 1000W
Suggested PSU 800 W 1400 W
Outputs No outputs No outputs
Power Connectors None
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 8.0 10.0
Shader Model N/A N/A