NVIDIA B200 SXM 192 GB vs NVIDIA RTX A4000

GPU Specs Compare

G

NVIDIA B200 SXM 192 GB

NVIDIA 2024-01
G

NVIDIA RTX A4000

NVIDIA 2021-04

Graphics Card

Release Date
Jan 2024
Apr 2021
Generation
Server Blackwell
Quadro Ampere
Type
Desktop
Professional
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x16

Clock Speeds

Base Clock
1665 MHz
735 MHz
Boost Clock
1837 MHz
1560 MHz
Memory Clock
2000 MHz
1750 MHz

Memory

Memory Size
96GB
16GB
Memory Type
HBM3e
GDDR6
Memory Bus
4096bit
256bit
Bandwidth
4.10TB/s
448.0GB/s

Render Config

SM Count
132
48
Shading Units
16896
6144
TMUs
528
192
ROPs
24
96
Tensor Cores
528
192
L1 Cache
256 KB (per SM)
128 KB (per SM)
L2 Cache
50 MB
4 MB
RT Cores
-
48

Theoretical Performance

Pixel Rate
44.09 GPixel/s
149.8 GPixel/s
Texture Rate
969.9 GTexel/s
299.5 GTexel/s
FP16 (half)
248.3 TFLOPS
19.17 TFLOPS
FP32 (float)
62.08 TFLOPS
19.17 TFLOPS
FP64 (double)
31.04 TFLOPS
299.5 GFLOPS

Graphics Processor

GPU Name
GB100
GA104
Architecture
Blackwell
Ampere
Foundry
TSMC
Samsung
Process Size
5 nm
8 nm
Transistors
104 billion
17.4 billion
Die Size
Unknown
392 mm²
GPU Variant
-
GA104-875-A1

Board Design

TDP
1000W
140W
Suggested PSU
1400 W
300 W
Outputs
No outputs
4x DisplayPort 1.4a
Power Connectors
-
1x 6-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.3
CUDA
10.0
8.6
Shader Model
N/A
6.7

📊 Benchmark

3DMark Time Spy
-
11,079
3DMark Time Spy Extreme
-
5,367
OctaneBench
-
352