Product Compare

NVIDIA GRID A100A vs NVIDIA H800 SXM5

GPU GPU
Graphics Card
Release Date May 2020 Mar 2023
Generation GRID Server Hopper
Type Professional AI GPU
Bus Interface PCIe 4.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 1095 MHz 1095 MHz
Boost Clock 1410 MHz 1755 MHz
Memory Clock 1215 MHz 1313 MHz
Memory
Memory Size 32GB 80GB
Memory Type HBM2e HBM3
Memory Bus 6144bit 5120bit
Bandwidth 1.87TB/s 3.36TB/s
Render Config
SM Count 108 132
Shading Units 6912 16896
TMUs 432 528
ROPs 192 24
Tensor Cores 432 528
L1 Cache 192 KB (per SM) 256 KB (per SM)
L2 Cache 32 MB 50 MB
Theoretical Performance
Pixel Rate 270.7 GPixel/s 42.12 GPixel/s
Texture Rate 609.1 GTexel/s 926.6 GTexel/s
FP16 (half) 77.97 TFLOPS 237.2 TFLOPS
FP32 (float) 19.49 TFLOPS 59.30 TFLOPS
FP64 (double) 9.746 TFLOPS 29.65 TFLOPS
Graphics Processor
GPU Name GA100 GH100
Architecture Ampere Hopper
Foundry TSMC TSMC
Process Size 7 nm 5 nm
Transistors 54.2 billion 80 billion
Die Size 826 mm² 814 mm²
Board Design
TDP 400W 700W
Suggested PSU 800 W 1100 W
Outputs No outputs No outputs
Power Connectors None 8-pin EPS
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 8.0 9.0
Shader Model N/A N/A