Product Compare

NVIDIA H100 SXM5 80 GB vs NVIDIA A800 PCIe 40 GB

GPU GPU
Graphics Card
Release Date Oct 2022 Nov 2022
Generation Server Hopper Ampere
Type AI GPU AI GPU
Bus Interface PCIe 5.0 x16 PCIe 4.0 x16
Clock Speeds
Base Clock 1590 MHz 765 MHz
Boost Clock 1980 MHz 1410 MHz
Memory Clock 1313 MHz 1215 MHz
Memory
Memory Size 80GB 40GB
Memory Type HBM3 HBM2e
Memory Bus 5120bit 5120bit
Bandwidth 3.36TB/s 1555GB/s
Render Config
SM Count 132 108
Shading Units 16896 6912
TMUs 528 432
ROPs 24 160
Tensor Cores 528 432
L1 Cache 256 KB (per SM) 192 KB (per SM)
L2 Cache 50 MB 40 MB
Theoretical Performance
Pixel Rate 47.52 GPixel/s 225.6 GPixel/s
Texture Rate 1045 GTexel/s 609.1 GTexel/s
FP16 (half) 267.6 TFLOPS 77.97 TFLOPS
FP32 (float) 66.91 TFLOPS 19.49 TFLOPS
FP64 (double) 33.45 TFLOPS 9.746 TFLOPS
Graphics Processor
GPU Name GH100 GA100
Architecture Hopper Ampere
Foundry TSMC TSMC
Process Size 5 nm 7 nm
Transistors 80 billion 54.2 billion
Die Size 814 mm² 826 mm²
Board Design
TDP 700W 250W
Suggested PSU 1100 W 600 W
Outputs No outputs No outputs
Power Connectors None 8-pin EPS
Graphics Features
DirectX N/A N/A
OpenGL N/A N/A
OpenCL 3.0 3.0
Vulkan N/A N/A
CUDA 9.0 8.0
Shader Model N/A N/A