Product Compare

NVIDIA Tesla M40 vs NVIDIA H100 SXM5 96 GB

GPU GPU
Graphics Card
Release Date Nov 2015 Mar 2023
Generation Tesla Maxwell Server Hopper
Type Professional AI GPU
Bus Interface PCIe 3.0 x16 PCIe 5.0 x16
Clock Speeds
Base Clock 948 MHz 1350 MHz
Boost Clock 1112 MHz 1980 MHz
Memory Clock 1502 MHz 1313 MHz
Memory
Memory Size 12GB 96GB
Memory Type GDDR5 HBM3
Memory Bus 384bit 5120bit
Bandwidth 288.4GB/s 3.36TB/s
Render Config
Shading Units 3072 16896
TMUs 192 528
ROPs 96 24
L1 Cache 48 KB (per SMM) 256 KB (per SM)
L2 Cache 3 MB 50 MB
SM Count 132
Tensor Cores 528
Theoretical Performance
Pixel Rate 106.8 GPixel/s 47.52 GPixel/s
Texture Rate 213.5 GTexel/s 1045 GTexel/s
FP32 (float) 6.832 TFLOPS 66.91 TFLOPS
FP64 (double) 213.5 GFLOPS 33.45 TFLOPS
FP16 (half) 267.6 TFLOPS
Graphics Processor
GPU Name GM200 GH100
GPU Variant GM200-895-A1
Architecture Maxwell 2.0 Hopper
Foundry TSMC TSMC
Process Size 28 nm 5 nm
Transistors 8 billion 80 billion
Die Size 601 mm² 814 mm²
Board Design
TDP 250W 700W
Suggested PSU 600 W 1100 W
Outputs No outputs No outputs
Power Connectors 8-pin EPS 8-pin EPS
Graphics Features
DirectX 12 (12_1) N/A
OpenGL 4.6 N/A
OpenCL 3.0 3.0
Vulkan 1.3 N/A
CUDA 5.2 9.0
Shader Model 6.7 N/A