NVIDIA Tesla T40 24 GB vs NVIDIA H100 SXM5

GPU Specs Compare

Graphics Card

Release Date
Unknown
Mar 2022
Generation
Tesla Turing
Tesla Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1305 MHz
1590 MHz
Boost Clock
1560 MHz
1980 MHz
Memory Clock
1625 MHz
1313 MHz

Memory

Memory Size
24GB
80GB
Memory Type
GDDR6
HBM3
Memory Bus
384bit
5120bit
Bandwidth
624.0GB/s
3350GB/s

Render Config

SM Count
72
132
Shading Units
4608
16896
TMUs
288
528
ROPs
96
24
Tensor Cores
576
528
RT Cores
72
-
L1 Cache
64 KB (per SM)
256 KB (per SM)
L2 Cache
6 MB
50 MB

Theoretical Performance

Pixel Rate
149.8 GPixel/s
47.52 GPixel/s
Texture Rate
449.3 GTexel/s
1045 GTexel/s
FP16 (half)
28.75 TFLOPS
267.6 TFLOPS
FP32 (float)
14.38 TFLOPS
66.91 TFLOPS
FP64 (double)
449.3 GFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
TU102
GH100
Architecture
Turing
Hopper
Foundry
TSMC
TSMC
Process Size
12 nm
4 nm
Transistors
18.6 billion
80 billion
Die Size
754 mm²
814 mm²

Board Design

TDP
250W
700W
Suggested PSU
600 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
1x 8-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
7.5
9.0
Shader Model
6.8
N/A