NVIDIA Tesla T40 24 GB vs NVIDIA H100 PCIe

GPU Specs Compare

Graphics Card

Release Date
Unknown
Mar 2022
Generation
Tesla Turing
Tesla Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1305 MHz
1095 MHz
Boost Clock
1560 MHz
1755 MHz
Memory Clock
1625 MHz
1593 MHz

Memory

Memory Size
24GB
80GB
Memory Type
GDDR6
HBM2e
Memory Bus
384bit
5120bit
Bandwidth
624.0GB/s
2039GB/s

Render Config

SM Count
72
114
Shading Units
4608
14592
TMUs
288
456
ROPs
96
24
Tensor Cores
576
456
RT Cores
72
-
L1 Cache
64 KB (per SM)
256 KB (per SM)
L2 Cache
6 MB
50 MB

Theoretical Performance

Pixel Rate
149.8 GPixel/s
42.12 GPixel/s
Texture Rate
449.3 GTexel/s
800.3 GTexel/s
FP16 (half)
28.75 TFLOPS
204.9 TFLOPS
FP32 (float)
14.38 TFLOPS
51.22 TFLOPS
FP64 (double)
449.3 GFLOPS
25.61 TFLOPS

Graphics Processor

GPU Name
TU102
GH100
Architecture
Turing
Hopper
Foundry
TSMC
TSMC
Process Size
12 nm
4 nm
Transistors
18.6 billion
80 billion
Die Size
754 mm²
814 mm²

Board Design

TDP
250W
350W
Suggested PSU
600 W
750 W
Outputs
No outputs
No outputs
Power Connectors
1x 8-pin
1x 16-pin

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
7.5
9.0
Shader Model
6.8
N/A