Nvidia H200 SXM
Nvidia H200 SXM
The H200 SXM 141 GB is a professional graphics card by NVIDIA, launched on November 18th, 2024. Built on the 5 nm process, and based on the GH100 graphics processor, the card does not support DirectX. Since H200 SXM 141 GB does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GH100 graphics processor is a large chip with a die area of 814 mm² and 80,000 million transistors. It features 16896 shading units, 528 texture mapping units, and 24 ROPs.
Also included are 528 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 141 GB HBM3e memory with the H200 SXM 141 GB, which are connected using a 6144-bit memory interface. The GPU is operating at a frequency of 1500 MHz, which can be boosted up to 1980 MHz, memory is running at 1593 MHz.
Being a sxm module card, the NVIDIA H200 SXM 141 GB draws power from an 8-pin EPS power connector, with power draw rated at 700 W maximum. This device has no display connectivity, as it is not designed to have monitors connected to it. H200 SXM 141 GB is connected to the rest of the system using a PCI-Express 5.0 x16 interface.
Specifications
NVIDIA H200 Tensor Core GPU
| H200 SXM¹ | H200 NVL¹ | |
|---|---|---|
| FP64 | 34 TFLOPS | 30 TFLOPS |
| FP64 Tensor Core | 67 TFLOPS | 60 TFLOPS |
| FP32 | 67 TFLOPS | 60 TFLOPS |
| TF32 Tensor Core² | 989 TFLOPS | 835 TFLOPS |
| BFLOAT16 Tensor Core² | 1,979 TFLOPS | 1,671 TFLOPS |
| FP16 Tensor Core² | 1,979 TFLOPS | 1,671 TFLOPS |
| FP8 Tensor Core² | 3,958 TFLOPS | 3,341 TFLOPS |
| INT8 Tensor Core² | 3,958 TFLOPS | 3,341 TFLOPS |
| GPU Memory | 141GB | 141GB |
| GPU Memory Bandwidth | 4.8TB/s | 4.8TB/s |
| Decoders | 7 NVDEC 7 JPEG |
7 NVDEC 7 JPEG |
| Confidential Computing | Supported | Supported |
| Max Thermal Design Power (TDP) | Up to 700W (configurable) | Up to 600W (configurable) |
| Multi-Instance GPUs | Up to 7 MIGs @18GB each | Up to 7 MIGs @16.5GB each |
| Form Factor | SXM | PCIe Dual-slot air-cooled |
| Interconnect | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s |
2- or 4-way NVIDIA NVLink bridge: 900GB/s per GPU PCIe Gen5: 128GB/s |
| Server Options | NVIDIA HGX™ H200 partner and NVIDIA-Certified Systems™ with 4 or 8 GPUs | NVIDIA MGX™ H200 NVL partner and NVIDIA-Certified Systems with up to 8 GPUs |
| NVIDIA AI Enterprise | Add-on | Included |
