NVIDIA HGX B200
NVIDIA HGX B200
NVIDIA HGX B200 is revolutionizing accelerated computing by unlocking unprecedented performance and energy efficiency. This post shows how HGX B200 is outperforming its predecessor NVIDIA HGX H100 in environmental metrics, including reduced carbon intensity, through a comparison of their recently published product carbon footprint (PCF) summaries.
Specifically, an analysis of the PCF data reveals that HGX B200 shows a 24% reduction of embodied carbon emissions across large workloads such as AI training and inference.
HGX B200 and HGX H100 are accelerated computing platforms composed of eight GPUs each, with high-speed interconnects through NVIDIA NVLink and NVIDIA NVSwitch to accelerate AI performance at scale. Both are designed for high-performance computing (HPC) and supporting data analytics workloads.
HGX B200 and HGX H100 are accelerated computing platforms composed of eight GPUs each, with high-speed interconnects through NVIDIA NVLink and NVIDIA NVSwitch to accelerate AI performance at scale. Both are designed for high-performance computing (HPC) and supporting data analytics workloads.
| Specification | HGX B300 | HGX B200 |
|---|---|---|
| Form Factor | 8x NVIDIA Blackwell Ultra SXM | 8x NVIDIA Blackwell SXM |
| FP4 Tensor Core** | 144 PFLOPS | 105 PFLOPS | 144 PFLOPS | 72 PFLOPS |
| FP8/FP6 Tensor Core* | 72 PFLOPS | 72 PFLOPS |
| INT8 Tensor Core* | 2 POPS | 72 POPS |
| FP16/BF16 Tensor Core* | 36 PFLOPS | 36 PFLOPS |
| TF32 Tensor Core* | 18 PFLOPS | 18 PFLOPS |
| FP32 | 600 TFLOPS | 600 TFLOPS |
| FP64/FP64 Tensor Core | 10 TFLOPS | 296 TFLOPS |
| Total Memory | Up to 2.3 TB | 1.4 TB |
| NVLink | Fifth generation | Fifth generation |
| NVIDIA NVSwitch™ | NVLink 5 Switch | NVLink 5 Switch |
| NVSwitch GPU-to-GPU Bandwidth | 1.8 TB/s | 1.8 TB/s |
| Total NVLink Bandwidth | 14.4 TB/s | 14.4 TB/s |
| Networking Bandwidth | 1.6 TB/s | 0.8 TB/s |
| Attention Performance | 2X | 1X |
