Главная Справочники HPE Rack Scale System

NVIDIA GB200 NVL72 by HPE: технические характеристики и документация

Нужна помощь с конфигурацией?

Пришлите SKU, спецификацию или список требований. Специалист Apltech проверит совместимость компонентов и найдёт актуальные артикулы

Получить консультацию →

NVIDIA GB200 NVL72 by HPE: технические характеристики и документация

NVIDIA GB200 NVL72 by HPE

Overview

Have feedback on QuickSpecs? We're listening

NVIDIA GB200 NVL72 by HPE

QuickSpecs

The NVIDIA GB200 NVL72 by HPE is a rack-scale system optimized to accelerate large AI model training, fine-tuning, and real-time inferencing for AI models over 1 trillion parameters.

This architecture is comprised of 36 NVIDIA Grace ARM processors and 72 NVIDIA Blackwell GPUs all interconnected with NVIDIA's 5th-gen NVLink technology. The rack is powered by a set of power shelves through a bus bar and the compute trays are cooled with cold plates that are mounted on the CPUs and GPUs.

NVIDIA GB200 NVL72 by HPE
The HPE offering incorporates direct liquid cooling technologies from HPE. NVIDIA GB200 NVL72 by HPE offers a complete, scalable solution for AI & HPC customers everywhere. NVIDIA GB200 NVL72 by HPE provides maximum performance for Large Model AI Training and Deep Learning. Built with high-speed networking technologies, integrated storage, a robust software portfolio and management tools, NVIDIA GB200 NVL72 by HPE systems enable customers to innovate and prepare for tomorrow's challenges.


Front / Rear View - Rack
Item	Description	Item	Description
1.	Top-of-rack Switches	4.	Compute Trays
2.	Power Shelves	5.	Cable Cartridges
3.	NVLink Switch Trays	6.	44U Rack Manifolds

NVIDIA GB200 NVL72 by HPE SKUs Below is a list of SKUs to configure the NVL72 System Additional Software and Support SKUs will be added soon Models
Description	SKU
NVIDIA GB200 NVL72 by HPE Base System Code	S5T77A
NVIDIA GB200 NVL72 by HPE Upgrade System Code	S5T78A
NVIDIA GB200 NVL72 by HPE Rack Solution	S4Q89A

Required Rack Accessories
Rack Manifold (nest under rack solution)	SKU
HPE 44U Top Feed Manifold Kit for NVIDIA NVL72	S5R45A
HPE 44U Bottom Feed Manifold Kit for NVIDIA NVL72	S5R46A

Optional Rack Accessories	SKU
HPE RACK EXTENSION KIT NVL72 300 mm	S5S33A
NVIDIA NVL72 Power Shelf Upgrade Kit	S6D82A

Cooling
RDHX options	SKU
HPE M12 48U 600 mm G2 Rack 208-230 V Top Feed Rear Door Heat Exchanger	S4N09A
HPE M12 48U 600 mm G2 Rack 208-230 V Bottom Feed Rear Door Heat Exchanger	S4N11A

CDU options	SKU
HPE 3-phase 380-480 V Top Feed Primary Bottom Feed Secondary XDU1350 Coolant Distribution Unit	S5R40A
HPE 3-phase 380-480 V Bottom Feed Primary Bottom Feed Secondary XDU1350 Coolant Distribution Unit	S5R41A
HPE 3-phase 380-480 V Top Feed Primary Top Feed Secondary XDU1350 Coolant Distribution Unit	S5S27A
HPE 3-phase 380-480 V Bottom Feed Primary Top Feed Secondary XDU1350 Coolant Distribution Unit	S5S28A

Sellable Service Kit	SKU
Vertiv XDU1350 Essential Spare Parts Kit	S5R44A
Vertiv XDU1350 Recommended Spare Parts Kit	S6D83A

Service / Deployment	SKU
HPE Cray Fill and Drain Hand Pump Kit	P59920-B21

CDU Power Cord	SKU
HPE 560P6W 400 V 3 m CDU Power Cord for Vertiv XDU1350	S5Z51A
HPE 560P6W 400 V 6 m CDU Power Cord for Vertiv XDU1350	S5Z52A
HPE 560P7W 400 V 6 m CDU Power Cord for Vertiv XDU1350	S5Z53A
HPE 560P7W 400 V 3 m CDU Power Cord for Vertiv XDU1350	S5Z54A

CDU Connection Kit
HPE CDU Con Flex Hose Kit Universal		S5S29A
HPE CDU Connection Hard Pipe Kit for Vertiv XDU1350		S5S30A

Secondary Fluid Network Manifold
HPE In-Row CDU Top Feed Secondary Manifold Kit	S5R42A
HPE In-Row CDU Bottom Feed Secondary Manifold Kit	S5R43A

Optional for secondary manifold
HPE Secondary Manifold Single Rack Spacer for NVIDIA NVL72	S5T44A
HPE Secondary Manifold Double Rack Spacer for NVIDIA NVL72	S5T45A

Standard Features

Platform Information

Form Factor

- 48U Rack-scale System

System

- 18x Compute Trays

2x Grace CPUs
4x Blackwell GPUs
PCIe slots (non-configurable): 2x BlueField-3 DPUs and 2x ConnectX-7
Storage: SEDs - Opal/TCP Capable

o 8x E1.S

o 1x M.2

- 9x NVIDIA NVLink Switch Trays

- 6 or 8 33 kW Power Shelves

- 50 V DC Busbar

- 2x SN2201 Top-of-Rack Switches

- 44U Rack Liquid Manifold

- FIO:

- 1x USB 3.0

- 1x USB 2.0 for UART

- 1x Mini Display Port

- 1x Management 1 GbE Port

- 3x Status LEDs

Processors - Grace Arm processor

NVL72 contains 18 compute trays. Each compute tray contains 2 GB200 boards. Each board has 1 Grace ARM processor.

Grace CPU
CPU core count	72 Arm Neoverse V2 cores
L1 cache	64KB i-cache & 64KB d-cache
L2 cache	1 MB per core
L3 cache	114 MB
Base frequency \| all-core SIMD freq	3.1 GHz \| 3.0 GHZ
LPDDR5X Size	512 GB (480 GB useable)

On System Management Chipset

Based on NVIDIA OpenBMC

ASPEED 2600 management controller

Memory

Soldered on 512 GB LPDDR5x - 480 GB useable of LPDDR5x

Memory ECC - Supported and enabled by default

Notes: Memory is not configurable

Front Panel Connections

Item	Description	Item	Description
1.	NVIDIA BlueField 3 B3240	4.	2x NVIDIA ConnectX-7 (400 Gbps)
2.	8x E1.S SSDs
3.	1x FIO panel

Front IO
Technology
1	BlueField 3 DPUs (RJ45 BF3 BMC port, 2x QSFP)
2	E1.S SSDs
3	FIO (RJ45 1 GbE port, USB 3.0, USB 2.0 UART, Mini Display Port)
4	ConnectX-7 I/O Board (2x OSFP)

System Unit Specifications

Dimensions (Height x Width x Depth)

- Rack

1068 mm (L) x 600 mm (W) x 2495 mm (H)

Weight (approximate)

- Fully Loaded (with PGW):

3245 lbs

Internal Storage

Hot-pluggable and hot-swappable

Drive	Capacity	Configuration
Front facing - E1.S SSD	3.84 TB	8 x 3.84 TB
Internal - M.2 SSD	1.98 TB	1 x 1.98 TB

Power Delivery and Requirements

The NVL72 rack is powered by a set of 6 (max: 8) power shelves and a DC bus bar. Each power shelf is fed by a power whip with input connector type IEC 60309 5-wire 560P6W. Each power shelf can provide up to 33 kW of power to the rack.

The rack's TDP (thermal design power) is 132 kW nominal with a EDPp (electrical design power - peak) of 1.5x TDP or approximately 192 kW

HPE suggests that data centers should provision their bus ways to be able to support 192 kW EDPp.

1 Power Shelf contains

- 6x 5.5 kW PSU - Power Supply Units

- 1x PMC - Power shelf management controller

- 1x Power Shelf Chassis

CDU (Cooling Distribution Unit) for NVIDIA GB200 NVL72 by HPE

The cooling distribution unit (CDU) is a liquid-to-liquid heat exchanger that is used to remove heat from HPE GB200 NVL72 by HPE.

The CDU uses a secondary loop to circulate a heat transfer liquid to the cold plates. The heat captured in the secondary loop is transferred to the facilities primary loop via a liquid-to-liquid heat exchanger. The CDU is designed to circulate and control the heat transfer fluid to the manifolds that are in each rack.

The in-row CDU is rated for 1.3 MW of cooling. One CDU supports a maximum of 8 racks.

HPE supports overhead (top feed) and underfloor (bottom feed) secondary loop configurations. A spacer manifold can be used for racks that do not need liquid cooling

Overhead (Top Feed) Configuration with Single Rack Spacer

Underfloor (Bottom Feed) Configuration

Operating Systems and Virtualization Software Support for HPE Servers

Currently, the only supported OS with NVIDIA GB200 NVL72 by HPE is:

Ubuntu 24.04

HPE Server UEFI (under development - subject to change)

Unified Extensible Firmware Interface (UEFI) is an industry standard that provides better manageability and more secured configuration than the legacy ROM while interacting with your server at boot time. HPE ProLiant Gen11 servers have a UEFI Class 3 implementation and support UEFI Mode only.

Notes: The UEFI System Utilities tool is analogous to the HPE ROM-Based Setup Utility (RBSU) of legacy BIOS. For more information, please visit http://www.hpe.com/servers/uefi.

UEFI enables numerous new capabilities specific to HPE ProLiant servers such as

- Secure Boot and Secure Start enable for enhanced security

- Embedded UEFI Shell

- Operating system specific functionality

- Mass Configuration Deployment Tool using iLO RESTful API that is Redfish API Conformant

- Support for greater than 2.2 TB (using GPT) boot drives

- PXE boot support for IPv6 networks

- USB 3.0 Stack

- Workload Profiles for simple performance optimization

UEFI Boot Mode only

- TPM 2.0 Support

- iSCSI Software Initiator Support.

- NVMe Boot Support

- HTTP/HTTPs Boot support as a PXE alternative.

- Platform Trust Technology (PTT) can be enabled.

- Boot support for option cards that only support a UEFI option ROM

Notes: For UEFI Boot Mode, boot environment and OS image installations should be configured properly to support UEFI.

Industry Standard Compliance (under development - subject to change)

- ACPI 6.3 Compliant

- IPMI 2.0

- PCIe 4.0 Compliant

- PCIe 5.0 Compliant

- PXE Support

- Redfish API

- TPM 2.0 Support

- Triple Data Encryption Standard (3DES)

- UEFI (Unified Extensible Firmware Interface Forum) 2.6

- USB 2.0 Compliant

- USB 3.0 Compliant

Embedded Management (under development - subject to change)

Based off of NVIDIA's Reference Firmware with HPE Enhancements such as

- Security Features

Ultimaco ESKM appliance support
Remote Keys
Self-encrypting devices (OPAL compliance)

- Audit Loggin

- Restricted SSH Access

- Serviceability Features

AHS logging limited to sensors and events
CLI Interface
Remote Support

Software delivered as a package to capture and surface data
Redfish Crawler built-in
Secure connectivity layer (provided by RDA)
Provides a method of secure remote access to customer systems

- Manufacturability Features

Non-volatile Hostname/Password

- Branding

HPE Branded GUI

Server Management

NVIDIA GB200 NVL72 by HPE Baseboard Management Controller

Embedded, in-depth server-level monitoring and management technology offering system management, service alerting, reporting and remote management including remote console and virtual media mount.

Industry Standard Redfish

The NVIDIA GB200 NVL72 by HPE supports industry standard DMTF Redfish that provides API conformance and offers simplified server management automation such as configuration and maintenance tasks based on modern industry standards. Learn more at: https://dmtf.org/standards/redfish.

Security (under development - subject to change)

- Secure Start - only boot Signed FW

- UEFI Secure Boot

- NIST SP800-193 Protect, Detect, Recover for BIOS and BMC Tamper-free updates - components digitally signed and verified using CNSA strength RSA4096 signing key.

- Secure Recovery - recover critical firmware to known good state on detection of compromised firmware. Event recorded in the event log.

- UEFI TPM 2.0 (Trusted Platform Module 2.0) - supports OpenSSL 3.0 to provide secure remote connectivity sessions to the system.

- SPI BUS monitoring to ensure BIOS and BMC FW are always signed and secure.

- Secure out-of-the-box high-entropy RMC administrator password is unique for each system.

- Support for multiple Redfish role-based access control (RBAC) accounts ensuring that passwords need not be shared and can provide separation of duties.

Technical Specifications

Product Warranty

This product is covered by a global limited warranty and supported by HPE Services and a worldwide network of Hewlett Packard Enterprise Authorized Channel Partners resellers. Hardware diagnostic support and repair are available for three years from date of purchase. Support for software and initial setup is available for 90 days from date of purchase. Enhancements to warranty services are available through HPE Services operational services or customized service agreements. Hard drives have either a one year or three-year warranty; refer to the specific hard drive QuickSpecs for details.

Notes: Server Warranty includes 3-Year Parts, 3-Year Labor, and 3-Year Onsite support. HPE acknowledges warranty requests on the next business day. Diagnostic completion and potential part shipments will be handled on a best-effort basis. Warranty repairs may be accomplished using Customer Self Repair (CSR) parts. These parts fall into two categories: 1) Mandatory CSR parts are designed for easy replacement. A travel and labor charge will result when customers decline to replace a Mandatory CSR part; 2) Optional CSR parts are also designed for easy replacement but may involve added complexity. Customers may choose to have Hewlett Packard Enterprise replace Optional CSR parts at no charge.

HPE Services

You can count on HPE Services to deliver the expertise you need when, where and how you need it. From planning to deployment, ongoing operations and beyond, our experts can help you realize your digital ambitions.

https://www.hpe.com/services

HPE HPC&AI Custom Support Service

HPE HPC&AI Custom Support Service is a comprehensive support solution tailored to meet specific HPE Cray high-performance computing customer requirements. It comprises hardware and software services and may include HPE on-site technical resources, also called resident customer engineers (CEs). CEs provide on-site support and work with the customer's IT team to meet agreed system availability and performance targets.

Please refer to https://www.hpe.com/psnow/doc/a50002850enw and https://www.hpe.com/psnow/doc/a50002922enw

HPE Lifecycle Services

HPE Lifecycle Services provide a variety of options to help maintain your HPE systems and solutions at all stages of the product lifecycle. A few popular examples include:

- Lifecycle Install and Startup Services: Various levels for physical installation and power on, remote access setup, installation and startup, and enhanced installation services with the operating system.

- HPE Firmware Update Analysis Service: Recommendations for firmware revision levels for selected HPE products, taking into account the relevant revision dependencies within your IT environment.

- HPE Firmware Update Implementation Service: Implementation of firmware updates for selected HPE server, storage, and solution products, taking into account the relevant revision dependencies within your IT environment.

- Implementation assistance services: Highly trained technical service specialists to assist you with a variety of activities, ranging from design, implementation, and platform deployment to consolidation, migration, project management, and onsite technical forums.

- HPE Service Credits: Access to prepaid services for flexibility to choose from a variety of specialized service activities, including assessments, performance maintenance reviews, firmware management, professional services, and operational best practices.

Notes: To review the list of Lifecycle Services available for your product go to:
https://www.hpe.com/services/lifecycle

For a list of the most frequently purchased services using service credits, see the HPE Service Credits Menu

HPE Education Services

Training and certification designed for IT and business professionals across all industries. Broad catalogue of course offerings to expand skills and proficiencies in topics ranging from cloud and cybersecurity to AI and DevOps. Create learning paths to expand proficiency in a specific subject. Schedule training in a way that works best for your business with flexible continuous learning options.

https://www.hpe.com/services/training

HPE Consulting Services

No matter where you are in your journey to hybrid cloud, experts can help you map out your next steps. From determining what workloads should live where, to handling governance and compliance, to managing costs, our experts can help you optimize your operations.

https://www.hpe.com/services/consulting

HPE Managed Services

HPE runs your IT operations, providing services that monitor, operate, and optimize your infrastructure and applications, delivered consistently and globally to give you unified control and let you focus on innovation.

HPE Managed Services | HPE

Emissions Classification (EMC) - Regulatory Information

To view the regulatory information for your product, view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products, available at the Hewlett Packard Enterprise Support Center:

http://www.hpe.com/support/Safety-Compliance-EnterpriseProducts

Environmentally Friendly Products and Approach End-of-life Management and Recycling

Hewlett Packard Enterprise offers end-of-life product return, trade-in, and recycling programs, in many geographic areas, for our products. Products returned to Hewlett Packard Enterprise will be recycled, recovered or disposed of in a responsible manner.

The European Union Waste Electrical and Electronic Equipment Directive [EU WEEE] (2002/95/EC) requires

manufacturers to provide treatment information for each product type for use by treatment facilities. This information (product disassembly instructions) is posted on the Hewlett Packard Enterprise website. These instructions may be used by recyclers and other WEEE treatment facilities as well as Hewlett Packard Enterprise OEM customers who integrate and re-sell Hewlett Packard Enterprise equipment.

Summary of Changes

Date	Version History	Action	Description of Change
20-Jul-2026	Version 5	Changed	Warranty and Services sections were restructured and standardized. Updated Product Warranty content for clarity and consistency, including revised support statements and terminology. Consolidated and refreshed HPE Services, HPE HPC&AI Custom Support Service, HPE Lifecycle Services, HPE Education Services, HPE Consulting Services, and HPE Managed Services sections with aligned messaging, updated descriptions, and current links. Removed legacy and redundant services content, including outdated operational services, regulatory, and environmental sections.
17-Nov-2025	Version 4	Changed	Document was modified to comply with HPE Rebranding strategy.
28-Jul-2025	Version 3	Changed	Models Section was updated
27-May-2025	Version 2	Changed	Overview section was updated. Added labeled photos and cleaned up content.
05-May-2025	Version 1	New	New QuickSpecs

		Have feedback on QuickSpecs? We're listening

		Chat now
		© Copyright 2026 Hewlett Packard Enterprise Development LP. The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein. a50009224enw - 17256 - Worldwide - V5 - 20-July-2026
		HEWLETT PACKARD ENTERPRISE HPE.com