---
格式版本: 2
标题: "Hardware — NVIDIA DGX GB Rack Scale Systems User Guide"
原文链接: "https://docs.nvidia.com/dgx/dgxgb200-user-guide/hardware.html"
发布日期: "2026-05-29"
发现时间: "2026-05-29T10:47:54+08:00"
入库时间: "2026-05-29T02:53:33.815Z"
来源平台: "Tavily"
搜索渠道: "tavily_web"
搜索词: "Compute tray"
匹配关键词:
- "Compute tray"
- "NVIDIA"
- "Switch tray"
- "GPU"
- "Liquid Cooling"
- "NVL72"
相关厂家:
- "NVIDIA"
相关专家:
[]
内容类型: "网页"
抓取工具: "XCrawl Scrape"
清洗工具: "XCrawl Markdown + LLM 正文裁剪"
AI优质: "是"
AI打分: 93
AI分档: "高置信优质"
AI质检状态: "通过"
AI打分理由: "NVIDIA官方DGX GB200/GB300整机柜硬件指南，深度覆盖Compute/Switch Tray、NVLink互连、冷板液冷、Busbar供电及120kW功耗等核心架构与详细参数。技术细节极丰富，来源权威，结构完整，属超节点/…"
AI质检模型: "qwen3.6-plus"
AI质检时间: "2026-06-03T00:05:51+08:00"
AI主题相关性: 20
AI来源权威性: 15
AI新颖性: 18
AI技术细节: 20
AI商业部署信号: 10
AI完整性: 10
采集批次: "2026年5月29日10点47分48秒"
采集批次ID: "20260529-104748-298"
去重键: "https://docs.nvidia.com/dgx/dgxgb200-user-guide/hardware.html"
---
# Hardware DGX Grace Blackwell rack scale systems are rack scale solutions for graphics processing units (GPUs) connected by NVLink through the NVLink passive copper cable cartridge backplane. The complete DGX GB rack system comprises compute trays with one or two compute boards, NVLink switch trays, an NVLink passive copper cable backplane, power shelves, a bus bar, and liquid cooling manifolds.
## Rack Configuration
An NVL72 rack is an NVIDIA rack with 72-GPU NVL domains. Each NVL72 rack contains:
* 18x 1RU compute trays, each with 2 Grace CPUs and 4 Blackwell GPUs.
* 9x 1RU NVLink switch trays.
* 2x TOR Switches for management.
* Power shelves for supplying power to all trays and switches.
DGX GB200
DGX GB200 Rack Configuration - Front view of four 72-GPU racks
## DGX GB300
DGX GB200 Rack Configuration - Front view of four 72-GPU racks
The rear side of the system provides access to the cable management system, the inlets and outlets to the liquid cooling manifolds and the manifolds themselves, the cable cartridges, and the power bus bar.
DGX GB200
DGX GB200 Rack Configuration - Rear view
DGX GB300
DGX GB300 Rack Configuration - Rear view
## Compute Trays
The compute tray in a DGX GB rack system is an enclosure that holds the compute boards and peripheral accessory boards and runs an OS image. The compute trays are cooled by liquid that runs up and down the rack through manifolds, then through the cold plates that are attached to the CPUs and the GPUs in the tray. The rest of the components like networking and storage devices are air cooled, which is pushed through the system by the fans. The compute trays in a rack are interconnected via NVLink through the connectors at the back of the tray, which enables communication with the other compute trays via the NVSwitch trays.
DGX GB200
DGX GB200 Compute Tray
DGX GB300
DGX GB300 Compute Tray
The following table provides information about the DGX GB rack system compute tray configuration.
| Component | Function |
|---|---|
| **Compute** | Compute node \| 2x Grace™ CPUs and 4x Blackwell™ GPUs |
| **Networking** | Cluster network \| 4x NVIDIA ConnectX-7 single port 400G OSFP NIC
Storage/management network \| 2x NVIDIA BlueField-3 DPU, dual port 400G Infiniband or Ethernet
Out-of-band management network \| 1x 1GbE x RJ45 from the compute tray BMC module
2x 1GbE x RJ45 from the BlueField-3 BMC interface |
| **Storage** | Data cache \| 4x 3.84TB E1.S NVMe per compute tray with software RAID 0
Boot drive \| 1x 1.92TB M.2 NVMe |
DGX GB200
DGX GB200 Compute Tray - Block diagram
DGX GB300
DGX GB300 Compute Tray - Block diagram
Out-of-Band (OOB) management of the compute tray hardware resources is provided by a combination of Board Management Controller (BMC) and Host Management Controller (HMC) microcontrollers. External access is available through standard BMC and console interfaces. The figure below shows a top view of the DGX GB rack system compute tray and identifies the main components.
DGX GB200
DGX GB200 Compute Tray - Top view
DGX GB300
DGX GB300 Compute Tray - Top view
The figure below shows a front view of the DGX GB rack system compute tray and identifies the main components.
DGX GB200
DGX GB200 Compute Tray - Front view
DGX GB300
DGX GB300 Compute Tray - Front view
## NVLink Switch Trays
The NVLink switch system delivers an unprecedented 57.6 terabits per second (Tbps) of full duplex bandwidth for the fifth-generation NVLink in a 1U design. Each switch tray has 2x NVLink switches, and each switch tray has the following components:
* 2x NVLink NVSwitches, each of which has 72 NVLink ports
* NVOS 2.0 or later for NVLink switch life cycle provisioning and telemetry
* BMC for attestation and recovery
* FM and SM as the NVLink control planes that run on the switch tray
* CPU ERoT for security
DGX GB200
NVLink Switch Tray - Top view
DGX GB300
NVLink Switch Tray - Top view
## Power Shelves
The DGX GB rack system uses a bus bar structure to distribute power in the rack. Power whips energize power shelves from a remote power panel. The power shelves convert AC power into nominal 50V-51V DC output and distribute it through the bus bar to the rack components. Multiple power shelves are used in the rack to supply redundant power. The rack power consumption is approximately 120kW. The power shelf uses six air-cooled 5.5kW PSUs in eight power shelves that provide N+N redundancy and the required input power of 33kW per power shelf.
Power Shelf - Top view
## Top-of-Rack Ethernet Switches
Top-of-rack (TOR) switches are used to connect all BMCs in the compute trays (including BlueField-3 BMCs) and the switch trays to the management network. The following system and switch ports are connected to this switch:
* Out-of-band management BMC from the compute trays
* BlueField-3 BMCs from the compute trays
DGX GB200 TOR Ethernet Switch
## Console Access
Each NVLink switch provides an RJ45 interface for RS232 serial access. The default serial baud rate is 115200 baud.
## Leak Detection
Leak detection in the DGX GB rack system’s liquid cooling system prevents damage to equipment, ensures system reliability and uptime, protects data integrity, and maintains safety. Early detection helps avoid costly repairs, downtime, and regulatory compliance issues, optimizes the cooling efficiency, and prevents secondary damage to infrastructure.