Accelerating AI Innovation: New Servers and Integrated Rack Solutions for the Future

On the heels of exciting announcements at AMD's Advancing AI Dayand OCP Global Summit 2024, Dell Technology continues its momentum at SC24 by announcing additional servers and integrated rack solutions that represent the latest additions to the Dell AI Factory infrastructure portfolio. This new infrastructure enables customers to accelerate time to value of their AI efforts and improves energy efficiency in support of sustainability goals.

Two new Dell PowerEdge servers, XE7740 and XE9685L, will be offered in the new Dell Integrated Rack 5000 (IR5000) seriesas a part of the Dell Integrated Rack Scalable Systems (IRSS) program, offering air and liquid cooled, energy-efficient AI infrastructure with flexibility, scalability, and improved performance. Dell is also first to announce support for the cutting-edge NVIDIA GB200 NVL4 architecture, which will be delivered in the Dell Integrated Rack 7000 series.

Additional details about these new products:

The 4U air-cooled Dell PowerEdge XE7740uses dual Intel® Xeon® 6 processors with P-cores and up to 8 double-wide accelerators, including Intel Gaudi® 3 PCIe accelerators or NVIDIA H200 NVL Tensor Core GPUs, or up to 16 single-wide accelerators, such as the NVIDIA L4. This flexibility allows enterprises to right-size their server configuration for the workload at hand, from fine-tuning or inferencing generative AI models, to extracting value from large datasets.  

• Enhanced performance - supports up to 16 GPUs and 2 CPUs with up to 384 CPU cores making it ideal for tasks that require intensive computation, like AI inferencing and fine-tuning.
• The PowerEdge XE7740 adds support for up to 8x Intel Gaudi 3 PCIe accelerators and Intel® Xeon® 6 processors with P-cores.
• Efficient cooling - air-cooled 4U chassis ensures efficient heat management even when using high-performance 600W GPUs without the need for complex cooling systems.
• Easy deployment - easily deploy this air-cooled system in existing datacenters to quickly leverage its capabilities, minimizing downtime and disruption accelerating time to value.
• Tailored systems - match specific workload requirements and right-size your configuration for your evolving workflows with ease.

The PowerEdge XE9685Lis a direct liquid cooled ultra dense 4U from factor driving 3x higher LLM training performance, designed to elevate enterprises engaged in AI, machine learning, and data-intensive operations. It integrates dual 5th Generation AMD EPYC™ 9005 series processors with NVIDIA H200 or B200 Tensor Core GPUs to deliver exceptional performance and customization for advanced workloads.

• Maximum GPU Density - Support up to 96 GPUs per rack using 8 NVIDIA® Tensor Core H200 or B200 GPUs in a 4U form factor. Consolidate your computing power and accelerate performance, all in a single server.
• High Performance Networking with flexible expansion - Featuring 12 front serviceable PCIe Gen 5.0 slots for superior internal and external data communication while reducing maintenance time.
• Efficient Cooling - Maintain optimal performance with our advanced dual DLC Manifolds delivering exceptional efficiency, serviceability, and reliability.

Dell is the first to announce support for the upcoming NVIDIA GB200 NVL4server architecture with an upcoming Dell PowerEdge server designed for the Dell IR7000 series integrated racks. Designed as a 1OU (21" sled), it will install seamlessly into the IR7000 rack announced earlier this year at OCP 2024.

• First-to-Market Innovation: Dell is the first to announce support for the cutting-edge sled using Nvidia GB200 NVL4 technology.
• Efficient Thermal Management: The IR7000 rack is engineered to capture up to 100% of heat generated by these sleds, promoting efficient computing practices.
• Comprehensive Lifecycle Services: The platform includes full lifecycle services, accelerating time to value while simplifying AI integration.
• Enhanced Workload Support: The architecture is designed to efficiently handle both HPC and AI workloads, maximizing performance and scalability.

With today's announcement, we now round out our integrated rack portfolio with the Integrated Rack 5000 (IR5000) series,adding an air or direct liquid cooled, EIA standard 19" rack to the IRSS program, enabling Dell to offer the XE9680L, XE9685L, XE7740, and XE7745 at rack-scale. These IR5000 series configurations offer the highest GPU density available for standard racks, providing greater performance in the same amount of space.

• Silicon diverse - Increasing demand for GPUs to power AI and highly dense compute is reducing availability and thus driving a growing need for silicon options. Silicon diversity also supports an open ecosystem for AI, giving customers a choice of processors and accelerators from Intel, AMD and NVIDIA.
• High Density - Up to 72 GPUs per rack for air cooled environments or 96 GPUs per rack for liquid cooled or hybrid cooled datacenters
• Energy efficient - Smart cooling technology provides customer options for either air-cooled, liquid-cooled, or hybrid environments.

Dell has offered customized rack-scale services and integrated racks to customers for more than 15 years. With these new announcements, Dell Technologies now offers customers interested in quickly deploying AI infrastructure with their choice of rack style, cooling for thermal management, networking options and a diverse selection of silicon options in a comprehensive integrated rack portfolio.

Dell Integrated Rack Scalable Solutions (IRSS) are designed for rack-scale AI and HPC deployments, maximizing space, energy efficiency, and reducing costs. IRSS systems are delivered as fully built and tested sets of racks, allowing for deployment in days rather than weeks, with a 3x reduction in time to build, deliver, and deploy. IRSS solutions undergo comprehensive QA testing at the factory and deployment to ensure quality and include multiple choices for networking. IRSS solutions empower businesses to scale seamlessly, making them an attractive option for organizations looking to simplify and accelerate their AI infrastructure deployments.

The Dell PowerEdge XE7740 will be available in the first half of calendar year 2025. The Dell PowerEdge XE9685L and Integrated Rack Scalable Systems program will be available in Q1 of calendar year 2025.

Explore the Dell IRSS websiteto learn more.