Advantech Enhances Generative AI, Accelerating Deployment of LLM and Optimizing Machine Vision for Improved Efficiency with NVIDIA H200 NVL

December 11, 2024, Taipei, Taiwan - Advantech, a leading global provider of industrial edge AI solutions, is excited to introduce its GPU server SKY-602E3 equipped with the NVIDIA H200 NVL platform. This powerful combination is set to accelerate the offline LLM for manufacturing, providing unprecedented levels of performance and efficiency. The NVIDIA H200 NVL, requiring 600W passive cooling, is fully supported by the compact and efficient SKY-602E3 GPU server, making it an ideal solution for demanding edge AI applications.

The SKY-602E3 GPU server excels in supporting large language models (LLMs) for AI inference and training. It features four PCIe 5.0 x16 slots, delivering high bandwidth for intensive tasks, and four PCIe 5.0 x8 slots, providing enhanced flexibility for GPU and frame grabber card expansion. The half-width design of the SKY-602E3 makes it an excellent choice for workstation environments. Additionally, the server can be equipped with the NVIDIA H200 NVL platform, which offers 1.7x more performance than the NVIDIA H100 NVL, freeing up additional PCIe slots for other expansion needs. With improved GPU performance and efficient internal space utilization, the SKY-602E3 is ideal for advancing AI machine vision applications and other compute-intensive tasks. NVIDIA H200 NVL is ideal for lower-power, air-cooled enterprise rack designs that require flexible configurations, delivering acceleration for every AI and HPC workload regardless of size. With up to four GPUs connected by NVIDIA NVLink and a 1.5x memory increase, LLM inference can be accelerated up to 1.7x and HPC applications achieve up to 1.3x more performance than with the NVIDIA H100 NVL.

To address the demanding requirements of industrial environments, the SKY-602E3 incorporates robust, industrial-grade features. Its magnetic front panel enables true tool-free access, significantly simplifying maintenance compared with traditional designs that require tools or hand-operated mechanisms. The server also supports replaceable smart fans, allowing users to customize cooling solutions based on specific application scenarios for optimized performance. Furthermore, the front panel includes an integrated dust filter to help ensure reliable operation in harsh industrial environments where contaminants like dust and debris are common.

A leader in industrial computing and an member of the NVIDIA Partner Network, Advantech is working with NVIDIA to deliver comprehensive edge AI solutions, offering a full range of AI IPC and AI server solutions. The SKY-602E3, powered by the NVIDIA H200 NVL, is now available for order. For detailed product specifications and solution information, visit the Advantech website.