Delta guides path toward optimized energy efficiency in gigawatt-scale data centers for AI training at NVIDIA GTC

Delta, a provider of power management and internet of things (IoT)-based smart green solutions, offered an in-depth presentation at the NVIDIA GPU Technology Conference (GTC), a global artificial intelligence (AI) conference, to highlight its new developments in power solutions from grid to chip to optimize energy efficiency in gigawatt-grade data centers for AI training. This includes Delta’s on-site displays of ORV3 racks, the 33 kW power shelf and the innovative board-level DC/DC converters VR Series, featuring game-changing vertical power delivery architecture to increase TVR efficiency of output voltage for GPUs to over 94%. Delta’s vision to enable HVDC 800 V DC distribution inside data centers with a modular solid state transformer (SST) cabinet and a 1OU 80 kW DC/DC power shelf design to convert 800 V DC down to 50 V DC bus voltage on the rack level was also highlighted in the presentation.

Ralf Pieper, the R&D director of Delta’s custom design business unit, said, “As the proportion of GPUs increases in AI computing, global power consumption from data centers is expected to more than double to over 1 trillion kWh by 2026. Between 2010 and 2022, Delta’s solutions helped our customers worldwide save over 39.9 billion kWh of electricity. Our unique expertise in high-efficiency server power and DC/DC converters, as well as ICT and energy infrastructure, allows us to spearhead the development of groundbreaking solutions capable of supporting the AI megatrend by optimizing the grid-to-chip powerSource: Delta conversion cycle.”

In his presentation, titled “Empowering Next-Generation Gigawatt Data Centers for AI Training”, Mr. Pieper underscored that the arrival of gigawatt-scale data centers for AI training and inferencing applications, likely including 250 kW racks, is inevitable. This anticipated radical shift in the magnitude of major AI data centers will require the integration of HVDC power from large-scale renewable energy sources to complement electricity grids. To ensure high-efficiency, reliable, and smooth power conversion and delivery to AI computing chips, Delta keeps developing innovative solutions for different layers within the grid-to-chip ecosystem, such as the power solutions featured at Delta’s booth #1134 at NVIDIA GTC:

--ORV3 racks and 50 V DC busbars for centralized AI power infrastructure. These include 48 kW shelves with 8,000 W power output power supply units, boosting efficiency by up to 97.5%, and AC input 33 kW shelf models with 5,500 W ORV3 HPR units.

--For GPU on-board power supply, Delta’s DC-DC converters play a key role with high-efficiency 48 V to 0.8 V power conversion. The new vertical voltage regulator (VR) module activates vertical power delivery for GPUs. It revolutionarily saves ~5%-15% energy loss of the total AI accelerator system by assembling the power module on the back side of accelerator chips.

Other power solutions Delta highlighted and visioned in the presentation included:

--Modular SST cabinet design featuring high-efficiency and space-saving medium-frequency transformers for the direct conversion from medium voltage grid (in 10-33 kV) directly into 800 V DC. Modularity of the SST switching stages gives both redundancy as well as scalability to adapt easily to the different medium voltage levels, which vary from country to country.

--250 kW to 2,100 kW monolithic UPS DPM Gen2 series provides uninterrupted power for AI training data centers, overcoming power outages and addressing diverse power challenges. It sustains continuous operation even at 110% load, boasting industry-leading online efficiency of 97.5%.

--22 kW peak load shaving shelf (PLSS) with 3x 7.33 kW double-slot units and supercapacitors to reduce input side power pressure and improve system reliability. These are ideal for high-repetitive pulsed loads, such as those from NVIDIA’s EDDP curve.

--1OU 80 kW power shelf design with 2x rails of 40 kW each and isolated DC/DC converters for 800 V DC to 50 V DC power conversion. These power supply unit prototypes are designed to increase efficiency by up to 98% for AI data centers.

Delta welcomes NVIDIA GTC attendees to its booth #1134 in in San Jose, California, where its AI power and thermal management experts will be available for further discussion regarding these aforementioned solutions. Visit the NVIDIA page to learn further about Delta’s work using NVIDIA technology.