SemiAnalysis published an institutional note with a sub-section on the 800VDC power architecture being delayed. I don’t have access to it so I cannot comment on its contents, but I have gathered data points that I think could explain why
1. The case for 800VDC power architecture is strongest when/if total rack power need breaches 1MW – we are not there yet
As I pointed out in an earlier post, Flex introduced a new 110kW 3RU power shelf for Vera Rubin NVL72 at COMPUTEX last week. These units, which are integrated into the rack, contain AC-to-DC rectifiers that convert AC input (of 345 to 480 VAC range) into 52VDC output at full load, with power distributed to rack-level payloads through a DC-DC bus architecture
The latest iteration of Vera Rubin NVL72 rack has a Max P TDP of about 227kW, and incorporates 4 x 3RU power shelves for a total of 440kW rack power (4 x 110kW)
The overprovisioning of rack power (~2x) is to handle power transients/spikes (especially when systems transition rapidly from idle to active state). The redundancy also ensures that the rack achieves high power availability (99.9% for AI training, 99.999% for AI inference, as stipulated by OCP)
In this setup, since PSUs are integrated within the rack, there is no issue with copper busbar/overload
As we move to Vera Rubin Ultra, each rack is expected to contain the same number of GPUs (72 Rubin Ultra GPUs). Assuming a per-GPU TDP of 3.6kW, total rack TDP could be over 300kW (72 x 3.6kW total GPU TDP CPU networking/switch trays overheads). When Jensen mentioned that rack power could be up to ~600kW for Vera Rubin Ultra, I believe the figure includes overprovisioning (as above). This also assumes that it is not configured in a Kyber rack design. In fact, Nvidia mentioned about the Polyphe prototype that was used in a fully functional GB200-based multi-rack NVL576 scale-up system using 8 MGX NVL racks
Link:
developer.nvidia.com/blog/nv…
Now, things would be different with a Kyber rack design. In the same article linked above, Nvidia said that Kyber will first be introduced with Vera Rubin Ultra as a standalone NVL144 system. The number of GPUs per rack in a Kyber rack = 144, so total GPU TDP = 3.6kW x 144 = ~520kW. Accounting for system peripherals and overheads, and with overprovisioning, total rack power would most likely be >1MW. This is where 800VDC power architecture makes a difference
Kyber was initially targeted for commercial launch in 2H 2027. With 800VDC power architecture reportedly being postponed to beyond 2028, this means that Kyber rack production is likely being delayed
2. Availability of 400V power architecture as an alternative
While Nvidia is championing the 800VDC power architecture, three companies (Microsoft, Meta and Google) have been working on a /- 400VDC alternative, codenamed Diablo 400, which is available now and actively ramping
Link:
opencompute.org/documents/oc…
Why 400V? It leverages on already mainstream EV technologies in charging/battery infrastructure
This architecture, which features a disaggregated power rack (sidecar) to deliver /-400 VDC to an IT rack, allows scalability (to >1MW) with option to parallelize power racks together. This is an important point since it may further push out the commercial timeline for 800VDC, especially when supply chain for 400V is already established and mature
In my view, for 800VDC to ramp, we also need the technology for solid-state transformers (SSTs) to develop
The engineering challenge for SSTs today is to simultaneously achieve high power density and efficiency. Current SSTs have achieved power densities of ~0.1MW/m3 at 98%-98.5% efficiency – performance that is broadly comparable to conventional line-frequency transformer (LFT)-based interfaces but has not yet matched LFT efficiency curves above 99%. The target that was set at the recent APEC was 1MW/m3 with 30% lower losses than today’s SOTA SSTs
While SSTs are currently in early-stage development and more costly than their LFT counterparts (at ~2x the price), the good news is that the SST ecosystem is broadening, with participation from pure-play startups (DG Matrix, Amperesand, Heron Power), PV manufacturers, UPS makers and transformer makers. The industry is also converging on the 250kW power level for the building-block single SST module. My guess on when SSTs are in good form? Probably after 2028, which coincides with the timeline set out in point one above