Vertical power delivery enables cutting-edge processing

By Ajith Jain, VP of WW Computing, Communication and Consumer BU

High-performance artificial intelligence (AI) processor power levels continue to rise and core voltages are declining with advanced process nodes. These developments are challenging power system designers with managing ever-rising power delivery network (PDN) impedance voltage drops, voltage gradients across high-current, low-voltage processor power pins, transient performance specifications and power loss.

Consider the case of clustered computing, where tightly packed arrays of processors boost the speed and performance of machine learning. PDN complexity rises significantly as current delivery must take place vertically from underneath the array. Designing a PDN using the Vicor Factorized Power Architecture (FPA™) with current multipliers at the point-of-load, instead of legacy voltage averaging techniques, allows a significant step up in performance. This is thanks to the qualities of point-of-load (PoL) power components: high current density, reduced component count and importantly, flexible placement. PoL power components thus enable the delivery of current laterally and/or vertically to AI processor core(s) and memory rails, significantly minimizing PDN impedances.

Modern-day GPUs have tens of billions of transistors. Better processor performance comes at the price of exponentially rising power demands. In most cases, power delivery is now the limiting factor in computing performance. Power delivery entails not just the distribution of power but also the efficiency, size, cost and thermal performance.

Peak current demands of up to 2,000A are now a typical requirement. In response, some xPU companies are evaluating multi-rail options where the main core power rails are split into five or more lower-current power inputs. The PDN for each of these rails must still deliver a high current while also undergoing individual tight regulation, which puts pressure on the density of the PDN and its physical location on the accelerator card.

To further add to this complexity, the highly dynamic nature of machine learning workloads result in high di/dt transients lasting several microseconds. These transients create stress across the PDN of a high-performance processor module or accelerator card.

The work by the Open Compute Project (OCP) consortium has helped establish a framework of standards for designing rack- and card-based processor developments. The Open Rack Standard V2.2 defines a 48V server backplane and a 48V operating voltage for open accelerator modules (OAMs) used predominately for AI and machine learning workloads. To maintain compatibility with legacy 12V systems, the standard stipulates the ability to meet 12-to-48V and 48-to-12V requirements.

The technical advances just highlighted focus on the downward trend of voltage scaling, the requirement for tight core voltage tolerance and the upward trend of current consumption. At the board level, the impact of these factors manifests in multiple ways.

The peak current densities encountered are extreme for any PCB. The task of routing power paths capable of handling these huge loads demands careful attention. Highly dynamic workloads can create spiking voltage transients, which sophisticated processors find disruptive and potentially damaging. Yet, a processor board has hundreds of other passive components, memory and other ICs essential to its operation that also need placement.

Then there are the I²R losses. Power path trace lengths must be short, so the power conversion modules should be close to the processor. The processor load currents and localized thermal gradients of the processor can also flex the PCB, forcing use of board stiffeners. Additionally, the converter’s power efficiency specification should be as high as possible to help mitigate thermal management challenges.

Factorized Power Architecture

New ideas, architectures, topologies and technologies provide a path to a more reliable, scalable PDN. The Vicor Factorized Power Architecture (FPA) is the foundation for delivering more efficient power for today’s unprecedented high-performance computing demands.

The Vicor FPA divides the task of a power converter into the dedicated functions of regulation and transformation. Separating the two functions allows both to be optimized individually to foster high efficiency and high density. FPA in conjunction with the Sine Amplitude Converter (SAC) topology underpins several innovative power architectures that can help unleash today’s high-performance processors.

Lateral power delivery is an innovative technique where the two current multipliers (Vicor VTM™ modules) flank the north and south side or the east and west side of the processor. This technique is preferable for load currents of ~800A at 0.8V nominal with an associated 70µΩ of PDN at 100°C. This architecture is excellent for powering graphics accelerator cards (OAM or otherwise), networking ASICs and APUs used in hyperscale data centers or supercomputer cabinets.

The Lateral-vertical power delivery technique resembles lateral power delivery but with this difference: Only 70% of the power is delivered laterally using the current multipliers that flank the sides of the processor. An additional current multiplier on the bottom side of the processor delivers the remaining 30% of the load current directly to the processor BGA. The hybrid of lateral and vertical reduces PDN loss by almost a factor of four! This technique also frees board space to accommodate a second high-current rail (aux) or HBM memory rails on the top side of the board around the processor.

Vertical-lateral power delivery, on the other hand, pushes >50% of the load current through additional current multipliers on the bottom side of the processor. This technique enables a further halving of PDN loss compared to the lateral-vertical approach. A 1,200A design can now realize a PDN resistance of a mere 10 µΩ, resulting in fewer than 14.4W of power loss. In this case, heat sinks can cool both the top and bottom sides of the load as space permits. This architecture is especially effective for applications that must accommodate high-speed signal routing from the periphery of the ASIC on the top side of the board and thus cannot afford to host power components there. Examples are CPO, NPO and networking / broadband communication devices.

Vertical power delivery is the ultimate way of delivering high current at low processor core voltages with the lowest PDN resistance. In this case, current multipliers and bypass capacitors are stacked on each other to form an integrated power module (geared current multiplier) that can mount directly underneath the processor by displacing the bypass capacitor bank. Vicor GCMs are custom-built devices that map the current multiplier pinouts to the AI processor BGA and in addition, can provide all the bypass capacitor needs within the module itself. This technique opens up the top floor of the PCB for high-speed signal routing from the periphery of the processor. Applications such as CPO (co-packaged optics, networking processors) and high-speed signaling ASICs can take advantage of this power delivery technique.

The Vicor architectures are flexible enough to be adapted in a wide variety of high-performance computing scenarios. Vicor architectures can reduce motherboard resistances up to 50x and processing power pin count more than 10x. Leveraging an FPA, Vicor minimizes the “last inch” resistances by combining lateral power delivery (LPD) and vertical power delivery (VPD). All enable processors to hit previously unattainable performance levels to support exponentially growing HPC processing demands.

The FPA architectures are unmatched in current density and in reducing power losses across the PDN. The propriety architectures, topologies and small module size are unique in the power industry. Next-generation processors will need power architectures able to adapt, scale and deliver high-density power. Robust, reliable power modules in conjunction with innovative topologies are essential in a dynamic systems where power requirements change rapidly. To meet that perpetual need demands innovation and the ability to adapt and scale for tomorrow using modular power.

Mr. Jain has served as our Vice President, High Performance Computing, since September 2011. Prior to joining the Corporation, Mr. Jain was employed by Semtech Corporation as their Director of marketing power business unit from 2009 to 2011. Mr. Jain served in various positions with National Semiconductor corp., a manufacturer of power converters, mixed signal and networking integrated circuits in different countries such as India, Hong Kong and most recently in the USA as Strategic Marketing for the power management group. Mr. Jain received a B.S.E.E. from the University of Karnataka, India and a business management degree from the Berkeley HAAS School of business CA USA.

VP of WW Computing, Communication and Consumer BU