Murata and Japan’s Hidden Electronic Infrastructure
[Part 1. Power Integrity: Why AI Servers Need More Small Capacitors, Closer to the Chip]
Full version:
open.substack.com/pub/superp…
The GPU is the chip that does the heavy calculations, but in an AI server the first thing you have to protect is stable voltage. As AI servers get bigger, the power network is no longer just wires. It becomes a system that absorbs sudden power shocks.
When the GPU suddenly pulls a lot of electricity, the system cares more about “keeping the voltage steady” than about raw calculation speed. This is what Power Integrity — power stability — is all about.
1. What matters is not average power, but how fast the power suddenly changes
In AI servers, the real problem is not “how much electricity is used on average.” It is how quickly and sharply the electricity demand changes.
When the GPU starts a big matrix calculation or accesses memory, it pulls a huge burst of current in a very short time. This sudden change causes the voltage to drop for a moment.
If the voltage drops too much, the GPU makes errors or slows down.That is why AI servers need more parts that keep the voltage steady around the GPU.
2. Decoupling capacitors are tiny “electricity reservoirs” right next to the GPU
The main power supply is far away and cannot react instantly when the GPU suddenly needs a lot of current. So engineers place small “electricity reservoirs” right next to the GPU. These are called decoupling capacitors.
When the GPU demands a sudden burst of power, the nearby capacitor quickly supplies electricity and prevents the voltage from dropping. The closer the capacitor is to the GPU, the more stable the voltage stays.
3. Why MLCC (multilayer ceramic capacitors) are so important
The most common capacitor used in AI servers is the MLCC.
It is important for three simple reasons:
It is very small → you can fit many of them on a crowded board
It reacts very fast → perfect for sudden power changes
You can place thousands of them around the GPU
Even though each MLCC is tiny, when you use many together they can quickly supply the electricity the GPU needs. Murata keeps making smaller and better MLCCs specifically for AI servers.
4. Capacitors are moving closer and closer to the GPU
In AI servers, the position of capacitors is changing.
They used to sit far away on the board → then closer to the GPU package → now even inside the package or embedded in the chip.
Why? Because power changes are happening faster and faster. If a capacitor is too far away, electricity takes time to travel and the voltage drops more. So engineers are moving capacitors as close as possible to the GPU.
Murata is also developing silicon capacitors for this exact purpose.
5. Power shocks are solved differently at different layers
Power problems in AI servers do not happen in only one place.
At the whole rack level → big energy storage devices are needed
Right next to the GPU chip → tiny MLCCs and other small capacitors do the job
For example, NVIDIA’s latest AI servers use large storage at the rack level, but still rely heavily on MLCCs right beside each GPU.
The upper layers use higher voltage to send power farther, while the lower layers (near the chip) focus on very low voltage, high current, and ultra-fast changes.
#Murata #MLCC #PowerIntegrity #AIInfrastructure #Decoupling #HiddenAIHardware