1/6 Exciting new results from @IBMResearch demonstrate that for a 3-billion parameter LLM, a compact 2U research prototype system using the IBM AIU NorthPole inference chip delivers an astounding 28,356 tokens/sec of system throughput and sub-1ms/token (per-user) latency.
IBM's new AI chip, NorthPole, is a groundbreaking processor inspired by the human brain.
It excels in tasks like image recognition, surpassing other AI chips in speed and energy efficiency.
(Image credit: @rowancheung)
Microchip breakthrough may reshape the future of AI | IBM’s new NorthPole may enable smarter, more efficient, network-independent devices that may even help the U.S. win the microchip war against China. buff.ly/471hNgl by @deftechpat
IBM's brain-inspired chip, NorthPole, could be the fastest at running AI yet - and it is 25 times more energy efficient than commercial chips too newscientist.com/article/239…
Publishing this week in @ScienceMagazine, IBM Research's newest prototype AI chip, NorthPole, could help us move toward more energy-efficient AI. Learn more: ibm.co/3MdhHdl
In Science, researchers present NorthPole—a brain-inspired chip architecture that blends computation with memory to process data efficiently at low-energy costs.
Learn more: scim.ag/4wc