The world’s top AI researchers are paid millions for their expertise—but how much do individual breakthroughs really drive AI progress, compared to simply building bigger datacenters?
Our new paper, On the Origins of Algorithmic Progress in AI, suggests the literature overestimates algorithms and underestimates compute.
Deep dive via our substack:
substack.com/home/post/p-181…#AIResearch#ComputeScaling#AlgorithmicProgress
4/ 📈 Current trends suggest we could see 5 orders of magnitude improvement in algorithmic efficiency within a year. That’s like going from a preschooler to a smart high schooler in terms of capability! #AlgorithmicProgress