It's easy to look at Google's success in terms of fortunate-monopoly, but you'd discount how fantastic they have been at retaining top talent. At any other company, Jeff Dean would have left long ago. From Day 1 Sergey and team not only innovated on product, but on talent retention (remember all the perks!) and it still resonates.
Sergey Brin on the genius of Jeff Dean.
He credits Jeff’s early obsession with neural networks, back when they were “telling cats from dogs”, as the spark for everything.
TPU was Jeff’s idea. He calculated that if users spoke to Google for just three minutes a day, Google would have to double its CPU data centers. Instead of buying more CPUs, Jeff decided to build a new chip for AI.
What’s fascinating is that when AI was not as big as today, when it can only “tell cats from dogs,” Larry and Sergey were like, “Cool, let’s make a custom chip for it.”
That’s a huge show of confidence in deep tech and top-tier technical talent. It makes Google the only AI company that has the top models, top chips, and top data centers.