As a PhD student, I worked on methods to generalize across motion, objects, lighting, backgrounds, etc. Each is hard, and thereās always a long tail. (E.g. my robot still canāt handle new camera viewsāhence the āDonāt move! Thx :)ā sign.)
But if you have enough data to train from scratch, many of these generalization problems start to disappear. You get them almost āfor free.ā
Whatās powerful is the clarity you get when you start from the goal, not from a favored method: data is a key bottleneck to remove on the path to physical AGI. And working backwards from first principles, there may be ways to solve the data problem that arenāt actually that expensive.
That unlocks the freedom to train from scratch with simple methods, not crutches.
goals are more powerful than methods