I'm not sure this lands.
Take chess to see what it looks like at the limit. There is no skill in being an Engine Operator. Humans don't add to the engine by knowing how to turn it on just right. You run Stockfish and humans cannot even contribute.
Skill development changes you in concrete ways. A skilled chess player sees the board fundamentally differently, and better, than an unskilled one, memorizing positions in the blink of an eye, noticing patterns, spotting tactics. Yes, humans are obsoleted by machines there. But that does not make you equal to Magnus Carlsen.
So – school. Maybe we just want it all to be trade school, where the goal is to maximize earnings, and so humans should abandon every intellectual task obsoleted by AI. Maybe. And on that trajectory, perhaps we can abandon every intellectual task, full stop, because the train shows no signs of slowing down, and we're all about to be left behind.
Do we want to be slaves to minds greater than our own, masquerading as their masters because we know how to turn them on? Do we want to stop creating Terence Taos because Codex out-calculates us? Do we want every classroom to maximize the skill of flipping switches, accepting our own obsolescence by becoming eternal adolescents?
I do not. Skill-building matters as a good in itself. Training your mind matters. Becoming better and more knowledgeable, in concrete ways and in narrow topics, climbing skill pyramids ourselves rather than abandoning every intellectual skill, matters.
And any skill that is worth training, any subject that is worth learning, is worth training and learning right: in a way that actually improves the individual.
AI is not going away. But I'm not ready for human skill building to go away either. There are more chess classes worth preserving than "how to download Stockfish."
.
@tylercowen has the best take I've seen on AI and education: