1. Smart people are often, if not usually, very irrational. I grew up with a mid-140s-IQ-tested dad who believed in Biblical literalism. Intelligence is just a powerful engine, it says very little about your ability to steer.
2. Most prestige in our civilization is built around powerful engines. You get good test scores, pass hard classes, you are 'smart', and we stamp you with phDs and titles like Economist or whatever.
3. (Having well-rounded skills can help but does not save you. You can be a charming top-tier artist who still falls for a crypto scam).
4. Our civilization has very little explicit study into being *rational* - which is, imo, something like 'holding true beliefs'. You might be like 'well 'true' is relative', it's people just disagreeing about values all the way down - but I think this is wrong! There *is* such a thing as 'correct' - you can do things like cure cancer or lift people out of poverty, those are real things!
5. If we want to optimize for people steering in correct directions, we might do things like "have them make predictions about the way things will go, and then track how accurate they are." We might force them to "make beliefs pay rent", where you regularly put your beliefs into positions with high stakes so you can't just conveniently 'not notice' when you're wrong. There's a *ton* of stuff to do in this domain that is completely abandoned by people in academia (though you can find it in stuff like investment funds where they actually end up hurting if they're wrong).
5. When I say smart *and* rational, I mean people who are very good at steering in correct directions, with enough power to get there. I don't think most people in this culture even have a conception of these as meaningfully different!
If all the smartest most rational ppl got their own civilization on it would be LEAGUES better than this one, just more functional in ways we can't even imagine, and like 90% of it would be downstream of their ability to understand incentives and ripple effects