AGI will never be able to have human level intelligence, NEVER, and it’s not a resource problem, it’s a fundamental design FLAW, if you don’t believe me, i’ll prove it to you now.
AI is not magic, we manage to brute force patterns in our language(s) that we are unable to formalize into a bunch weights using transformers. think about it like that: formalize the logic of languages is too hard for us, so we took as much examples as we could and we forced out the right “equation” from it.
llms are nothing more than that, hidden language logic encoded in a long list of numbers. period.
there is something llms will never be able to do tho, not if they’re built like this, and this is the fundamental difference between human intelligence and llms intelligence. models have nothing else to interpret context other then the text itself, humans on the other hand have something fundamentally different, our context interpretation, even if you don’t realize it, is deeply grounded in MUCH MORE different information.
every word is attached to a HUGE hidden substrate of emotions, touch, vision, memories, pain, pleasure, fear, body state, goals and every other thing that is deeply connected with our biological body and NOT ENCODED into text that models just doesn’t have.
take this sentence for example:
“the cup fell off the table”
when you read it you do not just process the words “the”, “cup”, “fell” and so on, but in your head you implicitly simulate gravity, objects, surfaces, breakability, sound, surprise, maybe a hand reaching out, maybe annoyance.
All data that is not in the sentence. it is supplied by your embodied world model
that’s why language is compressed. humans can say very little because the listener fills in a lot from shared reality.
this is one reason why llms writing can feel subtly off, it knows the phrase and the context where the phrase appears, but it may not have the same grounded constraint behind it. it can say “this design feels heavy” but it does not feel weight, effort, fatigue, or manipulation resistance. it can model the linguistic pattern of that judgment, but the judgment is not anchored in the same sensorimotor reality
this is why we all fell that way ”AI has no taste”, because “taste” as we intended is EXACTLY THIS! it information encoded in embodied experiences that is not present into text.