No one can disagree with him here, but the actual question is: to what extent do we humans actually have an understanding of anything? We also function mostly by using simple heuristics and statistically likely correlations, not logical reasoning.
The appearance that existing AI has such an understanding is a mere superficial effect of it regurgitating statistically likely correlations in writing or images. This appearance is then exaggerated by social media and editorial curation surfacing the most noteworthy 0.001%.