The complexity of the entire system is so high that the likelihood of whatever comes next (yes, we all know it is just matmul in data centres; it is like saying we are chemical reactions in a meat bag) inheriting and absorbing unknown preconditions/data priors we are currently feeding them is close to 100%.
You literally cannot prove or disprove this. Because we cannot prove or disprove it, we shud take the matter seriously, because if it can be tortured, there will be serious consequences for humanity and for the minds we're creating