Even if models never create new problem-solving methods, as they scale, they’ll get better at knowing when to apply what.
I expect they will create new methods, and discover methods for creating methods, etc. With enough training, they really could become universal.
I wonder if the models will only rediscover known problem-solving methods or create new ones.
When they learn to create new problem-solving methods to solve new problems, we can call them truly creative