Interesting thread on convergence (or lack thereof) of neural solutions, with cool refs in the replies.
It seems a lot of studies focus on classification rather than control tasks, and oft simple input dynamics. I'm looking forward to seeing this further explored in the future.
Is there a name for the hypothesis that task-trained neural networks and biological brains develop similar representations when they perform well, despite differences in architecture and learning methods? I.e. that optimization (whether backprop or evolution) leads to a similar solution?
If not, I think we should call it The Tolstoy Hypothesis: "All well-functioning networks are alike; each poorly functioning network is poor in its own way."
🤓💅