Artificial Intelligence, Physicalism, and Consciousness
AI is all over the news these days, but many people who are new to the topic are unfamiliar with the decades of discussions that have been had about the possibility of truly general AI, its relationship to human intelligence, and the nature of consciousness. Here, I'll try to summarize the most relevant scientific and philosophical considerations.
First, we will consider intelligence. This is about the ability of a system to perform a wide range of complex tasks, solve problems, build models of the world, etc. It does not relate to the internal conscious states of such a system, which we will address later.
One of the first people to seriously consider the possibility that digital computers could eventually have the same kind of intelligence as humans was Alan Turing. The argument is this:
1. All the known laws of physics are analytic. We don't need to get into exactly what this means, but it is a property shared by the equations of Newtonian physics, special and general relativity, and quantum mechanics.
2. Analytic functions can be modeled to arbitrary precision on a digital computer.
3. Human beings exist within physics.
Conclusion: all human behavior can in principle be modeled on a digital computer. Of course, actual implementations of AI are unlikely to be direct physical simulations of brains at the particle level, but this serves as an existence proof for the possibility of human-level AI.
How might these assumptions be violated, such that AGI is impossible? 2. is a straightforward fact of mathematics, so we will address 1. and 3.
For the assumption of analyticity (and thus, computer-modelability) in physics to be violated, whatever deeper paradigm of physics underlies and unifies quantum mechanics and general relativity must contain very mathematically strange behavior, AND this strange behavior must be relevant in the brain. Given that our particle colliders have verified the predictions of quantum field theory to an extreme degree of numerical precision, this is a high bar. It's not plausible that higher energy densities are at play inside our heads than are at play in the Large Hadron Collider, so the only alternative is extremely low temperatures. This is the premise of Roger Penrose's theory that so-called microtubules in the brain provide channels with the extremely low level of thermal disturbance necessary for these nuanced effects to play a role in cognition. This theory is very contentious, and has had to be revised several times as its predictions have been violated by experiments. The fact is that the brain is wet, warm, and noisy.
Suppose this theory or another theory relying on novel physics were true as an explanation of human intelligence. This would not rule out machine intelligence, it would only rule out machine intelligence implemented on digital computers. We could then focus our efforts on building devices that take advantage of the same exotic physical principles as the brain.
A violation of assumption 3. would be some kind of dualism or supernaturalism. The idea of an immaterial soul fits the bill. But of course, the belief that what human brains do is not reducible to physics is testable: we could, in principle, run a simulation of a human brain based on physical models, then look for deviations from predicted behavior in a real brain. For dualism to be true, the ectoplasm or soul or whatever must be pushing around particles such that the distribution of actual outcomes does not match the distribution of physically predicted outcomes. Otherwise, the soul isn't changing our behavior. Such a discovery would be a revolutionary scientific breakthrough, and I would be the first to want to explore its implications, but I'm not holding my breath. Physicalism (the belief that all outcomes in the universe are reducible to mathematical laws governing basic constituent elements) has an extremely strong track record, despite countless attempts to prove it wrong.
Thus, the case for the possibility of artificial intelligence looks quite solid. What about artificial consciousness?
The nature of consciousness is one of the most highly disputed topics in all of philosophy, religion, and science. It refers to the fact that it "feels like something to be you". The perception of redness, the smell of the ocean, the touch of clean sheets. Not the information gained from these sensory experiences, but the subjective experience of gaining that information. Assume an AGI with sensors could touch a sensor to a pillow and gain all the practical information you gain from such a contact. Would it, by doing so, be having a subjective experience of softness?
Philosophers have debated this endlessly, and seem no closer to a resolution. But modern technology may bring the question within the purview of science. As BCIs (brain-computer interfaces) become more sophisticated and more widely deployed, we may indeed have the opportunity to test this within ourselves. Imagine a brain chip that could replace the functionality of your brain with respect to one of your senses (for example, the sense of smell), without disturbing the rest of your cognition. You undergo a surgery to replace your inborn smell neurology with this chip. You could then smell something, and experience directly whether you feel the part of your cognition happening inside the chip, or whether it feels as if you sent off a request and received a verbal response like "this smells of roses". Assuming a positive result, assuming the computation happening inside the chip truly becomes part of your consciousness, you could then replace more functions one by one until you are fully artificial, stopping if at any point subjectivity doesn't carry over into the chip.
Artificial intelligence is one of the most fascinating developments in the history of humanity, and it is a joy to live in this time of unprecedented scientific progress.