Wednesday, November 15, 2017

IIT and Blade Runner 2049

Blade Runner 2049 is probably the best movie I've ever seen in a theater - definitely the best sci fi movie I've seen. The movie is a detective story about a replicant - an artificial human - who uncovers a mystery that has personal implications for himself, and broader implications for the dystopia that he lives in.

Are replicants conscious? It's hard to argue that they wouldn't be, and the movie doesn't seem to suggest they aren't. Instead, the movie focuses on memory and how your memories make you real or not - if your memories are false, you are a kind of false person in the world of 2049, and this is how people in the movie justify their enslavement of the replicants. The main theme of the movie is memory - are my memories real? If they're real, are they really mine, or someone else's? Does it really matter?

That stuff is all interesting, but like I said, consciousness is not the question with the replicants. It is the core question regarding one of the main characters: Joi the holographic girlfriend. We can speculate now on whether or not Joi is conscious. The movie is ambiguous about this, but there seems to be a subtext that she is not conscious, but that the main character (K), and we the audience, are supposed to believe that she is. And while there is this ambiguity, the resolution of the ambiguity is deeply meaningful to the story (just like the original Blade Runner, such a significant ambiguity is left unresolved).

First, to be clear on IIT terms: replicants are conscious because they are basically humans with human brains (and humans are clearly conscious) - what makes replicants different is that they are constructed as adults, with memories implanted (or not) to give them a more natural psychology. In the original Blade Runner, replicants like Roy Batty were assumed by their masters to be essentially psychopathic by nature, and the subsequent implantation of false memories was instituted to make them more psychologically healthy. But for a 'system in a state', the truth or falsity of memory is an extrinsic fact - from the IIT point of view (and probably any other modern theory of consciousness, or of the brain) it doesn't matter for the system itself. So replicants are conscious.

Joi, on the other hand, is not a human with a human brain. She's a holographic projection generated by a computer. The hologram of course is nothing but an image; what matters is in the computer. Computers as we know them cannot be conscious in any meaningful sense: the system is a very small set of very very fast switches, entirely feedforward at the most complex, finest grain, and extremely simple at coarser grains where we might see something like feedback or lateral connections. If computers in 2049 are like computers we know, Joi is not conscious - but computers might be very different. Joi has some kind of dedicated local unit, mounted on the wall in K's apartment - perhaps the computer in that unit is a neuromorphic system that replicates the connectivity structure of a human brain. But the picture of technology in the movie doesn't suggest this level of sophistication - I think that if we want to argue that Joi is conscious (in order to counter-argue) we need to weaken some assumptions.

Maybe Joi is conscious, but her consciousness is absolutely different from a human consciousness. That still requires some kind of neuromorphic computer, but it doesn't have to reflect the structure of the human brain, but there's a problem there that boils down to unreliability: if you want a simulation of a human being, you probably want something that's utterly controllable, like a performance - and where it's uncontrollable, it should still fulfill the simulation's desiderata. But consciousness is exactly uncontrollable - it's a closed locus of causal power (according to IIT) - so if your machine is conscious and you want it to simulate a human being, then its consciousness ought to resemble a human consciousness. Joi seems to do a very lifelike impression of a human being, so we have two choices - either she is conscious and her consciousness is specified by a neuromorphic computer that reproduces human neural connectivity, or she is an unconscious simulation.

As I said above, an artificial human brain (in the sense of an electronic device) seems beyond the technology of 2049; but even if it is in reach, it is hard to reconcile with the way Joi is quickly cut and copied over to her mobile emitter. First, it would mean that not only are there artificial human brains in 2049, but they are tiny enough to fit in the palm of your hand; second, it would mean that this brain can be constructed (or connected) in seconds, since remember that according to IIT it is a causally-interacting physical substrate that specifies consciousness - a computer program stored in memory is not causally-interacting in any important sense. I just don't think either of these is plausible in context.

So that leaves us with Joi the unconscious, but highly convincing, holographic girlfriend. Seeing Joi this way is easy when she first appears in the movie, but rather quickly it becomes clear that she is a dramatic and interesting character. Just like any other character in a movie or a play, it is then very difficult to imagine that she is not conscious. We know that the actor playing her is conscious, which makes it even more difficult. But if we try, we can see her as an entirely mechanical projection, like Siri or a chatbot, something that emulates humanity down to little details like evincing emotions like love and hope and excitement, and insistence on her own choices. But evincing emotion is not the same as feeling emotion - while there was an actor (Ana de Armas) that performed the character, there is nothing there on the screen while we watch the movie, and whether or not the actor was ever even real (or whether the performance is entirely artificial) doesn't matter to the fact that the performance on the screen is just a mechanical, unconscious projection. K the Blade Runner is in a similar situation: Joi is convincing, and maybe K himself cannot recognize that she is not intrinsically real, but she is nonetheless unreal.

This seems to me to contribute important meaning to the story, and it does resonate with some clues that are given out bit-by-bit, i.e. it seems the filmmakers probably also thought that Joi is not really real (not conscious). We see ads in the background of 2049 LA for Joi, touting that she is everything you want, and this is exactly what K seems to get. And K, who seems to despair at losing her (and losing other things), seems to recognize this (or remember it) when one of those ads reaches out to him and calls him by the same name that 'his' Joi had given to him. His copy of Joi wasn't even customized (it had all the 'factory settings'), i.e. not only is she unreal, she isn't even unique. So as a conscious being himself, K really is alone - his only companion is just a performance without an actor.

I think that, then, we're left with a hard question that aligns with the main theme of the story, which is (as I understood it) does it matter if my memories are mine, or if they are real? If none of my memories are real, am I real, do I matter? That theme gets a resolution: it is clear that K is real, he matters in important ways, and that his memories, real or not, nevertheless guide him significantly. The hard question is: does it matter if you are real? I mean that from the first person: I know I am real, but are you? Does it matter if you are or not, at least, does it matter to me? Well.. in a sense it is the same problem as the main theme - you are something I perceive, just as you might be something I remember. What matters, we might like to think, is whether or not I am real, whether or not I make my own choices of significance - and as pertains to you, whether or not you (real or not) have a significant role in my reality.

And, I think, K is left in a similar place with both versions of this problem; Joi had an effect on him, it seems clear to me, encouraging him and helping to destabilize him towards his ultimate fate, just as his memories did. But whereas (his) Joi is destroyed and lost to him, his memories - "all the best ones", at least - survive even when he dies, because they also belong to others. This happens to be an inversion of Roy Batty's famous observation that his memories will be lost with him.

Ok, enough!

No comments:

Post a Comment