• Email
  • Single Page
  • Print

Consciousness: What We Still Don’t Know

Imagine that you wake from a dreamless sleep in a completely dark, soundless room. Imagine that you are fully awake and fully alert. You can be fully conscious, with many fantasies and thoughts, and yet have absolutely minimal perceptual inputs. You feel the pressure of your body against the bed and the weight of the covers but they do not constitute your entire conscious experience—the conscious field as I have called it. They are minor parts of it. Now suppose you get up, turn on the lights, and have a bath. Are you creating consciousness? Well in one sense you are, because you now have conscious experiences you did not have before. But it is best to think of these as modifications of the preexisting conscious field, because the field was there before you had the perceptions. You had to be already conscious before you had the perceptual experience and we still need to know how you got to be conscious in the first place.

Koch is aware of this problem, but I do not think he deals with it adequately. He points out that in addi-tion to the NCC we also need certain enabling conditions, which he calls the NCCe. These would include such things as a certain blood flow and a certain temperature. The NCCe is a necessary condition for the functioning of the NCC, because without it, the NCC cannot produce a conscious state. The notion of the NCC then is “the notion of a minimal set of neural events that are jointly sufficient for conscious experience, given the appropriate enabling conditions.” But the problem is that he does not consider the possibility that the existence of the unified conscious field may be an “enabling condition” for the various building blocks that he studies.

The building-block approach seems unconvincing because it would, for example, predict that if a person was otherwise totally unconscious, we could introduce the NCC for a particular percept, say the color red, and then the person would have a sudden flash of red and then lapse back into unconsciousness. From what little I know, it does not seem to me that the brain works that way. In my view we will not understand consciousness until we understand how the brain creates the conscious field to begin with. We need to remind ourselves of such humble facts as that the alarm clock does not just make us perceive a sound. It wakes us up. That is, it sets off neuronal processes that cause a unified conscious field. However, I want to emphasize that this is a factual question not to be settled by philosophical argument but by further research. If I am right, research is going to be much more difficult than adherents of the building-block approach suppose because it will not be enough to find the NCC for an experience that occurs in a subject who is already conscious anyway.


The chief merit of Koch’s book is that he provides an account of the latest research in neuroscience. Among his many findings, I can mention here only a few that seem worth particular attention.

Vision. The neurobiological heart of the book is the account of vision. Koch traces the visual stimulus from the impact on the retina to the points in the brain, especially the inferior temporal cortex, where he hopes the NCC can be located. His book is much more detailed than the standard textbook accounts I am familiar with. One controversial idea that he and Francis Crick put forward is that the primary visual cortex does “not directly contribute to the content of visual consciousness.” Wherever we find the NCC for visual experience it will not be in V1, nor does V1 communicate with the front part of the cortex where apparently we do find the NCC. Among various arguments Koch offers to show that V1 contributes only indirectly to the visual experience is that V1 is inactive during visual dreams.

Koch also offers a fascinating account of color constancy, elaborating the findings of Semir Zeki of the Department of Anatomy at University College, London. Color constancy is exhibited, for example, by the fact that an apple looks to be the same color under different lighting conditions, all the way from moonlight to electric lamps, even though the reflections of light from the apple are quite different. He suggests that there are cells that “represent color, instead of raw wavelength.” And they do this by responding to the middle wavelength region, relative to the surrounding neighborhood, rather than to the entire distribution of stimuli.

Koch also offers an explanation of the waterfall illusion. If you stare at a waterfall long enough and then look to the side, the trees and the ground appear to move upward. What is the explanation? Cells that represent downward direction get weaker because of prolonged stimulation, but the cells representing upward motion do not, so to speak, get as tired because they are not stimulated. The illusion of upward motion results from the competitive interaction of the two pools of neurons with the upward pool winning out over the now weaker downward pool.

He also explores the idea that perception of motion might happen by way of a series of discrete visual experiences rather than a continuous flow. According to this view we do not really see the movement of an object, but rather have a series of discrete visual images that give the illusion of motion, just as a movie gives us the illusion of motion even when all that appears on the screen is a rapid series of still pictures. I am not sure this makes sense. We understand how a movie works. The screen contains an objective series of separate images. These change so fast that we have an illusion, a subjective experience of continuous motion. But how is the perception of motion supposed to work if both the sequence of discrete images and the continuous motion are subjectively experienced? I can’t identify the sequence of discrete elements when neither the objectively moving object nor the conscious continuous flow exists as a series of discrete elements.2

Split brains. In treating some patients with an extreme form of epilepsy surgeons cut the corpus callosum, the body of tissue that connects the two halves of the brain. This cured the epilepsy but the patients then behaved as if they had two conscious minds, one in each hemisphere. According to Koch’s interpretation, both halves of the brain are conscious, but they communicate only imperfectly. In one experiment, for example, if you show a spoon to a part of the visual system that connects to the right brain but not to the left, and you ask the patient “What do you see?,” the patient, who has the capacity to use language in his left brain, says, “I don’t see anything.” But he then reaches out with his left hand, which is controlled by his right brain, and grabs the spoon. It is as if there were two conscious people in his head, only one of whom can speak. This is why the split-brain patients may seem normal. The left brain, which does the talking, says that they feel just fine.

According to Koch, both halves of the brain are conscious and, by the way, both show binocular rivalry. I am a little surprised that he is confident that both halves are conscious. I once asked Michael Gazzaniga, the chief researcher in this field, if he thought they were both conscious and he said he could not tell because he could not think of an experimental way to resolve the question.

Memory. Most of us are comfortable with the idea that we need to distinguish between long-term and short-term memory, but within each type of memory we need several subcategories and, in fact, memory is the name for a large number of different processes. Within long-term memory we need to distinguish several different kinds. There is the procedural memory of skills such as riding a bicycle, and there are declarative memories, which include both episodic memories, such as remembering the picnic we went on yesterday, and semantic memories, such as remembering the date of the Battle of Waterloo. We need further to distinguish these from associative conditioning, in which the brain responds to a stimulus in a way determined by previous experiences. For example, when a friend of mine approaches his front door, his brain causes him to reach for his key, as he has done for years, even though the door is now opened by entering a code. Larry Squire found that if a heard tone is combined with a puff of air to the eye, after a hundred of such pairings, subjects blink when they hear the tone (rather like Pavlov’s dogs, who salivated when they heard the bell that they, by being habituated, associated with food). There are also nonassociative forms of memory. For example, people can have an after-image of a visual stimulus, even though they were not conscious of the stimulus. You can have a visual memory image of an object you have not consciously seen.

Short-term memory is the catch-all term for storage of information during as much as tens of seconds. Within short-term memory we need to distinguish between working memory, as for example when, after you have looked up a phone number, you remember it long enough to dial it, and iconic memory, which is the immediate sense of the continuity of any experience—for example, dialing the number and holding on for a response. Iconic memory seems to be essential for consciousness in a way that declarative memory and working memory are not. (That is, your capacities for short-term working and declarative memory may be impaired but you may still be conscious.)

Zombie agents. Philosophers have invented the idea of a “zombie” to describe something that behaves exactly as if it were conscious but is not. Koch uses the notion of “zombie agents” to describe the sensory motor systems that carry out certain kinds of specialized behavior in a nonconscious fashion. Many of the mental processes going on inside a conscious subject, according to Koch, are entirely nonconscious. These include not only such reflexes as blinking, but more complex forms of behavior such as eye movements when tracking a moving ob-ject and the mechanisms that control head, limb, and body posture when people are walking, running, cycling, etc. Koch cites the work of A. David Milner and Melvin Goodale, according to whom the brain uses two dis-tinct processing strategies for vision. Vision used for action, according to them, is nonconscious. Vision used for perception—for example, seeing a vase full of flowers—is conscious, and these differences correspond to two distinct pathways in the brain; the ventral pathway is conscious, the dorsal nonconscious.

Nonconscious mechanisms function to deal with stereotypical forms of behavior, where it would be inefficient to bring the behavior to consciousness. Consciousness, on the other hand, deals with situations that require a novel and nonstereotypical response.

Consciousness and time. Unconscious zombie agents are needed because they are fast, and lots of conscious processes are slow. For example it takes about a quarter of a second to see anything. The brain plays many tricks with time that we still do not fully understand. Many of them are discussed in a recent book by the neurobiologist Benjamin Libet.3 Here are some famous cases: The Olympic runner starts running before he can have heard the sound of the starting gun. The processes that produce the conscious sound are slower than the zombie mechanisms that produce the starting movement. The same considerations apply to the championship tennis player who has to start his return swing before he can have consciously seen the oncoming serve, and the baseball batter who must begin swinging toward the oncoming ball before his brain consciously registers it.

In perception there is a necessary period during which different perceptions are integrated. For example, in one experiment a small red disk is shown for ten milliseconds followed by a green disk at the same location for ten milliseconds. The subject does not see a red light turn into a green one, but a single yellow flash. A similar illusion occurs with hearing. If a click is delivered to the left ear, and a few hundred microseconds later a second click is given to the right ear, you hear a single tone originating somewhere inside the skull toward the left ear. The temporal order of the stimuli gets transformed in conscious perception.


I admire Koch’s book enormously. But I think his overall conception of consciousness and how it fits in with the rest of the world is flawed. Fortunately I don’t think the weaknesses of the overall picture are fatal or even damaging to his detailed scientific work; but if I am right, they will have to be corrected in an accurate account of the relations of consciousness to the brain. Here are some of the difficulties that should be faced.

Koch thinks we have consciousness only of things at a middle level between the external world and our inner thought processes. Thus, according to him, we never perceive objects in the real world, not even our own bodies. For example, you never see the chair in front of you, but only a mental representation of the chair in your brain. Not only do we fail to perceive the real, external world, but even the internal world of our thoughts and concepts is forever hidden from us. Consciousness for Koch and Crick exists at an intermediate level between the inner world of thoughts and feelings and the external world of material objects, both of which are wholly inaccessible to us. Furthermore, we are conscious of things only at the sen-sory level, where we are conscious of sensory experiences, and sensory images, including inner speech. Koch also postulates an unconscious homunculus who sits at the front of our brains and makes our decisions based on information coming in from the sensory areas at the back of the brain. If these views sound extreme, here are some passages from his own summary. The intermediate-level theory of consciousness, he tells us,

postulates that the inner world of thoughts and concepts is forever hidden from consciousness, as is the external, physical world, including the body.

One consequence of this hypothesis is that many aspects of high-level cognition, such as decision-making, planning, and creativity, are beyond the pale of awareness. These operations are carried out by the nonconscious homunculus residing in the front of the forebrain, receiving information from the sensory regions in the back, and relaying its output to the motor system.

A further consequence is that you are not directly conscious of your thoughts. You are conscious only of a re-representation of these in terms of sensory qualities, particularly visual imagery, and inner speech.

I believe that all of this is mistaken, but here are only four of many objections.

  1. The theory that we can never perceive the real world but only our inner pictures of it is the single most disastrous view in the past four centuries of epistemology. The arguments for it (Koch gives none, by the way) are invariably bad and the consequences are worse. This theory makes it impossible to have a public language or publicly verifiable knowledge. All we can ever talk about is our own solipsistic mental pictures. Historically this view leads from Descartes to Berkeley and then to Kant and eventually to Hegel. It is a road down which no sane person should wish to go. Koch’s own version is based on a confusion between perceptual content and perceptual object. Thus when he sees his son’s face (his example), he has a visual experience, but the object he sees is not, as Koch claims, the experience. Rather he sees his son. He thinks, mistakenly, that he can never see the object, his son, but only the content, his experience.

The failure to make the distinction between content and object is part of his general failure to understand intentionality—the fundamental requirement that consciousness be about something—and this in turn leads him to a mistaken account of qualia. He thinks the function of qualia, such as the experience of his son’s face, is to symbolize a vast repository of tacit and unarticulated data. Some qualia do that—think of Proust and the taste of the madeleine—but the primary function of garden-variety, perceptual qualia is to give us direct information about the real world. When he has the experience of seeing his son he knows his son is there.

  1. Often we are not consciously aware of our own decision-making, planning, and creativity, but it is needlessly paradoxical to say that we never are. For example, I made a conscious decision to review an excellent book by Christof Koch and in the course of writing the review I make many other conscious decisions about what to say and how to say it. Of course there are lots of unconscious actions going on. How to move my fingers on the keyboard, for example. But no ground has been given for saying that we are never conscious of any decisions.

  2. The idea that all of our consciousness is sensory is wrong as a matter of experience. Often when I think about problems in logic and philosophy I have no accompanying sensory experience. Why should I?

  3. The idea that I am controlled by a “nonconscious homunculus” sitting at the front of my brain and looking at the back is a metaphor. What literally is going on, without using this metaphor? If you try to answer this question, you will immediately see that there is a problem. Does the homunculus mechanism literally have intentionality or not? According to this description, it can’t literally have intentionality because the necessary conscious mechanisms for real intentionality have not been specified. So the metaphor of the homunculus collapses into a set of nonmental mechanisms.


Christof Koch has written the indispensable book for anybody interested in the current state of research on consciousness. It is intended for a general audience, but I think readers who do not know at least something about neurobiology will find it tough going. He helps enormously by giving a glossary, as well as a summary at the end of each chapter. I hope that in subsequent editions he will add an appendix, or perhaps a preface, where he explains such things as what a neuron is, what a synapse is, and how action potentials actually take place.

This is the most exciting period for the study of consciousness in my intellectual lifetime. We have now, at least, cleared away three of the worst mistakes in dealing with the subject, beginning with the view that consciousness does not exist at all, that it is just an illusion, and there really are no subjective, qualitative states of sentience and awareness. A second mistake is to claim that consciousness may exist but that it is really just publicly observable, third-person behavior. The third mistake is to argue that if consciousness does exist and is manifested in behavior it must be nothing more than a computer program running in the brain. All of these mistakes leave out the real existence and the subjective character of qualitative conscious states. We are now in a position to investigate those states through the collaborative efforts of philosophers, psychologists, cognitive scientists, and neurobiologists. Koch’s excellent book is necessary reading for anybody interested in the neurobiological foundations of this project.


What Is Consciousness? June 23, 2005

  1. 2

    This issue is discussed by Oliver Sacks in his article “In the River of Consciousness,” The New York Review, January 15, 2004. It seems to me that the data that Koch and Sacks discuss support the hypothesis that in the normal, nonpathological cases, the discrete “snapshots” are NCCs below the threshold of consciousness, and they cause consciousness as a continuous flow. Unconscious snapshots cause the conscious flow of vision. But the snapshots themselves are not conscious as snapshots.

  2. 3

    Mind Time: The Temporal Factor in Consciousness (Harvard University Press, 2004).

  • Email
  • Single Page
  • Print