• Email
  • Single Page
  • Print

A New Vision of Vision

An example of such a rule might be: a sudden change in the amount of light reflected from one part of a surface usually means there is a border, or change of contour, at that part of the surface. Other rules would refine this rule, determining, among other things, if the change in reflected light was caused by a shadow.

Nonetheless there are limits to the brain’s ability to acquire the necessary rules for seeing and creating a coherent visual world. More than two hundred years ago an English surgeon, William Cheselden, removed cataracts from a young boy who had been born blind. The operation attracted considerable attention because it seemed to answer a question the philosopher William Molyneux had asked John Locke: whether a man born blind who had recovered his sight later in life would be able to “distinguish between a cube and a sphere of the same metal.” Locke believed that he would not be able to distinguish the shapes visually because “he has not yet obtained the [visual] experience.”

Locke’s view appeared to be confirmed following the operation. Cheselden reported that his patient was unable to judge the shapes or sizes of objects. His room appeared to him as large as his house, though he knew this did not make any sense. He could see portraits hanging on the walls, but was surprised to discover that the faces were flat. He could recognize objects in two-dimensional drawings, but, again, their flatness did not make sense to him; they appeared to be in three dimensions. Cheselden’s patient was unable to acquire the rules that are essential for understanding drawings of three-dimensional objects on two-dimensional surfaces. Similar surgical operations on people born with congenital cataracts have been performed some twenty times since, always with unfortunate results, although they differ in some ways from the reactions of Cheselden’s patient. Recently, one patient reported, following an operation that restored her sight, that she had great difficulty making sense of whatever she was looking at. She was in a constant state of depression. Among the distressing problems she described was her in- ability to see individual colors as a part of objects; she saw the colors floating in separate planes before her eyes. Zeki cites the case of a French surgeon, Moreau, who in 1913 had enthusiastically looked forward to restoring the vision of an eight-year-old patient with cataracts. “The deception was great,” Moreau wrote. He concluded that,

It would be an error to suppose that a patient whose sight has been restored to him by surgical intervention can thereafter see the external world. The eyes have certainly obtained the power to see, but the employment of this power…still has to be acquired from the very beginning. The operation itself has no more value than that of preparing the eye to see; education is the most important factor. The [visual cortex] can only register and preserve the visual impressions after a process of learning…. To give back his sight to a congenitally blind patient is more the work of an educationalist than that of a surgeon.

Unfortunately, however, just as children who have never learned any language before the age of puberty cannot acquire the grammatical rules essential for language, people born blind who later have their vision restored cannot acquire the rules essential for seeing and recognizing objects and people.

Such cases of people who are born blind and later acquire sight seem to show that our visual recognition of distance, size, and the three dimensions are acquired early in life when visual stimuli are integrated with our sense of touch, a sense that generally depends on movement. Our capacities to recognize distance, size, and dimensions derive from the set of rules or procedures the brain uses to recognize and make sense of the visual world. The rules required for creating the abstract idea of a two-dimensional representation, for example, must be acquired very young. Apparently infants can acquire the ability to correlate their sense of touch and movement with visual stimuli and older children can’t. After infants undergo operations to remove congenital cataracts, they have normal vision; following the same operations, children of some twelve years or older are hardly able to make out objects clearly. Once again, Hoffman makes it clear that we do not understand why this is the case, just as we do not understand why most children learn new languages easily and most adults do not.

Artists have always known, at least intuitively, that the brain makes possible the creation of our visual worlds, since representational art uses materials on a flat surface to create the illusion of faces, objects, and scenes. For Zeki, artists were unwitting neurologists long before neurology came into being, at times exploring the limits of our visual intelligence. He argues that in simultaneously showing objects from several different perspectives Cubist works make explicit the perceptions that we know implicitly and that are essential to our faculties of recognition.

Brain damage can destroy this implicit knowledge, making the recognition of objects and drawings virtually impossible. Zeki describes a patient who, following a stroke, had great difficulty seeing objects. He was asked to make a drawing of St. Paul’s Cathedral in London. After considerable effort, he eventually completed the drawing. But when he had finished, Zeki writes, “he could not recognize the Cathedral in his own drawing; he could not combine the elements of which the drawing was made into a whole. But he could see the individual details, describing correctly the orientation of the lines in various parts of his drawing.”

Another brain-damaged patient reported: “Generally, I find moving objects much easier to recognize, presumably because I see different and changing views…. For that reason the TV screen enables me to comprehend far more of an outdoor scene than, for example, the drawings on my living room walls.” Here movement provides the information that most of us implicitly understand when we are viewing a face or an object. The case of this patient shows it is possible to be directly aware of stationary objects and yet have difficulty imagining what they are like.

Just as we rely on implicit knowledge in our perception of objects and faces, so too, the brain creates a sense of “color constancy”: no matter what the lighting conditions—bright sunlight, filtered sunlight, or artificial lighting—colors remain more or less the same. This remarkable ability is not fully understood, but depends, in part, on the brain’s comparing the amount of light reflected in the long (red), middle (green), and short (blue) frequencies coming from different parts of a given scene. In a famous experiment performed by Edwin Land, the inventor of the Polaroid camera, a multicolored surface was illuminated by three projectors of colored light; one projector emitted red light, one green light, and one blue light. The intensity of the light emitted by each projector could be adjusted. The people being tested were asked to view, for example, a green patch. The projectors were then turned on and the green patch was illuminated with 30 units of red light, 60 of green, and 10 of blue. All the subjects of the experiment agreed that the patch was green. Of course this is hardly surprising since most of the reflected light (60 units) was green. In the following trial, however, the multicolored surface was illuminated by 60 units of red light, 30 units of green light, and 10 units of blue light. Even though the surface was illuminated by twice the amount of red light than in the first trial the subjects of the experiment agreed that the patch they had declared to be green in the first trial remained green. (See illustration on page 61.)

This is an example of color constancy. The brain compares the light frequencies coming from the green surface with those coming from surrounding surfaces. The green patch will reflect proportionately more green wavelength light than the surrounding areas no matter what the actual mix of red, green, and blue light coming from the projectors. Hence surfaces appear to have basically the same color under very different light conditions. Furthermore, since colors are created when the brain compares the ratios of light frequencies reflected by neighboring surfaces, colors establish borders; even in chaotic and turbulent paintings there are always unavoidable distinctions from one shade of color to another.

Carbon monoxide poisoning can cause the loss of color constancy and with it a separation of the sense of color and form. One patient Zeki describes complained that though he could see colors, they were “wrong”; careful study revealed what he meant. If a green surface reflected more red wavelength light than green or blue, he saw the surface as red; if the same surface were made to reflect more green wavelength light than red or blue, he saw the surface as green. In other words, unlike the normal subjects in the experiment I have already described, this patient’s brain did not compare the amount of red wavelength light being reflected by a given surface with the amount of red wavelength light being reflected by surrounding surfaces. For this patient, green leaves did not remain green from morning to evening. His brain was measuring the frequency of the light reflected from the leaves throughout the day without comparing the frequency reflected from the leaves to the frequency from the surrounding areas. The leaves became red in red light, blue in blue light, and green in green light. He had no way of knowing if the leaves had any permanent, invariant color.

And yet if pathology has told us much about how the brain works, artists have in their own way discovered aspects of brain function that had previously been unknown. Indeed, Zeki writes, brain-scanning techniques have revealed that abstract, representational, and Fauve paintings cause very different patterns of brain activity in normal individuals. Abstract art activates principally two areas in the visual cortex of the brain—V1 and V4—that are apparently essential for creating the perception of colors. Representational art activates, in addition to areas V1 and V4, areas believed to be concerned with memory and learning, including the hippocampus. The Fauves painted people and objects with unnatural colors. Zeki found that Fauve art creates a pattern of activity in the brain that is quite different from the pattern created by traditional representational art.1 It is remarkable that abstract and representational art should cause such diverse patterns of brain activity; different schools of art each seem to have their own neurological basis.

Our enjoyment of portrait painting, moreover, is dependent on our specialized faculty for face recognition, which, Zeki writes, is an apparently irreducible neurophysiological unit. When that unit is damaged, the capacity to see a portrait may be impaired, as in the case of the patient who said, when looking at his wife, “I can certainly see a face, with eyes, nose and mouth etc. but somehow it is not familiar; it really could be anybody.” A relatively small lesion in a specific part of the brain is responsible for these difficulties; brain damage causes an inability to synthesize visual faces into coherent, recognizable images. Equally striking is another form of brain damage, which does not destroy a patient’s ability to recognize faces, but leaves him unable to recognize facial expressions of emotions such as fear. Our interest in portraiture obviously derives not just from recognition but also from our ability to read facial expressions and their psychological implications.

Our visual worlds, as the books by Hoffman and Zeki demonstrate, are creations that depend upon complex interactions within the visual cortex. Color, form, and motion are the brain’s solutions to making sense of the constant flux of visual sensations that are registered on the retina. We are beginning to uncover the ways in which the brain divides up its visual tasks, but, as Zeki and Hoffman both make clear, we have few details of the neurophysiology of these rule-following processes.

Indeed, there is still much to learn. We will only truly understand vision when we have unraveled the mysteries of consciousness and memory and the relations among recognition, remembering, and awareness. We have yet to learn how we become aware of our recollections and perceptions, and how we can consciously recognize and recall people, places, and things. Not very long ago, for example, it was a generally accepted truth that the human brain never produces new neurons after birth; therefore it was widely believed that memories had to be imprinted and permanently stored in fixed brain structures for recognition, thought, and action to be possible. Last year researchers discovered that new neurons appear in areas of the brain concerned with learning and memory. If these findings are confirmed, it is very probable that even our present limited understanding of perception and brain function will undergo radical, if not revolutionary changes—just as Hoffman and Zeki have shown us how our present views of perception are radically different from what they were a few decades ago.2

  1. 1

    Fauve art activates areas V1 and V4, and scans show a pattern of frontal lobe activity different from that of traditional representational painting, with no activity in the hippocampus.

  2. 2

    See Elizabeth Gould et al., “Neurogenesis in the Neocortex of Adult Primates,” Science, October 15, 1999, pp. 548-552. The first reports of neurogenesis (new neurons) in mammalian brains go back to 1965. See J. Altman et al., Journal of Comparative Neurology (1965), p. 319. Also F. Nottebohm has long studied neurogenesis in avian brains. See S.A. Goldman and F. Nottebohm in Proceedings of the National Academy of Science (1983), p. 2390. See Gould’s article for more recent papers of Nottebohm and others.

  • Email
  • Single Page
  • Print