updated 2021-05-05

Some short talks that overview the SMT

These are some short (<30 min) talks I’ve given about the sensorimotor theory. Because they are so short, they usually will miss out one or other important aspect — usually I emphasize the main originality of the SMT, namely how it deals with phenomenal feel. What I don’t touch on is the notion of Self and the need for attention and cognitive access to make feels conscious.

How to make a robot that feels

Towards a science of Consciousness, Tucson, Arizona, 4 Mar, 2013

I gave this this 20 min talk at the Plenary session of the “Towards a Science of Consciousness” Conference. The slides I showed are not shown in the video, but the talk is quite good in explaining the theory, and the questions asked at the end are very useful. I start with Access Consciousnes, which I assume is amenable to science and go on to Phenomenal Consciousness. I claim that the explanatory gap is a strategy to maintain the last bastion of humanity, namely “feel”, against the onslaught of robots. I suggest that the explanatory gap is due to making the Rylean category mistake of reifying qualia, and can be overcome by taking a “skill” approach to feel. I mention bodiliness, insubordinateness and grabbiness, and I show how Change Blindness is a consequence of taking the sensorimotor approach. I only touch on color, sensory substitution and the importance of attention and the notion of self. In answer to questions, I talk about dreams, thoughts, locked-in syndrome, pain, and the explanatory status of the theory as a re-definition of the notion of phenomenal consciousness or “feel”.

How the sensorimotor approach overcomes the Explanatory Gap and the Hard Problem of Consciousness

Mind and Life European Summer Research Institute, 10 Aug 2020

This 22 minute talk is an overview of some of the main ideas in my sensorimotor approach, as presented in my book “Why red doesn’t sound like a bell”. It was filmed by Denis Connolly of the School of Looking.

The talk covers: the blind spot and other defects of vision; how we should understand what it’s like to perceive in terms of active exploration rather than brain representations.

I explain the explanatory gap problem and show how the sensorimotor approach overcomes it, explaining why red looks red rather than sounding like a bell. And I show how “bodiliness”, “insubordinateness” and “grabbiness” explain why there is “something it’s like” to have an experience. Finally I show how the brain can understand the notion of space by interacting with the world.

Le faux problème de la conscience et la conscience imminente des machines

Forum des Sciences Cognitives, April 28, 2020

This half-hour summary in French of my sensorimotor approach to consciousness is a short but fairly complete overview of the theory.

I start with the explanatory gap problem of explaining the differences in experienced sensations in terms of brain mechanisms. I review whether current theories of consciousness deal with this. I say that Access Consciousness and even the notion of Self seem amenable to scientific investigation, but Phenomenal consciousness seems difficult because of the explanatory gap. I show then how the sensorimotor approach can solve the explanatory gap. I give the example of softness, I discuss the explanation of sensory modalities in terms of sensorimotor laws and the prediction of sensory substitution. I describe the rubber hand illusion. I explain sensory presence in terms of bodiliness, insubordinateness and grabbiness. I describe change blindness. I then go on to the importance of invoking Access Consciousness and the Self as paying attention to the sensorimotor laws, which brings me to inattentional blindness.

The sensorimotor approach to understanding “feel” in humans and robots

Softbank robotics, Paris, June 17, 2014

In this 40 min talk I cover pain, color, sensory presence, the explanatory gap, change blindness. I spend quite a while explaining the approach Alexander Terekhov and I have developed to explain how brains could deduce the notion of space without prior knowledge. I don’t cover the Self and cognitive access.

Thinking about vision in a different way: the world as an outside memory

Workshop on Perception Through Structured Generative Models, at ECCV on Aug 28, 2020

This 45 minute talk does not present my SMT as a whole, but rather is about vision and the “world as an outside memory” idea, used to explain the experienced quality of visual perception. I start with all the defects of the visual system like chromatic aberration, lack of color vision in periphery, distortions due to retinal inhomogeneity, the blind spot, and eye movements. I show how there is no need to compensate these defects if we think about vision as an exploratory sense like touch. I propose we take vision to be like exploring an outside memory, and illustrate this with inattentional blindness. I discuss why seeing seems “real” rather than just like thinking or remembering in terms of grabbiness, which I illustrate with change blindness.

Some (longish) talks and classes I’ve given on SMT

These talks are fairly complete overviews of the sensorimotor theory, and are all quite similar to each other. The first one is the shortest.

Why things feel the way they do

Copernicus Center for Interdisciplinary Studies, 8 Aug 2014

This one-hour talk is a good overview of the sensorimotor theory. It starts with pain, goes on to color, that I treat in quite some detail, and then discusses sensory “presence” or “what it’s like”. I explain the role of attention and give some change blindness demonstrations, I mention the phenomenon of “looked but failed to see”, and talk about the Self and the taboo of changing the self.

La conscience expliquée aux machines (approche sensorimotrice de la conscience)

Integrative Neuroscience and Cognition Center, Université Paris Descartes, 4 Feb 2019

This two hour talk in French (with English slides) is similar to the class I give every year to Masters’ students in the CogMaster course. I start with the robot Terminator, and ask what we would have to build into him so he actually felt pain, for example. I explain the explanatory gap problem and use the softness example to explain the idea of understanding feel in terms of sensorimotor skills. I show how this idea explains the differences between sensory modalities and predicts sensory substitution. I show a video of the “Voice” device. I talk about touch and the rubber hand illusion, and describe the approach to color in detail. I then go on to explain the “what it’s like” or sensory “presence” of sensory experiences in terms bodiliness, insubordinateness and grabbiness and mention the “phenomenality plot”. I show how this idea predicts change blindness and show several varieties of change blindness. After a pause I describe the need for attention to ensure consciousness of a sensory experience, and show inattentional blindness and “looked but failed to see”demos. I then go on to discuss different levels of the notion of self, and how it can be conceived as a social construction and how it might develop in infants.

The Sensorimotor Theory of Phenomenal Consciousness

Barcelona Cognition Brain and Technology Summer School, Sept 2012

In this two-hour talk I start by defining what we mean by “raw” feel, and the three mysteries about it: ineffibity, the structure of sensory feels, and their sensory “presence”. I explain the explanatory gap and the “content-vehicle confusion” of thinking that a neural account of sound intensity or of color could explain the structure of sensory feels like the loudness of sounds or the redness of red. I go on to show how the sensorimotor theory overcomes the three mysteries. I show how it predicts sensory substitution and show a video of the “Voice” device. I describe the sensorimotor approach to color. I show how the approach predicts the rubber hand illusion. I then treat the topic of sensory “presence”or “what it’s like” using the ideas of bodiliness, insubordinateness. I show how this predictds Change Blindness. I go on to talk about attention and inattentional blindness and “looked but failed to see”. Finally I talk about the need for a notion of Self, and describe what is meant by this. There are numerous interruptions and interesting questions during the talk by people including Anil Seth, Paul Verschure and Andreas Engel.

Why red things look red

Barcelona Cognition Brain and Technology Summer School, Sept 2009

Below are links to the videos of a talk I gave on the sensorimotor account. Each video lasts between 30 and 45 minutes, and there are a lot of interruptions and questions from among others, Paul Verschure and Tony Prescott.
Part 1 In this part I start by talking about the Self: we only say that we experience something if we, as selves, are paying attention to what we are doing. But what is the Self? I will assume that the Self is amenable to science, and consists in a self-referential story that “I” construct about “I”! I present some empirical evidence that this makes sense. I then go on to address the main interest of the sensorimotor theory, namely “feel”, or phenomenal consciousness. I start with color, and show how neurophysiological accounts of “basic colors” red, yellow, green and blue, do not work.
Part 2. In Part 2 I go on to generalize from color to all “feels” and explain the “explanatory gap” problem of why any brain-based account of feel must remain unsatisfactory. I then propose the idea of the sensorimotor approach, which is that we could consider feels to be modes of interaction instead of brain activation. I illustrate it with the softness of a sponge. And then i show how, applied to color, it actually explains the “basic colors”.
Part 3 In Part 3 I then describe how the same ideas explain the “feels” of other sensory modalities, and how they predict the possibility of sensory substitution, and phenomena like the “rubber hand illusion”. I then talk about the feeling of phenomenal presence or “something it’s like” in terms of the notions of bodiliness, insubordinateness and grabbiness. This predicts the phenomenon of Change Blindness, for which I give some demonstrations.

A New, Sensorimotor View of Seeing

Edmond & Lily Safra Center for Brain Sciences, Interdisciplinary Center for Neural Computation, Hebrew University, 24 Feb, 2011

In this one hour talk I start with the upside down image at the back of the eye and other defects of vision, like the blind spot, lack of color vision in peripheral vision, and eye saccades. I explain how the sensorimotor approach dispenses with the need to postulate compensation mechanisms to overcome these defects. I demonstrate inattentional blindness and “looked but failed to see”. I explain that seeing continuously does not need continuous brain activation, thanks to the phenomenon of the “refrigerator light” and thanks to “grabbiness”. I talk about the explanatory gap and the infinite regress of explanations it necessitates. I describe the sensorimotor account of color experience. I explain how the theory accounts for differences in sensory modalities and how it predicts sensory substition. I dont talk about the self.