IV. Sensory substitution

This second empirical workpackage of the FEEL project is concerned with a more general aspect of feel than the color package, namely the question of how a feel can be experienced as belonging to one sensory modality (e.g. vision) as opposed to another (e.g. audition). According to the sensorimotor theory, sensory modality is determined not by the channel through which information is obtained, but by the sensorimotor structure of this information.

This workpackage will take substituting vision as a test case to see whether existing devices can be improved using insights from the sensorimotor theory. As a matter of fact, it appears that many aspects of vision are often ignored but could be key to such applications.

The chosen device to be improved is “the vOICe” which converts images into sound.