natural interactive walking

Wednesday, May 6, 2009

natural interactive walking

http://www.niwproject.eu/
http://www.cim.mcgill.ca/~alvinlaw/research/

Project Description

NIW will investigate possibilities for the integrated and interchangeable use of the haptic and auditory modality in floor interfaces, and for the synergy of perception and action in capturing and guiding human walking. Its objective is to provide closed-loop interaction paradigms, negotiated with users and validated through experiments, enabling the transfer of skills that have been previously learned in everyday tasks associated to walking, and where multi-sensory feedback and sensory substitution can be exploited to create unitary multimodal percepts.

NIW will expose walkers to virtual scenes presenting grounds of different natures, populated with natural obstacles and human artefacts, in which to situate the sensing and display of haptic and acoustic information for interactive simulation, and where vision will play an integrative role. Experiments will measure the ecological validity of such scenarios, investigating also on the cognitive aspects of the underlying perceptual processes. Floor based interfaces will be designed and prototyped by making use of existing haptic and acoustic sensing and actuation devices, comprising interactive floor tiles and soles, with special attention to simplicity of technology. Its applicability to navigation aids such as land-marking, guidance to locations of interest, signalling, warning about obstacles and restricted areas, will be assessed. NIW will nurture floor and shoe designs which may impact the way we get information from the environment.

FET-Open will further benefit from the discovery of cross-modal psychophysical phenomena, the design of ecologically valid walking interaction paradigms, the modelling of motion analysis and multimodal display synthesis algorithms, the study of non visual floor-based navigation aids, and the development of guidelines for the use of existing sensing and actuation technologies to create virtual walking interaction scenarios.

No comments:

Post a Comment

Welcome

This is the blog of the Extra Senses, Extra Interference research group, taught by Edwin van der Heide and Joost Rekveld at the Interfaculty ArtScience in The Hague in april and may 2009.

http://www.interfaculty.nl/

In 1964 Marshall McLuhan wrote his now classic book ‘Understanding Media’, in which he developed a completely new view of what a medium is. Instead of focussing on the content offered by the new, technological media that have been appearing in the last century and a half, he called attention to how the experience of a new medium changes the web of relations between our senses, how it changes the way in which we interpret what we perceive and how it ultimately changes our worldview. For him, every medium is an ‘extension of man’, and every new extension has a profound, total influence on how we sense, think and act. In developing this view he was influenced by the bauhaus artist Laszlo Moholy-Nagy, who was fascinated by the new perceptual possibillities offered by the new media of his time (photography, film, electric sound) and who thought that artists had a responsibility for literally shaping mankinds’ perception of the world.
In science, views on the flexibility and adaptability of our senses were developed by the Mexican/American scientist Paul Bach-y-Rita. In a series of far-reaching experiments he showed the incredible extent to which our perceptual system can adapt in real-life situations. This ‘Sensory Plasticity’ was most dramatically demonstrated in a series of experiments in which Bach-y-Rita restored sight to a number of blind people. He gave them a crude interface that translated a camera image into a series of tactile impulses on the skin. After a short period of accomodation these people reported visual sensations, and they could recognize objects, move through spaces or even catch a ball thrown at them. As a kind of cyborgs they were truly seeing, not through their blind eyes, but through their interface and their skin. Key to the success of these experiments was that the people involved could move around with their interfaces and use them in real-life situations, in which perceptions are always related to intentions, bodily movements and actions.
In this research group we want to apply this perspective on the plasticity of our senses to interactive art. We are going to develop and build (preferably wearable) interfaces that will enable us to navigate through the world on the basis of information to which we normally have no access. We are going to try and build new senses. In order to translate these normally imperceivable aspects of the world into sound, image or tactile sensations, we will study different approaches to sonification, visualization and the tactilization of data. Also we will have to think about the environment for which we build these senses and perhaps design a special environment for them.

Extra Senses, Extra Interference | ArtScience

Wednesday, May 6, 2009