Audio-haptic simulation of walking on virtual ground surfaces to enhance realism

In this paper we describe two experiments whose goal is to investigate the role of physics-based auditory and haptic feedback provided at feet level to enhance realism in a virtual environment. To achieve this goal, we designed a multimodal virtual environment where subjects could walk on a platform overlooking a canyon. Subjects were asked to visit the environment wearing an head-mounted display and a custom made pair of sandals enhanced with sensors and actuators. A 12-channels surround sound system delivered a soundscape which was consistent with the visual environment. In the first experiment, passive haptics was provided by having a physical wooden platform present in the laboratory. In the second experiment, no passive haptics was present. In both experiments, subjects reported of having a more realistic experience while auditory and haptic feedback are present. However, measured physiological data and post-experimental presence questionnaire do not show significant differences w...