TESSA - Toolkit for experimentation with multimodal sensory substitution and augmentation

Sainz Martinez, C. and Hwang, F. ORCID: https://orcid.org/0000-0002-3243-3869 (2015) TESSA - Toolkit for experimentation with multimodal sensory substitution and augmentation. In: CHI 15, 2015-01-01, Seoul, South Korea, pp. 259-262. (ISBN: 9781450331463)

Abstract/Summary

TESSA is a toolkit for experimenting with sensory augmentation. It includes hardware and software to facilitate rapid prototyping of interfaces that can enhance one sense using information gathered from another sense. The toolkit contains a range of sensors (e.g. ultrasonics, temperature sensors) and actuators (e.g. tactors or stereo sound), designed modularly so that inputs and outputs can be easily swapped in and out and customized using TESSA’s graphical user interface (GUI), with “real time” feedback. The system runs on a Raspberry Pi with a built-in touchscreen, providing a compact and portable form that is amenable for field trials. At CHI Interactivity, the audience will have the opportunity to experience sensory augmentation effects using this system, and design their own sensory augmentation interfaces.