Language of Touch: Aesthetics, Experience and Technologies for Next Generation Touch Interfaces

Candidate: Nima Motamedi
Type: Master of Arts (MA), School of Interactive Arts and Technology
Date: June 27, 2008
Senior Supervisor: Thecla Schiphorst
Thesis: Download Thesis Document

Abstract

Despite the recognition on the importance of embodied interaction, our ability to effectively discuss, understand, or analyze an aesthetic experience with interactivity is largely underdeveloped. Previous attempts to construct models for aesthetic experiences are too broad and general to provide practical and insightful recommendations for specific design challenges. Instead, our work focuses on the aesthetic qualities of tactile interfaces by analyzing three interactive tactile prototypes. These case-studies reveal four recurring themes which, when stitched together, construct a compelling framework for analyzing and understanding the aesthetic and embodied experience of tactile systems:

(i) InterSensory Mapping:: This theme introduces the concept of sensory-mappings which is the creation of appropriate cross-modal relationships between touch and our other senses, namely vision. This capability of mediated interfaces is a compelling strategy to evoke metaphorical haptic responses.

(ii) Semantics: This theme explores how meaningful and affective gestures can be encoded into computational models of gesture recognition. Semantics in touch is bi-directional: we encode meaning in the way he touch and caress, and at the same time, we decode meaning in what we feel and how are touched.

(iii) Technology: The third theme in the framework exposes technology as a design substance, not as a design tool. We introduce the concept of “designing technology” which ensures that the interaction better cultivates and nurtures an aesthetic experience.

(iv) Materiality: The last theme argues for the return of the primacy materials in interaction design. This section dispels the myths of “immateriality” or “dematerialization”, and highlights the role of physicality, texture, form, and materials in our experience with technology.

Combined together, our framework offers a flexible yet structured approach to understanding tactile aesthetics. In order to evaluate it’s usefulness, three case studies are presented that exemplify the main concepts of the framework.

Where are they now?

Nima is a designer for Whirlpool in Milan, Italy.