Computational Compositions: Aesthetics, Materials, and Interaction Design

Mikael Wiberg, Erica Reyna Robles

This paper advocates re-focusing interaction design towards aesthetics and compositions. Inspired by current movements within human-computer interaction, product design, materials science, and architecture, we argue that a central problematic concerned with reconciling the digital and physical has always shaped the field. Rather than bridging atoms and bits, an approach that systematically keeps the digital and physical apart, we advocate thinking of design as composition. Doing so will require articulating an aesthetic vocabulary that formally relates diverse materials whether digital or physical. Texture, a word that applies across materials, substrates, and scales, is advanced as a candidate term within our approach. We provide a model for thinking about texture as a relation and then ground the model through a design project, Icehotel X, rendered in ice and digital displays. Texture guided the quality of composition achieved in the final design executed by a team of diverse experts. This approach opens new avenues for the analysis and practice of interaction design.