Back to Works

Interactive electroacoustic work · 2010

i Touch
the Moon

A handheld device becomes an instrument, a gesture becomes musical form, and the moon becomes an unstable field of sound.

Duration 4′53″ Form Interactive electroacoustic performance Composition, programming and performance Liu Hao
Visual texture for Liu Hao's 2010 interactive electroacoustic work i Touch the Moon
i Touch the Moon, 2010 Interactive electroacoustic performance

Created in 2010, i Touch the Moon presents an iPod touch as the visible edge of a larger musical instrument formed by the body, sensors, software, synthesized sound and real-time response.

01

Touching an Unstable Moon

The moon in this work is neither distant nor silent. It is imagined as a volatile sonic territory: flashes appear and vanish, white and black clouds cover one another, crater-like depths open inside the sound, and unfamiliar events seem to move beneath an unseen surface.

The performer enters this imagined space through inclination, movement and touch. Each gesture seems to alter its gravity, atmosphere and light. Sounds gather, fracture, drift and transform; one texture slowly passes into another, while tension rises and dissolves across the work’s distinct musical sections.

From the original project brief

The composer approaches the moon as a mysterious sonic world. Flashes of light, white and black clouds, lunar craters and strange events are translated into continuously changing sound through a fully interactive real-time performance.

The technology does not replace composition. It enlarges the space in which composition can happen.
02

When a Mobile Device Becomes an Instrument

In i Touch the Moon, the instrument is not a single object. It is a relationship between the performer’s body, the iPod touch, its motion sensors and touchscreen, OSC communication, software interpretation, sound synthesis and the acoustic result heard in the room.

This changes what an electronic instrument can be. The device was designed for communication and everyday media use, yet on stage it becomes part of an embodied performance system. Its own qualities—mobility, touch, orientation and continuous movement—become the basis of musical action.

The significance lies not simply in using a mobile device, but in allowing an object from daily life to enter the grammar of composition. The device no longer only stores or plays content. It participates in producing the work as it unfolds.

03

Interaction as Composition

The gestures do not merely activate sounds. They shape how the composition moves through time.

Motion and touch affect timbre, modulation, transformation, density and transition. These relationships are organised inside a complete musical form with recognisable sections, contrasting states, accumulating tension and deliberate release. Interaction is therefore not added after the music has been written; it is one of the means through which the music is written and performed.

This is what separates the work from a short sensor demonstration. The system does not exist to prove that a gesture can trigger an effect. It exists to sustain continuity, articulate form and carry an expressive argument from beginning to end.

04

Real-Time Sound Synthesis and Interaction System

Acceleration-sensor and touchscreen data are transmitted from the iPod touch to the computer through OSC in real time.

The system receives continuous streams of sensor values and also distinguishes different physical actions, allowing tilting, sweeping, touching and changes in device orientation to enter different levels of musical control.

Max/MSP receives and analyses this movement data, constructs the mappings between gesture and sound, and manages the interaction logic, musical processes and part of the real-time audio processing. Csound generates the synthesized sound material of the work in real time.

Granular synthesis breaks sound into minute grains and reorganises, accumulates, stretches and transforms them. Sound can fracture out of a continuous state and can also gather again from dispersed particles into a new sonic form.

Timbral morphing allows different sound states to pass continuously into one another rather than switching abruptly. The modulation system continually alters the internal relationships between parameters, causing timbre, density, motion and sonic tension to remain in transformation throughout the performance.

Bodily actions can operate on local sound parameters and can also drive larger musical processes, including changes of sonic state, transitions between sections, the accumulation and release of tension, and the development of the overall structure.

For the audience, most of this technical system remains invisible. Yet it is this system that turns movement into sound, organises changes in sound as time, and ultimately makes interaction part of the form of the work.

05

A Work from the Early Mobile Era

Today, mobile devices are inseparable from everyday life and are frequently treated as extensions of the body.

In 2010, their role inside composed concert performance was far from settled. i Touch the Moon records a transitional moment in which a consumer electronic object was reorganised as a bodily performance interface.

The work brought an emerging body–computer relationship onto the stage, organising performer, device, software and sound as one continuous artistic system. Musical action moved from the fixed workstation, keyboard and fader into the palm, the tilt, the sweep and the touch; the instrument ceased to be only an object placed on stage and became an active relationship between body, sensors, algorithms and sound.

A new interactive medium enters artistic language only when it can carry time, structure, tension, transformation and expressive consequence. i Touch the Moon presents this transition as it was taking shape: everyday computational devices moving closer to the body and participating directly in the generation of musical form.

Work Archive

Title
i Touch the Moon
Year
2010
Duration
4′53″
Form
Interactive electroacoustic performance
Creator
Composition, programming and performance by Liu Hao / 刘昊
Performance
Central Conservatory of Music, Beijing
Interface
iPod touch with acceleration sensor and touchscreen
Communication
OSC · Open Sound Control
Action analysis, interaction and audio processing
Max/MSP
Synthesis
Csound
Sound techniques
Real-time sound synthesis, granular synthesis, action recognition, timbral morphing and modulation
Video
YouTube and Youku documentation
Back to Works