This blog took a break for the summer. I was working full-time and on my spare time couldn't focus on any of my thesis work. The first year of my masters was pretty stressful and I really needed a break.
Now I'm back. With quite a challenge in front of me. I just learned some basic electronics on my robotics class and have to build a physical interactive prototype in 1 month. I'm in the stage of researching the best solution before actually buying parts and implementing.
Here is my current proposal:
Haptic interface for sound manipulation
Introduction
Computer-based music performances still mostly involve people sitting behind a laptop, their fingers hidden by the screen. The use of body gestures, infinitely variable and visible to the audience, avoids the visually uncommunicative quality of typical computer music.
Goal
Use physical objects to embody and control music. This approach provides a more usable interface since the keyboard and mouse interface is less appropriate for musical performance. The projects will make use of multiple objects that move, rather than a single large touchscreen with interactive buttons, sliders, etc. It is much easier to interact with real physical objects because the hands get passive haptic feedback from the objects which help you move them without requiring a lot of visual attention.
Components
Magnetic flat display surface
Electronically tagged magnetic objects
Objects characteristics:
Translucent
Magnetic (in order to attach to surface)
RFID tagged (in order to hold one sound loop)
LED lights inside (to show when object is active)
How does it work?
Electronically tagged magnetic objects are used to manipulate sound. Sound loops are assigned to objects before they can be used in a performance. Electromagnetic tags embedded in the objects enable each one to be wirelessly identified.
When an object is placed on the board, the corresponding sound loop becomes audible and the LEDs inside the object light up to indicate the object is active.
Many objects can be placed on the board and their sounds will be layered as they become active.
The position of objects can be wirelessly tracked on a flat display surface. The position of objects on the surface also influences sound. Higher objects on the surface have higher volume.
Why will it work?
It is more expressive than a laptop interface or twisting knobs and pressing buttons for creating electronic music. It encourages a more expressive style of play. Because it is physical, there is also a dynamic that engages the audience. They can actually see what the performer is doing.
