Thesis Blog

Thesis blog moved!

2007-02-07T14:27:00.000-08:00

Since I'm not a big fan of blogger, I decided to move this thesis blog to wordpress. The posts that are here are already there and i've added some new stuff.

Here is the new address: http://interactionthesis.wordpress.com/

I'm starting the 2nd half of my masters now. This means less classes and more time for research. Who hooo! So this new blog will be updated more often then this one.

I'm still alive

2006-10-20T08:26:00.000-07:00

This blog took a break for the summer. I was working full-time and on my spare time couldn't focus on any of my thesis work. The first year of my masters was pretty stressful and I really needed a break.

Now I'm back. With quite a challenge in front of me. I just learned some basic electronics on my robotics class and have to build a physical interactive prototype in 1 month. I'm in the stage of researching the best solution before actually buying parts and implementing.

Here is my current proposal:

Haptic interface for sound manipulation

Introduction
Computer-based music performances still mostly involve people sitting behind a laptop, their fingers hidden by the screen. The use of body gestures, infinitely variable and visible to the audience, avoids the visually uncommunicative quality of typical computer music.

Goal
Use physical objects to embody and control music. This approach provides a more usable interface since the keyboard and mouse interface is less appropriate for musical performance. The projects will make use of multiple objects that move, rather than a single large touchscreen with interactive buttons, sliders, etc. It is much easier to interact with real physical objects because the hands get passive haptic feedback from the objects which help you move them without requiring a lot of visual attention.

Components
Magnetic flat display surface
Electronically tagged magnetic objects

Objects characteristics:
Translucent
Magnetic (in order to attach to surface)
RFID tagged (in order to hold one sound loop)
LED lights inside (to show when object is active)

How does it work?
Electronically tagged magnetic objects are used to manipulate sound. Sound loops are assigned to objects before they can be used in a performance. Electromagnetic tags embedded in the objects enable each one to be wirelessly identified.

When an object is placed on the board, the corresponding sound loop becomes audible and the LEDs inside the object light up to indicate the object is active.

Many objects can be placed on the board and their sounds will be layered as they become active.

The position of objects can be wirelessly tracked on a flat display surface. The position of objects on the surface also influences sound. Higher objects on the surface have higher volume.

Why will it work?
It is more expressive than a laptop interface or twisting knobs and pressing buttons for creating electronic music. It encourages a more expressive style of play. Because it is physical, there is also a dynamic that engages the audience. They can actually see what the performer is doing.

Visibility of creative performance

2006-05-29T13:36:00.000-07:00

The value we place in visibility of creative performance is exemplified by live musical performance.

While the music itself is more intricate and polished in studio recordings, audiences still pack concert venues because live performances permit listeners to witness the act of performance as well as co-produce the event (musician and audience respond to each other by mutual feedback).

With the spread of software synthesis and sequencing, laptop performers of electronic music became common, where a lone musician sits behind the LCD screen. Because performers sat motionless behind their computers (except for some mouse-clicking) the act of performance, although still taking place, was rendered invisible and as a result audiences became both disengaged and suspicious. "How do I know the performer is not just checking his e-mail?"

As an antidote, Audiopad reestablishes visibility of performance by creating a synthesis interface comprised of a projected tabletop display with several control pucks.

Audiopad is a composition and performance instrument for electronic music which tracks the positions of objects on a tabletop surface and converts their motion into music. One can pull sounds from a giant set of samples, juxtapose archived recordings against warm synthetic melodies, cut between drum loops to create new beats, and apply digital processing all at the same time on the same table. Audiopad not only allows for spontaneous reinterpretation of musical compositions, but also creates a visual and tactile dialogue between itself, the performer, and the audience.

Audiopad has a matrix of antenna elements which track the positions of electronically tagged objects on a tabletop surface. Software translates the position information into music and graphical feedback on the tabletop. Each object represents either a musical track or a microphone.

SmackBook Pro

2006-05-25T08:21:00.000-07:00

Mac user and developer Erling Ellingsen is putting the new Macbook’s motion sensor to work with his virtual desktop manager: he’s programmed it to switch desktops when he hits the side of his “Smackbook Pro.” Check out the video to see it in action:

More information: http://blog.medallia.com/2006/05/smacbook_pro.html

Sent by: Mark Potnick. Thanks! :D

Visualize Scratch

2006-05-21T22:38:00.000-07:00

This is not very related to my thesis but it's just SO cool! ;)
http://www.v-scratch.net/media1_hi.htm

Sent by: Diego Zambrano.
Thanks, honey :D

Deal Me In

2006-05-20T20:32:00.000-07:00

Deal Me In, by Simone Pia, is targeted at those "left behind by technology" by substituting for the computer keyboard a tangible user interface (TUI) and metaphor familiar to seniors: playing cards.

In the Deal Me In box:
- plastic discs like poker chips, each representing a month or year,
- two decks of cards resembling playing cards,
- a foldable mat, rather like a blackjack table.

One deck of cards is used to collect photos into albums; the other, to modify the albums, print the photos, etc. Cards and chips are all RFID-tagged.

Plug the mat into your computer: your photo-management application reconfigures itself for the Deal Me In interface. Then place cards on the mat to indicate your intentions. For instance, putting down an album card displays its associated photos one at a time; placing a print card next to it prints the photo currently displayed. Connecting your camera to the mat automatically downloads its photos and displays thumbnails of them all; putting down a blank album card 'captures' those photos: you now have a new album. If you loose an album card, put down two chips, together representing a month and a year: this lets you recreate album cards from that period.

Marble Answering Machine

2006-05-20T19:51:00.000-07:00

The Marble Answering Machine (by Durell Bishop, student at the Royal College of Art) is a prototype telephone answering machine. Incoming voice messages are represented by marbles, the user can grasp and then drop to play the message or dial the caller automatically. It shows that computing doesn’t have to take place at a desk, but it can be integrated into everyday objects. The Marble Answering Machine demonstrates the great potential of making digital information graspable.

Accenture Interactive Network

2006-05-07T23:52:00.000-07:00

The Accenture Interactive Network made its debut at Chicago’s O’Hare International airport in 7-feet high by 10 feet wide, high-definition, interactive screen format that will deliver topical news, weather, sports and entertainment features. Thousands of people will be informed and entertained by this new technology while traveling through one of the nation’s busiest airports.

The O’Hare installation is the first of what Accenture believes could evolve into a network of interactive, wall-sized screens that deliver a variety of information to the fingertips of users. The Accenture Interactive Network could one day link multiple screens in a way that maximizes content distribution with the flexibility to choose independent content for each location/screen or the same content at each location, depending on the business need.
More information

Sent by: Diego Zambrano

Touchscreen iPod?

2006-05-07T23:47:00.000-07:00

New patent application from Apple shows a virtual scroll-wheel appearing on top of an iPod interface. So... soon the iPod will only consist of the screen and nothing else. Another time the concept of "invisible interface" coming closer and closer. Anybody doubt they will do it?
http://hrmpf.com/wordpress/54/touch-sensitive-ipod/

Sent by: Diego Zambrano. Thanks :D

VirtuSphere - Totally Immersive VR

2006-05-07T14:02:00.000-07:00

VirtuSphere is a new Virtual Reality technology that allows a user to truly ‘walk’ in 3D computer generated terrain. All you do is climb into the rig, but on the VR goggles and start walking. The movement of the sphere is then measured and translated into movement in the virtual world. This technology looks amazing for future computer gaming applications as well as military training exercises and virtual tourism.

With the creation of the VirtuSphere™, Virtual Reality technology has developed sufficiently to permit users to leave behind the keyboard or mouse and immerse in this exciting new medium. The VirtuSphere is currently the only technology in the world, which permits the user to move about in virtual space through the most natural movement of all – by walking.
More information

Sent by: Diego Zambrano. Thanks :D

In search of identity

2006-05-01T22:22:00.000-07:00

This interactive installation combines a unique human-scale display system, a diverse of embedded sensors, and a dynamic spatial interface. It presents an innovative way for users to be incorporated into and interact with the photographic work of Tatiana Parcero.
http://www.insearchofidentity.com/video/

Sent by: Monica Fox. Thanks! :D

Thesis presentation

2006-05-01T07:44:00.000-07:00

Here is the link to my current thesis presentation:
http://s37.yousendit.com/d.aspx?id=3CXR2IGQZ15KD3SNTQOAAEQP1U

Nintendo Revolution

2006-04-30T18:41:00.000-07:00

How much interaction?

2006-04-30T14:58:00.000-07:00

This continuum represents the range of possible user interaction and specifies the kinds of things that users can control. It's a vocabulary of interaction that can help you express your goals in basic terms.

Extracted from the book "Interactivity by Design: Creating & Communicating with New Media" by Ray Kristof & Amy Satran

The power of interactivity

2006-04-30T14:52:00.000-07:00

Extracted from the book "Interactivity by Design: Creating & Communicating with New Media" by Ray Kristof & Amy Satran

Pick-and-Drop: A Direct-manipulation Technique for Multiple-Computer Environments

2006-04-30T14:42:00.000-07:00

Pick-and-Drop is an extended concept of the commonly used drag-and-drop. With this technique, a user picks up an object on one computer display with a stylus, then drop it on a (possibly different) computer display. For example, a user can select or create a text on one's own PDA and pick-and-drop it at the desired location on the whiteboard. From the implementation point of view, the data is transferred through the network, but from the user-interface point of view, this technique allows a user to pick up digital data as if it were a physical object.
http://www.csl.sony.co.jp/person/rekimoto/pickdrop/

Sfera

2006-04-30T14:38:00.000-07:00

The Sfera is a radio alarm clock which hangs above your bed and wakes you in the morning by forcing you physically to get out of bed. When you set the alarm, the glowing Sfera gradually dims and the music gently fades out as you drift off to sleep. When the alarm chimes in the morning, the only way to silence it is to reach up and gently tap the Sfera. This action initiates the snooze function, but it also makes the Sfera rise above your head towards the ceiling. As it slowly rises away from your reach, you must stretch higher each time to gain another ten minutes of snooze. When it reaches the ceiling, you have no option but to reach for it and drag it back down to your bed – an action which switches off the alarm and forces you finally to get up.
http://courses.interaction-ivrea.it/strangely/a4_hb.html

Gesture-based language for sharing music

2006-04-30T14:24:00.000-07:00

Mathias Dahlström developed in his thesis at IDII a gesture-based language for sharing data (in his case: music). He uses the fresbee as a metaphore for throwing music towards the receiver.

Embodied Music Sharing

Sharing music expands the sound bubble around you to encompass other people in the same space. Both interactions with people and listening to music has tactile elements to it. The music runs through our body and out to our identites. Instead of thinking about visual screen interfaces for interacting with music sourcs this project suggests ways of using the motion of our bodies and social skills to define how and why we share music with people on the move.
http://people.interaction-ivrea.it/m.dahlstrom/thesis/concept.html

Datafountain: Money translated to water

2006-04-30T14:17:00.000-07:00

This fountain is connected to money currency rates on the internet. It is realtime, refreshed every five seconds. This mobile fountain measures 5x4x3 meters. The relation between money and water is evident. On the datafountain are displayed the Yen, Euro and Dollar (¥€$). Currency rates are closely interconnected; their interdependence is visible in water. The design of the casing was kept as minimal as possible. The water is the thing to look at and listen to.
http://datafountain.nextnature.net/

flashbag - USB Flash Drives with micro pump

2006-04-30T13:37:00.000-07:00

The size of the device changes depending on the amount of data it holds.

When the device is about to blow up you will see the familiar error message on your screen: "There is not enough free space".

When swithched off the flashbag remains pumped up, so you can estimate with the naked eye how much more pics, books and music albums can be transferred into it.
http://www.plusminus.ru/flashbag.html

The "unforgettable" purse

2006-04-30T13:27:00.000-07:00

The purse registers whether certain objects (e.g. keys, wallet) are inside or at a close distance. If one of the objects moves out of this area the purse warns by soft vibration at the shoulder and you can react accordingly. In case everything is alright, e.g. you gave the cellphone to a friend to let him use it, you can "tell" the purse by shaking it softly. Then it stops warning you.

http://interface.fh-potsdam.de/popups/koch.html

Physical Interaction Design

2006-04-30T13:01:00.000-07:00

Physical Interaction Design involves the design of objects for sensing (usually humans) and displaying information (to all our senses). It involves making new devices with embedded sensors, electronics, microcontrollers and communication. The best way to do Physical Interaction Design is with rapid iteration of working prototypes.

Why "Physical Interaction Design"?

"Desktop computing" has for over 20 years relied on the same style of interaction, which is shaped by bit-map, keyboard and mouse.
"Laptop computing" offers only minor variations on the mouse (pad, stick, ball).
"Mobile computing" seems to be converging around the PDA (stylus) and mobile phones (buttons and small screen), but innovations are still happening (cameras).

Some conventions are well established (TV remote) but should be challenged. Some interaction styles have never been well coordinated (vending machines).

I am interested in creating new styles of interaction, which will depend on new controls and displays. "Ubiquitous computing" has not settled on standard devices or a common style of interaction. In fact, the idea of "embedded computing" is that we might use almost any thing that can become sensors and actuators (One that activates, especially a device responsible for actuating a mechanical device, such as one connected to a computer by a sensor link). Every interface can be unique; every object can be interactive.

Current version of abstract

2006-04-29T18:01:00.000-07:00

Gesture-based communication in Human-computer Interaction

The way people use and interact with a product is as important as what the product can do or what it looks like. The current state of human-computer interaction (HCI) is confined to traditional Graphical User Interfaces (GUI). The interactions with these GUIs are limited to keystrokes and mouse clicks. Limiting man-machine interaction to keyboard/mouse input and text/graphical output means employing only a small fraction of the overall interaction bandwidth that is available to us. My approach is to use multi-modal interfaces that will allow the artificial system to engage in a similar dialog with the user, with the objective of exploiting the richness, robustness and flexibility of face-to-face conversation.

Secondary research already conducted in the fields of augmented reality and interaction design reveals the need to broaden Human-Computer Interaction by exploring more communication channels and the use of intuitive human actions. Further studies will be undertaken in the form of observations of how humans interact with seven applications ranging from low to high degree of interactivity. By the use of video capture, three variables will be measured: physical kinesthetic, temporal dimension and responsiveness. Following the interactive experience, a survey will be undertaken so that users can describe their experience in terms of ease of use, learnability, system adaptability, etc. From my research I hope to understand the unmet needs of users when it comes to communicating with digital systems.

My approach will focus on an integrated design of real and virtual worlds. The resulting hybrid environment provides and requires new forms for interacting with information. The idea is to augment everyday places and objects with information processing capabilities. I believe that augmenting the physical environment with computer-based devices providing new functionality will provide a much richer multi-sensory experience of digital information. The proposed project explores the use of intuitive actions to manipulate information. The idea is to move towards a more fluid and natural interaction. The concepts presented will also demonstrate new potentials in navigating content without the fear of information overload associated with it.

Multi-touch interaction research

2006-04-29T15:10:00.000-07:00

Usability Guidelines

2006-04-29T13:00:00.000-07:00

From the book "Interactivity by design - Creating & Communicating with New Media", Ray Kristof & Amy Satran

1. Remove obstacles

- Let people interact with the content as directly as possible
- Give them simple routes to the information they are looking for

2. Minimize effort

- Keep related controls close together
- Put frequently used buttons in places that are easy to reach in relation to other items on the screen

3. Give feedback

- Feedback should be both appropriate and immediate (for example, responding to mouse clicks with a sound and highlighting items that have been selected)

4. Be explicit

- Make it obvious what is clickable on the screen and what is not. Objects that look like buttons should act like buttons. If images have hot areas, make sure they are distinct from the rest of the image

5. Be flexible

- Make all media (sounds, movie , animation) interruptible
- Make it easy to quit at any time, from anywhere, by using the computer's standard keyboard shortcuts for quitting

6. Be forgiving

- Don't create conditions where users have to "do the right thing" before they can move on

Monome

2006-04-22T21:36:00.000-07:00

I just got this reference from Goiano. Thanks :)
It goes along the lines of music creation that i'm speacially interested in.

The monome is a reconfigurable grid of sixty-four backlit buttons.
Buttons can be configured as toggles, radio groupings, sliders, or organized into more sophisticated systems to monitor and trigger sample playback positions, stream 1-bit video, interact with dynamic physical models, and play games. Button press and visual indication are decoupled by design: the correlation is established by each application.
Demonstration video

http://monome.org/

WarCraft Panel

2006-04-17T07:56:00.000-07:00

In this link is a table interface with gesture based commands for the WarCraft game. One more multi-touch interactive surface.

Sent by: Thadeu Morgado
Thanks Leleko! :D

Gesture-based communication in Human-computer Interaction

2006-04-16T19:53:00.000-07:00

Abstract:

The way people use and interact with a product is as important as what the product can do or what it looks like. The current state of human-computer interaction (HCI) is confined to traditional Graphical User Interfaces (GUI). The interactions with these GUIs are limited to keystrokes and mouse clicks. Limiting man-machine interaction to keyboard/mouse input and text/graphical output means employing only a small fraction of the overall bandwidth that is available to us. My approach is to use multi-modal interfaces that will allow the artificial system to engage in a similar dialog with the user, with the objective of exploiting the richness, robustness and flexibility of face-to-face conversation.

Secondary research already conducted in the fields of augmented reality and interaction design reveals the need to broaden Human-Computer Interaction by exploring more communication channels and the use of intuitive human actions. Further studies should be undertaken in the form of observations of how humans interact with applications of various levels of interactivity. The book “Interactivity by Design” provides an interaction continuum that identifies six different levels of interactivity: from lowest to highest. Six applications will be chosen to fit each level of interactivity from this continuum and users will be observed while interacting with each of those applications. By the use of video capture observational studies on how people interact with these technologies will be developed. Following the interactive experience, questionnaires will also be undertaken so that users can describe in words how was their interaction. This will complement the video ethnography. From my research I hope to understand the unmet needs of users when it comes to communicating with digital systems.

My approach will focus on an integrated design of real and virtual worlds. The resulting hybrid environment provides and requires new forms for interacting with information. The idea is to augment everyday places and objects with information processing capabilities. I believe that augmenting the physical environment with computer-based devices providing new functionality will provide a much richer multi-sensory experience of digital information. The proposed project explores the use of intuitive actions to manipulate information. The idea is to move towards a more fluid and natural interaction. The concepts presented will also demonstrate new potentials in navigating content without the fear of information overload associated with it.

Explorations of keywords and titles

2006-04-10T12:33:00.000-07:00

Keywords:

Rich interaction
Augmented environments
Multi-modal interface
Tangible interface
Ubiquitous computing

Titles:

Rich interaction: Moving towards a more natural interaction through the use of intuitive actions to manipulate digital information.

Gesture-based communication in Human-computer Interaction

Integrating "disappearing" computers and multi-modal interfaces into a natural environment

Physical participation and experience in the human-machine interaction process

Gestural Human-Computer Interaction: Moving towards intuitive experiences for the manipulation of digital information

German researchers develop another transparent OLED technique

2006-04-09T18:06:00.000-07:00

Looks like Fraunhofer's researchers aren't the only Germans able to get in on the transparent OLED thing. It appears some researchers at the Technical University of Braunschweig are claiming to have developed a technique for embedding OLED pixels on layers of transparent TFTs, creating see-through displays that could be manufactured cheaply with flexible plastics capable of withstanding extreme temperatures. Apparently the transparent displays, which were up to (and over) twice the brightness of today's displays, should be ready to rock in two years -- just in time for us to renovate the Department Of Precrime set we use act out Minority Report in during our lunch hour. Is it now?

Link

Portfolios from Ivrea students

2006-04-09T17:32:00.000-07:00

Alexandra Deschamps-Sonsino
http://designswarm.com/blog/

Aram Armstrong
http://thefarwest.net

Alejandro Zamudio Sanchez
http://www.ULTRAsuperuich.net

Ana Camila Amorim
http://www.ana-c-amorim.com/

Chia-Ying Lee
http://people.interaction-ivrea.it/c.lee/thesis/

Dave Chiu
http://www.d4v3.net/

Dana Gordon
http://people.interaction-ivrea.it/d.gordon/thesis/

David Mellis
http://dam.mellis.org/thesis/

Didier Hilhorst
http://www.nundroo.com

Hayat Benchenaa
http://people.interaction-ivrea.it/h.benchenaa/thesisblog/

Haiyan Zhang
http://failedrobot.com

Marcos Wescamp
http://marcosweskamp.marumushi.com/

Nick Zambetti
http://www.zambetti.com

Oren Horev
http://people.interaction-ivrea.it/o.horev/morph/

Tristam Sparks
http://www.restlesseye.com/

Victor Szilagyi
http://www.semiot.com/

Vinay Venkatraman
http://www.openbuilder.org/blog

Abstract

2006-04-09T16:46:00.000-07:00

The way people use and interact with a product is as important as what the product can do or what it looks like. The current state of human-computer interaction (HCI) is confined to traditional Graphical User Interfaces (GUI). The interactions with these GUIs are limited to keystrokes and mouse clicks.

Human-to-human communication is multi-modal, that is, there is simultaneous exchange of information over multiple channels at different levels of abstraction. Limiting man-machine interaction to keyboard/mouse input and text/graphical output means employing only a small fraction of the overall bandwidth that is available to us. My approach is to use multi-modal interfaces that will allow the artificial system to engage in a similar dialog with the user, with the objective of exploiting the richness, robustness and flexibility of face-to-face conversation.

The idea is to augment a real environment so that the user will be able to interact with virtual services as directly as he/she interacts with physical objects and tools, and to communicate with the system as intuitively and robustly as with another human.

My research approach is to do enough secondary research as to become familiar of what is being done in the field of augmented reality and interaction design. I also plan on conducting a study with the purpose of analyzing how humans better communicate ideas. This study will consist of observations as well as a questionnaire to be answered by an audience that will rate their understanding of the subjects being communicated. From my research I hope to understand the unmet needs of users when it comes to communicating with digital systems.

My approach will focus on an integrated design of real and virtual worlds. The resulting hybrid environment provides and requires new forms for interacting with information. The idea is to augment everyday places and objects with information processing capabilities. I believe that augmenting the physical environment with computer-based devices providing new functionality will provide a much richer multi-sensory experience of digital information. The proposed project explores the use of intuitive actions to manipulate information. The idea is to move towards a more fluid and natural interaction. The concepts presented will also demonstrate new potentials in navigating content without the fear of information overload associated with it.