MUSIO is a musical interactive device designed for deaf people. Using the same music visualization theory, I extended the MUSIO App into this device, the input is still iPhone or iPad, but output is different. Instead of only feeling the music through abstract symbols in the application, people can feeling the music through actual physical interfaces such as light color in this interactive device.
I incorporate the twelve keys in an octave with dance symbols, producing a new way of music visualization. Therefore, a piece of dance choreography is produced as a piece of music is played on this device.
The symbol system came from a set of dance dance symbol system, "Kinetografie" proposed by the German expressionist dance artist Rudolf von Laban. Laban thinks that every part of the human body can be broken down into parts and that dance can be tokenized. In this system, each symbol could represents a part of human body. Thus, a piece of dance choreography is produced as a piece of music is played on this device. This symbol system has been used in training military by Adolf Hitler during the Second World War.
I follow the theories of music as well in this device because I want to explore music visualizations not only in digital application, but also in physically.
I had many ideas for this musical device in its initial stage, and put forward many proposals as well, but the selection of materials almost always was a problem for me. So we spent a lot of time on looking for diverse materials and try to find out the best, chose Acrylic for its good plastically finally.
Step1, iPad App – key board – a set of buttons; Step2, MAX/MSP – interfacing with hardware – control the switch of the key board; Step3, Arduino – physical computing – control the switch of the relay; Step4, Light strip – testing –implement; iPad App – (UDP, wifi) MAX/MSP – (USB Cable) Arduino – (control) Light Strip/LED
/W Peng Zhao, December 2013