CaMus2: optical flow and collaboration in camera phone music performance

ABSTRACT

CaMus² allows collaborative performance with mobile camera phones. The original CaMus project was extended to support multiple phones performing in the same space and generating MIDI signals to control sound generation and manipulation software or hardware. Through an optical flow technology the system can be used without a reference marker grid. When using a marker grid, the use of dynamic digital zoom extends the range of performance. Semantic information display helps guide the performer visually.

REFERENCES

• 1: William Carter , Leslie S. Liu, Location33: a mobile musical, Proceedings of the 2005 conference on New interfaces for musical expression, May 26-28, 2005, Vancouver, Canada
• 2: G. Essl and M. Rohs. Mobile STK for Symbian OS. In Proc. International Computer Music Conference, pages 278--281, New Orleans, Nov. 2006.
• 3: Lalya Gaye , Lars Erik Holmquist , Frauke Behrendt , Atau Tanaka, Mobile music technology: report on an emerging community, Proceedings of the 2006 conference on New interfaces for musical expression, June 04-08, 2006, Paris, France
• 4: M. Kaltenbrunner. Interactive Music for Mobile Digital Music Players. In Inspirational Idea for the Intl. Computer Music Conference (ICMC), Sept. 2005.
• 5: G. Levin. Dialtones - a telesymphony. www.flong.com/telesymphony, Sept. 2, 2001. Retrieved on April 1, 2007.
• 6: M. Rohs. Real-world interaction with camera phones. In Second International Symposium on Ubiquitous Computing Systems (UCS 2004), pages 74--89. LNCS 3598, Springer, July 2005.
• 7: Michael Rohs , Georg Essl, Which one is better?: information navigation techniques for spatially aware handheld displays, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada [doi>10.1145/1180995.1181016]
• 8: Michael Rohs , Georg Essl , Martin Roth, CaMus: live music performance using camera phones and visual grid tracking, Proceedings of the 2006 conference on New interfaces for musical expression, June 04-08, 2006, Paris, France
• 9: Greg Schiemer , Mark Havryliv, Pocket Gamelan: tuneable trajectories for flying sources in Mandala 3 and Mandala 4, Proceedings of the 2006 conference on New interfaces for musical expression, June 04-08, 2006, Paris, France
• 10: Atau Tanaka, Mobile music making, Proceedings of the 2004 conference on New interfaces for musical expression, p.154-156, June 03-05, 2004, Hamamatsu, Shizuoka, Japan
• 11: Atau Tanaka , Petra Gemeinboeck, A framework for spatial interaction in locative media, Proceedings of the 2006 conference on New interfaces for musical expression, June 04-08, 2006, Paris, France

INDEX TERMS

Keywords:
camera phone, collaboration, mobile phone, mobile sound generation, music performance, sensing-based interaction