iPhone as Musical Instrument from UMNewsService on Youtube.
For the last year Georg Essl from the University of Michigan has been working on an interactive programming environment for mobile devices. An alpha version of urMus, currently used by the Stanford Mobile Phone Orchestra (MoPhO) and Michigan Mobile Phone Ensemble, has recently been released for download. I was lucky enough to be invited to the second urMus workshop ever, held by Essl on the 21 June 2010 at the University of Wollongong.
Basically urMus is a tool for the creation of sonic and visual instruments directly on mobile devices (currently the iPhone and iPad, with wider non-Apple compatibility coming in the future). It gives you multiple entrance points from which to build these instruments. You can use Essl’s default urMus interface to work in a high level Pd-like way linking boxes together to create and process sound and vision, or you can delve deeper, using urMus lua code to build your own processes and interfaces. Where it differs from apps like RjDj is that it lets you create your own instruments and interfaces directly on the mobile device itself.