Soundscape Safari • DeScioli.com

Making music with goofy animal characters using mobile augmented reality

Published Friday February 9th, 2018

Last edited Friday February 9th, 2018

At the 2017 Reality, Virtually, Hackathon I was a part of team Augmented Fifth that made a playful music composition experience using mobile augmented reality. In the experience you create music by placing and interacting with animal characters in the physical space around you.

Inspiration

Our original inspiration for the project was to explore immersive sound composition in augmented or virtual reality. We chose mobile augmented reality over virtual reality or high-end augmented reality because of its accessibility and shareability.

Team Augmented Fifth — Vik Parthiban, Emily Salvador, Colin Greenhill, Yichao Guan, Chaz Hing (not pictured), and myself.

Contributions

I worked on the augmented reality interactions and 2D user interface. This included the placement and tracking of characters within the scene, and the side menu where you can choose characters, adjust the tempo, or reset the scene.

Sharing the app with kids and watching their delight at the public expo on Monday was a welcome reward for the weekend's hard work.

More info

You can find more details about the experience on our Devpost project and get the code on our GitHub repo. You can open the project in Unity, but it will not run because we did not upload some of the larger dependency files. All of the art, assets, and code that we made is there, but you will need to install some missing files to be able to run it yourself.