Skip to main content

Becoming

Becoming is the result of a collaborative work that was initiated at the Opera Hack organized by SD Opera. It is an operatic VR experience based on a Persian poem by Mowlana Rumi. While the piece is a major artistic endeavor, it also showcases a number of key technologies and streaming techniques for the development of musical content which depends on high-quality audio. In the context of experiencing a musical work in VR, the quality of spatial audio is important not only for the delivery of the music but also for the establishment of the environment and definition of a focal point of the experience in time. Our Space3D system is capable of creating highly realistic spatial impressions, and recreating the acoustics of the environment based on the virtual models in real-time using advanced multi-processing ray-tracing techniques. Audience members can be connected through the network and haptic feedback technology provides human interaction cues as well as an experiential stimulus. 

The audience experiences visual, auditory, and tactile impressions which are partly curated and partly generated interactively in response to the player's actions. The Rumi poem describes seven stages of evolution on Earth; the video below presents examples of two of the worlds of the piece. The presented volumetric video capture will be a companion to the audience members throughout the experience.

It is recommended that you listen to this video over headphones to experience the spatial audio impressions in their full effect.

The final version of Becoming with all seven stages completed will be released for free on Steam as a reference for the application of the VR technologies and strategies used in this piece. Additionally, we will release the source code of the game portion of the application, as a reference design for compute shaders, dynamic audio across multiple software audio systems, and other major elements of its design.


Credits:

  • John Burnett:  VR Infrastructure and Creative Design
  • Jeremy Cooperstock (Shared Reality Lab): Haptic Design
  • Louis Pisha: GPU Programming
  • Francesca Talenti:  Graphic Design
  • Mahsa Vahdat: Vocals
  • Shahrokh Yadegari: Direction and Composition