Role  UI/UX Designer
Team ​​​​​​​ Brandon Badger, Sam Hu, Shiva Sankar Kannan, Pavan Paravasthu
Timeline  4 months

Mixthesia is an exploratory project focused on discovering intuitive interactions in VR that introduce novice musicians to sound mixing tools and concepts.

Sound mixing is an arcane craft performed in closed-off rooms for extended periods of time through a complex interface. By prototyping different visualizations and interactions, the project aims to demystify the craft of sound mixing by avoiding the complex traditional interface.
Which part of music production are we tackling?
Music Production and Mixing

1. Our inspiration behind this is that Digital Audio Workstations, the software that is used for song mixing, are very intimidating to newcomers.

2. Find experts telling novice to picture something in their head to explain how the tools and concepts work with the sound.

1. How might we build something like a tutorial/transition to DAWs?
Since DAWs work within a stereo sound setup, we want to present the same type of sound that they will be using to mix professionally.

2. How might we make sound mixing concepts more understandable in VR? 
Concepts including: EQ/reverb/volume/panning/automation

3. How might we present the tools without interacting with sliders and knobs on a panel, but a more interesting and intuitive way?
Novice learn the mixing tools and concepts through visual associations, but need to operate on the complex mixing panel.

4. How might we make the space and the interface/interactions accessible for guests? (this came later in the development phase)
Accessibility has been brought up multiple times with ETC advisers and industry professionals. Not only colors and interfaces, but we need to consider the functionality and content as well.
MY CHALLENGE design constraints

1. Should not show all parameters and labels, but still leave some trails on the interface or in the interactions to match sound mixing techniques.

2. Customize a clear design pipeline for this project.
We have the resource of playtesters and industry professionals to gain insights. How exactly can we get the best out of the interviews and playtests? How to introduce UX research and design methods to the cross-discipline team?

3. Interactions should be simple, becasue the goal is to let guests understand sound mixing concepts.
Importance level: visualization > interaction

1st phase:   Create UI
In charge of logo design and poster design. At the same time, set up design pipeline, mood-board for art theme. 
Create instruction board for interactions within each prototype.

2nd phase:   Lead Design Panels
Research about sound mixing concepts and interactions before discussing with teammates. Sketch storyboards on Zoom whiteboards and Procreate/Paper. 
Organize design brainstorm ideas in shared document for efficient communication with development team, artist, and producer.

3rd phase:  Interview & Analyze Playtest Feedback
Construct interview structure to get valuable insights from industry professionals. Lead affinity diagramming and consolidate key takeaways.
Prepare post-surveys for prototype playtests. Clarify goals and pain points with playtesters. Bring up questions aside from survey during and after the playtest. Organize playtest data and takeaways into shared document.

4th phase:   Documentation & Media
Finalize each prototype development phase by documenting all design reasonings, findings, and future perspectives. Refine project website and media. 

Our approach to representing sound mixing is two-fold: tools and concepts. After coming up with visualizations and interactions for mixing tools, we’ll engage with more abstract and conceptual guidelines within the craft of audio mixing. The team will build prototypes inspired by insights and feedback from both industry professionals and novice musicians.
Storyboard for prototype interactions
Playtests and workshop
Workshop with Arvi School of Music
Workshop with Arvi School of Music
Demo during workshop
Demo during workshop
Playtest with Rebecca Wolfinger
Playtest with Rebecca Wolfinger

From the interviews with professionals and novice musicians, we understand that real world association bridges the gap between parameters and laymen nouns. Therefore we aim to visualize the laymen nouns such as ‘hallway’ and ‘church’ reverb.

Automation + Volume + Panning
Automating volume and panning together was an innovative experiment spotting the limitations and inconveniences while mixing in DAWs. Instead of horizontal and lifeless automation lines, we leveraged the VR space and matched the project theme by designing the lines into dropping constellations.

Parameters in EQ layout were carefully chosen to let novice understand clashing concepts along with reifying some commonly used adjectives.

Through playtests, we proved the efficiency of interacting with sound tracks and visualizing concepts in VR space. Also foresee the potential of understanding preliminary sound mixing concepts with our prototypes.

Sound designer pain points analyzed with qualitative research:   click the images to zoom in

Demo of 2 latest prototypes

For more in depth development process and documentation, visit Mixthesia website.
1. Share screen to observe behaviors and resolve confusions.
2. Prepare instructions in virtual space about buttons and interactions.

Instructions for onboarding playtesters

Mixthesia poster

You may also like

Back to Top