MoveMusic is a XR MIDI controller that lets you wirelessly control music software with body movement. Build and interact with a 3D instrument you create.
MoveMusic Control is an app for Meta Quest VR headsets which lets you build a virtual MIDI controller of 3D geometry which you can interact with using handheld VR controllers. Use custom-built controller layouts to wirelessly control music software on another computer via Wi-Fi and MIDI with low latency. Air-drum a drum beat, bow an invisible cello, play 3D instruments that could not exist in reality! Turn on the Mixed Reality Passthrough feature to see the world around you while performing with your virtual MIDI controller. Take advantage of the advanced 3D MIDI interface building system including MIDI Note and CC mapping, multiple workspaces of control layouts, multi-object editing, object grouping, and other customization. Save the 3D MIDI controllers you create to reopen later or share with a friend! Requires our MMConnect app for macOS/Windows/Linux to connect the MoveMusic Control VR app to your computer and send MIDI to your music software. The VR app currently supports Meta (Oculus) Quest standalone VR systems. My name is Tim. I've been researching & developing this concept over the past 7 years and it's a big passion project for me! I’ve made various prototypes through the years, including MoveMIDI, an app which used PlayStation Move controllers and a camera for similar interactions. After researching the topic in graduate school, I spent a couple years developing MoveMusic Control for VR. Now my wife and I are working together to sell the VR app to consumers! Videos of MoveMusic: Live Looping Performance 1: https://youtu.be/2CG6NDF-IP0 Live Looping Performance 2: https://youtu.be/QCaUKKBS2RI Basic Walkthrough: https://youtu.be/erX-TEpcNJM?t=100
How It's Innovative
The goal of MoveMusic is to provide musicians a tool for creating and performing digital music which allows for interaction using large body movements for expressive control and for communicating with an audience through movement. A quote from Brian Eno in 1999 very much informs the mission of this product: """ Years ago I realized that the recording studio was becoming a musical instrument. I even lectured about it, proclaiming that “by turning sound into malleable material, studios invite you to construct new worlds of sounds as painters construct worlds of form and color.” I was thrilled at how people were using studios to make music that otherwise simply could not exist. Studios opened up possibilities. But now I'm struck by the insidious, computer-driven tendency to take things out of the domain of muscular activity and put them into the domain of mental activity. This transfer is not paying off. Sure, muscles are unreliable, but they represent several million years of accumulated finesse. Musicians enjoy drawing on that finesse (and audiences respond to its exercise), so when muscular activity is rendered useless, the creative process is frustrated. """ We hope MoveMusic allows electronic musicians to perform and create in new ways which are inspired by the body-involved interactions required by many acoustic instruments. There are few VR apps similar to MoveMusic Control, a dedicated MIDI controller product with a simple, yet powerful control building system. The app provides the user with the basic building blocks to create a wide range of controller layouts. While MoveMusic takes advantage of VR technology at the moment, we are looking towards the future where AR glasses and robust full-body 3D tracking will allow people to dance to create and perform music!
See MIDI Innovation In Action
Most Inspiring Use Cases
Although we have not explored this use case in-depth, we are extremely interested in the application of MoveMusic to music therapy. We plan to reach out to people in this field after initial release of the app. If this app interests you and/or you know someone who utilizes music therapy in their field, please reach out to us. Some of the most inspiring uses of MoveMusic we have seen have come from one of our beta testers, Charlie Beeching (CeeD33Bee on YouTube). Charlie was one of the most active beta testers in our community and his feedback and suggestions have heavily influenced the state of the app as it is today. His positivity and happy attitude shone a bright light during the dark times of the pandemic and his enthusiasm brought many others to our community. Very sadly, Charlie died last year. We’ll always remember the impact he had on our community and hope to commemorate his contributions when MoveMusic is released. Here are a couple of Charlie’s performances: https://youtu.be/Pmv7dmRgSVg https://youtu.be/zHjEwZeU1QE
After we begin sales for the MoveMusic Control VR app, we hope to add more features including: - More 3D MIDI controls including physics based and generative MIDI tools - Undo/Redo - Workflow improvements - Deeper DAW integration for Ableton Live, Logic Pro, etc. If the sales of our MoveMusic VR app provide enough funding, we hope to create more music apps for XR devices. We have plans for: - A standalone music app targeting a wide audience. - A professional DAW app which allows linked transitioning between XR and PC, giving users the best of both interaction paradigms. - Continued development of our dedicated MIDI controller product for newer XR devices, leaning into AR (augmented reality), MR (mixed reality), and full-body tracking.