AirBending

AirBending, an innovative macOS app, transforms hand gestures into musical expression using computer vision and MIDI technology. It tracks hand movements in real-time using Apple’s Vision framework, detecting precise hand poses and finger positions.

The app maps hand gestures to musical controls in customizable ways. You can control pitch by moving your hands horizontally across different musical scales, while vertical movements control volume, modulation, or pitch bend. It supports multiple MIDI channels and control change assignments, making it compatible with digital audio workstations and external synthesizers.

AirBending offers a sophisticated preset system for creating and saving gesture-to-music mappings. You can assign different hands to control musical parameters, such as pitch with your right hand and effects or dynamics with your left hand. Alternatively, you can use one hand to control the filter in vertical movement and the resonance in horizontal movement. The app supports various musical scales in different keys, ensuring accurate note playback.

AirBending, a groundbreaking musical interface design, eliminates the physical barrier between musicians and instruments. Unlike traditional MIDI controllers that require touching keys, knobs, or faders, AirBending transforms the surrounding space into a musical instrument using only hand gestures and built-in Mac camera, without the need for additional hardware.

The music performer can play their keyboard and control two parameters without physical devices, expanding expressive possibilities. Even adventurous performers can play notes like a theremin.