The Expression Orchestra

The Expression Orchestra is made up of four core elements: Performers, Instruments, Conductor, and Scores:

Performers are central – without them, the space remains silent. With them, a living composition emerges through movement, interaction, and collaboration.

Instruments are bespoke physical tools, each uniquely designed to suit a different mode of interaction – touch, motion, pressure, or gesture.

Conductor is the machine-learning powered audio engine that interprets intent and dynamically translates interactions into expressive musical responses.

Scores are adaptive musical frameworks – less like sheet music, more like responsive worlds – guiding the emotional and sonic character of the performance while allowing freedom and play.

Together, these elements transform space into a living, breathing composition and performance platform – open to everyone.

The Expression Orchestra was born from pyka’s early efforts to make our existing musical tools more accessible. In doing so, we discovered that retrofitting conventional instruments with accessibility features was fundamentally limiting. It often compromised the depth of engagement and expressiveness available to users with diverse needs. We also recognised that designing a single instrument to serve all users equally was an inherently flawed approach.

Instead, we developed The Expression Orchestra: a bespoke suite of alternative instruments that celebrates access through polyphony – not just in sound, but in interaction. Each instrument is tailored to a specific form of interaction or physical affordance, allowing users to express themselves through motion, gesture, touch, or pressure (and so on!) in ways that suit them best.

In 2024, we took the development of The Expression Orchestra even further with the development of Conductor – a machine learning audio engine that interprets and responds to users’ intent in real time. This machine learning-powered system enables instruments to deliver a much richer range of expressive musical outcomes, helping us honour users’ unique gestures with increasingly meaningful adaptive musical outputs.

The Expression Orchestra is rooted in an Access First design philosophy – and as a result of that, we’ve witnessed truly spontaneous musical collaboration emerge among groups with radically different needs and abilities. In one moment, a neurodivergent teenager, a non-verbal adult, and an elderly participant with mobility limitations were found performing together – each using a different instrument that was honouring their own way of interacting. There’s no need for explanation, instruction, or translation – the music just happens.

Another moment saw a septagenarian approach us to say that her physical direct interactions with the instruments in The Expression Orchestra had inspired her to sing along with the collaborative performance emerging in the room – something she hadn’t done in many years (as a retired choir singer) since losing the confidence to sing due to her ageing voice.

That kind of shared, immediate creativity between individuals with radically different needs is profoundly inspiring and it continues to motivate our efforts as we further develop The Expression Orchestra.