fbpx
Skip to main content

MIDI Forum

MIDI 3.0 AI Hand Tr...
 
Notifications
Clear all

MIDI 3.0 AI Hand Tracking Thoughts

2 Posts
2 Users
0 Reactions
4,923 Views
Carl Guyenette
Posts: 1
New Member
Topic starter
 

Just thought this could inspire the future of MIDI so I wanted to share.

Full-tracking of fingers and digits in the air with just your webcam utilising the wonder of AI.
If using overlapping cameras with a wider FOV greater accuracy and space to perform can be achieved. Averaging and smoothing of the data points would help give it the right feel.

Future MIDI products could be consisting of cameras and depth sensors.

Try it out!:
https://codepen.io/mediapipe/pen/RwGWYJw

 
Posted : 12/06/2021 1:01 am
Mike Kent
Posts: 86
Trusted Member
 

Cool idea.

Did you see this?:
https://www.midi.org/midi-articles/ar-pianist-combines-midi-and-ai-to-create-virtual-piano-performances-in-your-home

Oh, and by the way, this can be done with MIDI 1.0 or MIDI 2.0.
Let's not talk about MIDI 3.0 until MIDI 2.0 has been out for a while. 😀

Mike.

Chair of MIDI 2.0 Working Group

 
Posted : 14/06/2021 1:29 pm
Share: