Mediapipe Hand Solution on Raspberry Pi to OSC to Modular CV / Gate

View this post on Instagram

A post shared by Sebastian Tomczak (@littlescale)

Setup: 

1. Set up a Raspberry Pi 4 with a clean install of Raspberry Pi OS: https://www.raspberrypi.com/software/ 
2. Install Mediapipe as per the instructions here: https://github.com/googlesamples/mediapipe/tree/main/examples/pose_landmarker/raspberry_pi
3. Install Python OSC on the Raspberry Pi: https://pypi.org/project/python-osc/ 
4. Add detect_osc_pi.py (https://github.com/little-scale/Tele-o-Module/blob/main/software/dectect_pi_osc.py) to mediapipe/examples/hand_landmarker/rasperry_pi
5. If using my Tele-o module (https://little-scale.blogspot.com/2023/01/tele-o-wifi-bluetooth-to-cv-gate.html) replace ip in detect_osc_pi.py with the address of the ESP32 in the module. 
6. If using a different OSC endpoint, replace ip in detect_osc_pi.py with the appropriate address. 
7. It may be beneficial to change the port variable in detect_osc_pi.py - the default is 3000
8. Pressing together or releasing the thumb and index finger sends a 1 or 0 on OSC path /gate/0
9. The distance between the thumb and index finger sends a float 0 - 1 on OSC path /cv/0
10. The X and Y co-ordinates of the index finger are sent as floats of 0 -1 on OSC paths /cv/1 and /cv/2
11. These OSC paths can be changed with the variables near the top of detect_osc_pi.py

Tele-o: WiFi / Bluetooth to CV / Gate Eurorack Module

 

I made a Eurorack module that accepts WiFi or Bluetooth signals and outputs CV / Gate. 

Download hardware and software files here: https://github.com/little-scale/Tele-o-Module