In order to keep my kids doing exercise during the shelter-in-place order, we started playing Nintendo Ring Fit Adventure. Thanks a lot Nintendo 👍 !
It is an awesome exercise based game. However, after three months and leveling up over 200, the kids started losing interest.
We moved on to play Mario & Sonic at the Olympic Games Tokyo 2020 and Yoshi's Crafted World. Unfortunately, these games are not exercise based and only some sport events support motion control. In particular, my 3 yr old kid's finger is not developed enough to play with the key pad.
So this hack is created, for converting games into motion controllable one for small kids.
- Nvidia Jetson NX
- Logitech C920 at 30fps
- Nintendo Switch
-
TensorRT Pose Estimation https://github.com/NVIDIA-AI-IOT/trt_pose
-
Joycontrol https://github.com/mart1nro/joycontrol
-
Jupyter Notebook
- Install trt_pose from https://github.com/NVIDIA-AI-IOT/trt_pose
- Install joycontrol from https://github.com/mart1nro/joycontrol
- Clone this repo
- Download this weights resnet18_baseline_att_224x224_A (81MB) and save it in the trt_pose folder
- Install jupyter
- Open trt_pose/live_demo_karate.ipynb with jupyter notebook and follow the notes
- Start joycontrol tcp server with
sudo python3 joycontrol/run_controller_server.py
OR
sudo python3 joycontrol/run_controller_server.py PRO_CONTROLLER -r <your Switch's BLE MAC address>