questions about Mocap-Drones bad accuracy

[wykisthebest]

I built a motion capture environment based on the code on github.Used 4 ps3 eye cameras and also carried out IR modification，as shown below。

I used an infrared lamp bead, as shown below

Front-end web pages can also be displayed.

In the Collect points for camera pose calibration step, I used the infrared lamp beads above to move in the space, capture about 5,000 points, and then perform calculations.

But the final calculation result is not very good.

I wonder if I missed any steps that caused this to happen?

[jyjblrd]

Hi,

The camera calibration can be a bit finicky sometimes, and you might need to do it a few times before getting a good calibration. A few tips are:

1. Make sure that your camera intrinsics in the camera_param.json file are correct
2. When collecting point for calibration, make sure that they you are moving the marker around in 3d space throughout the whole field of view of all the cameras
3. I've noticed that I got a better calibration when using less points, not sure why? The best results were when I only blinked my IR led in a few places around the room, and ran the calibration on these 20-30 points. Maybe the optimization algorithm isn't very good at rejecting outliers? That might be something to look into.
4. Make sure you don't accidentally move your camera after calibration! That might be what happened to make your 4th camera's epipolar line not line up with the point.
5. Play around with the optimizer's parameters to try find a loss function, ftol, or xtol that works better.

Hope that helps!

[wykisthebest]

Thank you so much for patiently answering my questions!

I will study the information you provided and attempt to implement it in my project. If I encounter any new challenges during the process, I will reach out to you again for guidance.

Once again, thank you for your support and guidance!

[jyjblrd]

Thats a strange error, are you sure that you havent edited anything in the code? maybe this is the issue: https://stackoverflow.com/a/339220/9776627

[muzilyd]

@jyjblrd I added init.py to the folder, but it didn't work

I annotated all sections in "index. py" that use serial, because I was unable to successfully determine which port the camera is using on a Windows computer, but I feel that this is not the reason for "no model named index"

[jyjblrd]

Try to clone the repo so there are no changes, and then edit the serial line to ser = None. Then run python3 api/index.py

[muzilyd]

@jyjblrd After I re cloned the repo, I found that test.py was no longer working.

However, I may have found a problem in the previous clone project. When I replaced "test.py" with "test1. py", I found that it had the same problem. However, I don't know how to modify the file "index. py" because it is originally called index.

[muzilyd]

@jyjblrd Thank you very much, I have solved this question, Although I don't know why, when I use "start debugging", the issue of "no model named index" appears. When I use "run without debugging", it succeeds and is displayed on the UI interface, as shown in the following figure. Thank you again for your open-source project. I have learned a lot from it. Then, I will continue to complete the remaining part.