Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implementing batdetect2 #334

Closed
kdarras opened this issue Mar 23, 2023 · 7 comments · Fixed by #406
Closed

implementing batdetect2 #334

kdarras opened this issue Mar 23, 2023 · 7 comments · Fixed by #406
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@kdarras
Copy link

kdarras commented Mar 23, 2023

We are currently testing different bat classifiers and it is likely that we will choose to implement batdetect2 on ecoSound-web, similarly to how BirdNET was implemented:

  • dependencies should be installed
  • batdetect2 should be integrated into the models table, which should be expanded to make future model addition as sustainable (easily expandable and adaptable) as possible (details to discuss)
  • batdetect2 should be chosen from the drop-down menu that appears when clicking on "Tensorflow models", which should be renamed to "Classifiers", and the documentation icon should link to the GitHub repository
  • the parameters specific to batdetect2 should appear in the window, and left at their default values if nothing is entered
  • the results should be saved as new tags, and non-matched species names should be inserted inside the comment
@kdarras kdarras converted this from a draft issue Mar 23, 2023
@kdarras kdarras added the enhancement New feature or request label Mar 23, 2023
@kdarras kdarras moved this from To do to In progress in Sound detection Nov 16, 2023
@kdarras
Copy link
Author

kdarras commented Nov 16, 2023

Batdetect2 runs suspiciously fast but outputs no tags with local test files for which I usually got lots of detections.

Input of confidence thresholds between 0 and 1 (this is the original range accepted by batdetect2) should be allowed instead of 0.1 to 1.

For instance, this recording:
https://ecosound-web.de/ecosound_web/recording/show/523954
has 24 tags inside, all generated with batdetect2 at a threshold of 0.1 (all other recordings contain tags that were generated offline with batdetect2 and may be used for testing purposes).

@LiuDilongNJ
Copy link
Collaborator

BatDetect2 didn't detect the ogg file in the path, I've modified it and generated the label successfully.

@kdarras
Copy link
Author

kdarras commented Nov 17, 2023

it should run on the WAV file

@kdarras
Copy link
Author

kdarras commented Nov 17, 2023

I ran the update code:
sudo git reset --hard origin/branch-name sudo sh install.sh sudo sh run.sh
Uploaded three ~125 MB FLAC files containing numerous bat calls. When I leave the confidence threshold parameter empty, I get an error
image

When I enter a very low threshold (0.01), I get no detections at all.

Note: it is not necessary to reload the page when no detections are found.

@kdarras
Copy link
Author

kdarras commented Nov 17, 2023

I converted one of the FLAC files to a WAV and added it to the same collection to run batdetect2 on it. Now it works, even with these large files!

batdetect2 should run on the WAV file only. It won't work with any other audio format.

@LiuDilongNJ
Copy link
Collaborator

It works with all formats of audio, I've finished it but haven't uploaded it yet, I'm fixing other problems.

@kdarras
Copy link
Author

kdarras commented Nov 21, 2023

Works in Docker.
However, there is no feedback to the user after executing a model from the admin interface. Please add a popup message "Model running on [recording name] in background" (same style as when we upload recordings), since you have already implemented this :)

@LiuDilongNJ LiuDilongNJ linked a pull request Nov 24, 2023 that will close this issue
@kdarras kdarras closed this as completed Nov 24, 2023
@github-project-automation github-project-automation bot moved this from In progress to Done in Sound detection Nov 24, 2023
@kdarras kdarras added this to the F1000 v3 milestone Aug 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants