Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase efficiency of IoU scores (#15) #129

Merged
merged 18 commits into from
Jul 18, 2022
Merged

Increase efficiency of IoU scores (#15) #129

merged 18 commits into from
Jul 18, 2022

Conversation

sprestrelski
Copy link
Member

@sprestrelski sprestrelski commented Jul 13, 2022

Closes #15. Uses matrix multiplication ($A \times B^T$, with A = manual labels, B = bot labels) to calculate the intersection, NumPy operations to calculate the union, then divides the intersection matrix by the union matrix. See timing benchmarks in the associated issue or in the Jupyter Notebook.

Dataset # clips Method orig (s) skip (s) lin-alg (s) lin-alg + skip (s)
Screaming Piha 11 clip_IoU (avg 10 trials) 426.38 280.62 128.25 10.14
Screaming Piha 11 automated_labeling_statistics() (avg 10 trials) 92.45 47.22 26.26 5.69
25% Mixed Bird 596 automated_labeling_statistics() - - 2221.1 337.7

JacobGlennAyers and others added 16 commits July 7, 2022 15:56
Shows how it was created as well.
…anges to isolation parameters (model and window_size parameters)
Updated simple_isolate function in IsoAutio.py to use numpy library instead of manually iterating through local_scores
Tested on both Performance_Tests notebook and PyHa_Tutorial notebook
Used numpy library to find starts and ends of clips, create annotations using the window size, and join annotations if necessary
Used similar rolled score technique to simple and steinberg isolate
Still has differences with original that will be fixed
@sprestrelski sprestrelski self-assigned this Jul 13, 2022
@sprestrelski sprestrelski merged commit fa91052 into main Jul 18, 2022
@sprestrelski sprestrelski deleted the performance-iou branch July 5, 2023 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Increase efficiency of IoU scores with Linear Algebra
3 participants