Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature extraction #1

Closed
3 of 5 tasks
Veldhoen opened this issue Aug 22, 2023 · 3 comments · Fixed by #11
Closed
3 of 5 tasks

Feature extraction #1

Veldhoen opened this issue Aug 22, 2023 · 3 comments · Fixed by #11
Assignees
Labels

Comments

@Veldhoen
Copy link
Member

Veldhoen commented Aug 22, 2023

Apply code by Teng:

Input: keyframes + audio spectograms
Output: binarized feature matrix

  • Preprocess keyframes & spectograms
  • Load in pretrained model from model files
  • Apply pretrained model on data
  • Binarize resulting feature matrix (C++ rather than Python). Teng will provide an example matrix for testing this bit in isolation.
  • Use GPU for processing
@Veldhoen Veldhoen added the VisXP label Sep 26, 2023
@Veldhoen Veldhoen self-assigned this Oct 9, 2023
@Veldhoen
Copy link
Member Author

Veldhoen commented Oct 9, 2023

First steps have been implemented (in a rudimentary way).
Applying the model fails on dimensionality issues. Teng is now looking into the dimensionality of the representations that come out of worker 1, that do not seem to match the expectations.

@Veldhoen Veldhoen changed the title Feature extraction (needs refinement) Feature extraction Oct 9, 2023
@Veldhoen
Copy link
Member Author

Binarization moved to separate issue, nice to have

@Veldhoen
Copy link
Member Author

GPU moved to separate issue, requires installation etc.

@jblom jblom linked a pull request Oct 19, 2023 that will close this issue
@jblom jblom closed this as completed in #11 Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant