Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can you offer some samples about manual attribute? #4

Open
fjchange opened this issue Oct 5, 2019 · 9 comments
Open

Can you offer some samples about manual attribute? #4

fjchange opened this issue Oct 5, 2019 · 9 comments

Comments

@fjchange
Copy link

fjchange commented Oct 5, 2019

I am wondering how you annote mannual attribute on the video, can you give me some hints?

@GayatriPurandharT
Copy link

I think UCF101 dataset come along with manual attribute description. I'm not sure of the format they used, in order to be used as semantic embeddings. I would like to know about it.

@devraj89
Copy link

devraj89 commented Oct 8, 2019

I believe UCF101 is available here: http://www.thumos.info/download.html
Regarding the attributes for the Olympic dataset, I think it was in some pdf file.
https://github.com/gzoumpourlis/olympic_sports_tools
The pdf is linked there.

@fjchange
Copy link
Author

Thanks, @devraj89 , there are the manual attributes, but what is word2vec attributes?

@GayatriPurandharT
Copy link

Is it possible to define manual attributes for the hmdb51 dataset? if yes, can you describe how?
Thank you very much.

@devraj89
Copy link

@fjchange the word2vec attributes are generated by sending the category names through the word2vec model.
@GayatriPurandharT I really do not know how the manual attributes were even constructed for the other two datasets. I just used the ones that were provided to us. Maybe you can ask the original authors regarding how they generated the attributes ? This might itself be a research topic.

@GayatriPurandharT
Copy link

GayatriPurandharT commented Oct 22, 2019

@devraj89 Thanks for your reply. I downloaded attributes provided by UCF101. Each action has got attributes with truth-value 0/1. Can I add a new action of my own? I would want to know how the video features and attributes have been merged into data_action/ucf101/split_1/att_splits.mat can. So that I train my own videos with new actions. Thanks

@devraj89
Copy link

@GayatriPurandharT regarding adding new action classes I am not sure. You have to figure out what the attributes should be. As I mentioned previously, contact the original authors of UCF101 dataset. They might be able to tell you on this more.

att_splits.mat --> for this please go through this paper : https://arxiv.org/abs/1712.00981 and the code: https://www.mpi-inf.mpg.de/departments/computer-vision-and-machine-learning/research/zero-shot-learning/feature-generating-networks-for-zero-shot-learning/ to understand how the .mat file was created.

To generate those files I had to write a separate code which I dont have access to right now.

@GayatriPurandharT
Copy link

@devraj89 Thanks a lot for the information. I will go through the code. Also, it would be really helpful if you publish the code to create .mat files for video files and attributes.

@prashastbindal
Copy link

prashastbindal commented Nov 11, 2020

@GayatriPurandharT : Were you able to create attributes file for UCF 101 ? If yes, can you please share it ? Please also share the code to create the files if you have it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants