Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CMU-Mosei datasets #30

Open
yanzichuan opened this issue Nov 25, 2024 · 2 comments
Open

CMU-Mosei datasets #30

yanzichuan opened this issue Nov 25, 2024 · 2 comments

Comments

@yanzichuan
Copy link

I hope this message finds you well. Thank you for your excellent work on MARLIN and for sharing your valuable resources with the research community.

I am currently working on a project involving the CMU-MOSEI dataset and noticed that your work utilizes this dataset. I would like to ask if you could kindly provide the official download link or any guidance on where to access the CMU-MOSEI dataset.

Your support would be greatly appreciated, and I look forward to learning from your work. Thank you for your time and assistance.

@ControlNet
Copy link
Owner

I just checked their github and see their dataset looks not available currently. ecfm/CMU-MultimodalSDK#1

When downloading the dataset, you can find a csd file CMU_MOSEI_Labels.csd, and the Raw/Videos/Full/Combined/*.mp4 video files. These video files are processed with FaceXZoo to extract the facial video, then run MARLIN on it.

@yanzichuan
Copy link
Author

yanzichuan commented Dec 17, 2024

I have reproduced this MOSEI accuracy rate is only 75 %, very accurate on celebv, but why is it not accurate on the CMU-Mosei dataset ? Do you need to modify what configuration On cmumosei, the accuracy of each task is about 10 points worse. Please also guide you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants