Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I have some questions about training on VOC datasets #23

Open
lichong0 opened this issue Jul 3, 2024 · 5 comments
Open

I have some questions about training on VOC datasets #23

lichong0 opened this issue Jul 3, 2024 · 5 comments

Comments

@lichong0
Copy link

lichong0 commented Jul 3, 2024

During the training and testing processes of a generative model(The fifth step and the sixth step). Do both the val and test sets in the VOC dataset configs file need to be set to 'seen' or unseen ?
val=dict(
type=dataset_type,
ann_file=data_root + 'VOC2007/ImageSets/Main/val.txt',
img_prefix=data_root + 'VOC2007/',
classes_to_load='seen',
split=split,
pipeline=test_pipeline),
test=dict(
type=dataset_type,
ann_file=data_root + 'VOC2007/ImageSets/Main/test.txt',
img_prefix=data_root + 'VOC2007/',
split=split,
classes_to_load='seen',
pipeline=test_pipeline))

@sandipan211
Copy link
Owner

sandipan211 commented Jul 3, 2024

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

@lichong0
Copy link
Author

lichong0 commented Jul 3, 2024

When to set unsee categories,test?

@lichong0
Copy link
Author

lichong0 commented Jul 3, 2024

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

Are the settings the same for ZSD and GZSD?

@sandipan211
Copy link
Owner

When to set unsee categories,test?

In case of VOC especially, just keep it exactly the same as mentioned in this file.

@sandipan211
Copy link
Owner

sandipan211 commented Jul 3, 2024

In case of VOC, follow this config file. Both should be seen. It has been a while since I uploaded the codes, and I don't exactly remember why we kept them like this. Maybe we have hardcoded something in some intermediate file. But it is correct.

Are the settings the same for ZSD and GZSD?

For VOC dataset, ZSD/GZSD setting was ill-defined when we did this work. If you look at our paper, for VOC, we have just shown seen and unseen class results - nothing explicitly defined as ZSD/GZSD as in MSCOCO.

To summarize, for VOC we just did one experiment following previous works - just find the results separately on seen and unseen classes and report them. And that experiment shall be done following our command in step 6, replacing with voc related weight files and config files.

Please use the "zsd" flag for evaluation on VOC.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants