Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support DDP Evaluation for IS and FID #151

Merged
merged 6 commits into from
Nov 23, 2021

Conversation

LeoXing1996
Copy link
Collaborator

@LeoXing1996 LeoXing1996 commented Oct 30, 2021

  • slurm_eval.sh
  • Update quick_run.md

@nbei nbei requested a review from plyfager November 1, 2021 16:33
mmgen/core/evaluation/evaluation.py Show resolved Hide resolved

def parse_args():
parser = argparse.ArgumentParser(description='Evaluate a GAN model')
parser = argparse.ArgumentParser(description='Evaluate a Generation model')
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may also need to change the related docs to inform this feature.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

quick_run.md is updated.

rank, _ = get_dist_info()
rank, world_size = get_dist_info()
cfg.gpu_ids = range(world_size)
assert args.online or world_size == 1, (
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why offline mode cannot be supported in DDP?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Offline mode now supports DDP!

tools/evaluation.py Outdated Show resolved Hide resolved
@LeoXing1996 LeoXing1996 requested a review from nbei November 3, 2021 14:10
@LeoXing1996 LeoXing1996 requested a review from plyfager November 12, 2021 09:31
@nbei nbei merged commit f68025c into open-mmlab:master Nov 23, 2021
LeoXing1996 added a commit that referenced this pull request Jul 16, 2022
* support dist eval for IS and FID

* support offline mode with DDP

* update readme and script for slurm

* fix bug in log print

* fix bug in image saving

* fix bug of log display in offline evaluation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants