Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removed dataflow sync from Engine #938

Merged
merged 2 commits into from
Apr 18, 2020

Conversation

vfdev-5
Copy link
Collaborator

@vfdev-5 vfdev-5 commented Apr 18, 2020

Description:
PR (1/3) to that splits #895

  • Removed dataflow sync from Engine

  • Added new engine events (used with deterministic methods)

    • DATALOADER_STOP_ITERATION : engine's specific event triggered when dataloader has no more data to provide

    • TERMINATE_SINGLE_EPOCH : triggered when the run is about to end the current epoch,
      after receiving :meth:~ignite.engine.Engine.terminate_epoch() call.

    • TERMINATE : triggered when the run is about to end completely,
      after receiving :meth:~ignite.engine.Engine.terminate() call.

Check list:

  • New tests are added (if a new feature is added)
  • New doc strings: description and/or example code are in RST format
  • Documentation is updated (if required)

- added deterministic methods
- Fixed pytorch#818
- Fixed pytorch#795
@vfdev-5 vfdev-5 requested a review from sdesrozis April 18, 2020 14:20
@vfdev-5 vfdev-5 changed the base branch from master to new_engine April 18, 2020 14:52
pass


def _repr_rng_state(rng_states):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need this function ?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be helpful to debug random state

Copy link
Contributor

@sdesrozis sdesrozis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Huge and awesome work :)

Engine is simplier, that's nice. IMO, do not deal with local seeds but with global and uniform strategy is a good way !

@sdesrozis sdesrozis merged commit 8fb5edd into pytorch:new_engine Apr 18, 2020
@vfdev-5 vfdev-5 deleted the new_engine_p1 branch April 18, 2020 16:05
vfdev-5 added a commit that referenced this pull request Apr 28, 2020
* Removed dataflow sync from Engine (#938)

- added deterministic methods
- Fixed #818
- Fixed #795

* Added DeterministicEngine (#939)

* Fixed broken GPU test

* Update examples and docs (#957)

* Added DeterministicEngine

* [WIP] Update examples

* Fixes #941 for deterministic engine
- added tests for both engines

* Update examples/mnist/mnist_save_resume_engine

* Updated mnist example, fixed minor bug in deterministic

* autopep8 fix

* Updated cifar10 docs
+ minor cosmetics

* autopep8 fix

* Cosmetics x

* Commented results for single node, multi-gpus

* Fixed mnist_save_resume_engine smoke tests

Co-authored-by: AutoPEP8 <>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants