Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deprecate flush_logs_every_n_steps on Trainer #9366

Merged
merged 11 commits into from
Sep 14, 2021

Conversation

edward-io
Copy link
Contributor

@edward-io edward-io commented Sep 7, 2021

What does this PR do?

  • Deprecates flush_logs_every_n_steps
  • Moves flush_logs_every_n_steps init to individual loggers (only CSV logger has the ability to flush afaict)

Fixes #8991

Does your PR introduce any breaking changes? If yes, please list them.

Before submitting

  • Was this discussed/approved via a GitHub issue? (not for typos and docs)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you make sure to update the documentation with your changes? (if necessary)
  • Did you write any new necessary tests? (not for typos and docs)
  • Did you verify new and existing tests pass locally with your changes?
  • Did you list all the breaking changes introduced by this pull request?
  • Did you update the CHANGELOG? (not for typos, docs, test updates, or internal minor changes/refactorings)

PR review

Anyone in the community is welcome to review the PR.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

  • Is this pull request ready for review? (if not, please submit in draft mode)
  • Check that all items from Before submitting are resolved
  • Make sure the title is self-explanatory and the description concisely explains the PR
  • Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?

Make sure you had fun coding 🙃

@ananthsub ananthsub added the logger Related to the Loggers label Sep 7, 2021
@edward-io edward-io marked this pull request as ready for review September 8, 2021 08:00
@edward-io
Copy link
Contributor Author

I'm not sure why the doc tests are failing. There aren't any obvious error messages, only some warnings. Building them locally on a laptop works for me.

@awaelchli awaelchli added the deprecation Includes a deprecation label Sep 8, 2021
@awaelchli
Copy link
Contributor

I think that's because you commited submodule changes in _notebooks. Make sure to remove that again.

@awaelchli awaelchli added this to the v1.5 milestone Sep 8, 2021
@awaelchli
Copy link
Contributor

awaelchli commented Sep 8, 2021

TensorBoardLogger also has "flushing" implemented as part of save(). Can you add the argument there too? Save is what is called in the training loop when should_flush_logs=True. And on the summary writer for tensorboard there is also a flush method but we only call it in finalize(). So confusing. I guess it's good that this gets deprecated.

@codecov
Copy link

codecov bot commented Sep 9, 2021

Codecov Report

Merging #9366 (5fa4296) into master (ec828b8) will decrease coverage by 4%.
The diff coverage is 100%.

❗ Current head 5fa4296 differs from pull request most recent head e619ce1. Consider uploading reports for the commit e619ce1 to get more accurate results

@@           Coverage Diff           @@
##           master   #9366    +/-   ##
=======================================
- Coverage      93%     89%    -4%     
=======================================
  Files         180     179     -1     
  Lines       15066   14933   -133     
=======================================
- Hits        13991   13261   -730     
- Misses       1075    1672   +597     

pytorch_lightning/loggers/tensorboard.py Outdated Show resolved Hide resolved
pytorch_lightning/trainer/trainer.py Outdated Show resolved Hide resolved
@mergify mergify bot added the ready PRs ready to be merged label Sep 10, 2021
Copy link
Contributor

@rohitgr7 rohitgr7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Contributor

@tchaton tchaton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM !

@tchaton tchaton merged commit c784092 into Lightning-AI:master Sep 14, 2021
@Borda Borda changed the title deprecate flush_logs_every_n_steps on Trainer deprecate flush_logs_every_n_steps on Trainer Mar 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
deprecation Includes a deprecation logger Related to the Loggers ready PRs ready to be merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Deprecate flush_logs_every_n_steps on Trainer
5 participants