Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Running into GPU out-of-memory issue during pretraining. Any suggestions to reduce GPU memory usage? #17

Open
sythello opened this issue Oct 31, 2020 · 0 comments
Open

Running into GPU out-of-memory issue during pretraining. Any suggestions to reduce GPU memory usage? #17

sythello opened this issue Oct 31, 2020 · 0 comments

Comments

@sythello
Copy link

sythello commented Oct 31, 2020 •
edited
Loading

As title.
By the way, I saw there is an argument empty-cache-freq, would decreasing that help? What would be the side effects of decreasing it?

Any inputs are appreciated. Thanks!
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sythello