New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about GPU memory usage #33

Open

wangwang-xyz opened this issue Nov 26, 2024 · 1 comment

wangwang-xyz commented Nov 26, 2024

Thanks for sharing this excellent work！
Here are two questions:

I tried to train re10k_dl3dv_512x512 on an A6000 and got CUDA out of memory error even though batch_size was set to 1. How much GPU memory is needed for this training condition?
It seems two datasets will lead to batch_size*2. How to avoid this problem? (like random choose dataset while training)

ShuzhaoXie commented Nov 28, 2024

Thanks for sharing this excellent work！ Here are two questions:

I tried to train re10k_dl3dv_512x512 on an A6000 and got CUDA out of memory error even though batch_size was set to 1. How much GPU memory is needed for this training condition?

It seems two datasets will lead to batch_size*2. How to avoid this problem? (like random choose dataset while training)

Could you please tell me the minimal requirement of CUDA memory for testing re10k_dl3dv_512x512? Thank you very much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment