fix error reported 'find_unused_parameters' running in mutiple GPUs

[jiaqiw09]

What does this PR do?

Fixes #5354

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a Github issue or the forum? Please add a link to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings. not required
• Did you write any new necessary tests? not required

Who can review?

@DN6 @patrickvonplaten

[jiaqiw09]

@DN6 @patrickvonplaten

In this PR, I just change files related to UT cases I mentioned in issue.
If you think it is a suitable solution and it's necessary to add those codes to all train files in example folder, feel free to comment this PR.

Best wishes

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[jiaqiw09]

@DN6 hi, I just check the 'Run code quality checks ', and the problem maybe the this line

from accelerate.utils import ProjectConfiguration, set_seed, DistributedDataParallelKwargs

if I use isort module to do some fix, it turns to

from accelerate.utils import (DistributedDataParallelKwargs,
                              ProjectConfiguration, set_seed)

However, I use isort to check file train_text_to_image_lora_sdxl.py and train_dreambooth_lora_sdxl.py, there are mutiple lines are fixed by isort module. As I can't do entire test locally, would you mind having a look?

• If I only need change from accelerate.utils import ProjectConfiguration, set_seed, DistributedDataParallelKwargs, I can submit an commit quickly.
• Or I need to change all reported format error by isort module.

Best

[jiaqiw09]

@DN6 Hi,I am sorry for the inconvenience. I just push a new commit trying to solve code-check problem. Would you mind having a look? And if there are other problems, I can fix it quickly.

Best

[jiaqiw09]

@patrickvonplaten Hi, I am sorry for the inconvenience. Would you mind having a check again?

Best

[patrickvonplaten]

Also a gentle ping to @SunMarc , do you think using the DistributedKwargs makes sense here?

[sayakpaul]

Looks good to me, thank you! But I defer to @SunMarc for the final go ahead here.

[SunMarc]

LGTM @jiaqiw09 ! Don't forget to run make style. Yes this is how you can pass kwargs related to DDP when using accelerate @patrickvonplaten .

[jiaqiw09]

@patrickvonplaten @sayakpaul @SunMarc

thanks all for your review. I just do not notice that checks has passed 3 hours ago so i just merge latest main branch into my own branch and make a new commit and push to solve codecheck probelm. i hope it will not be a problem.

best

[sayakpaul]

Thank you for your contributions!