【Hackathon No.113】 PR.md #4464
Merged
【Hackathon No.113】 PR.md #4464
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
【队名】：xd_no-bad 【序号】：113 【状态】：PR提交
|
Thanks for your contribution! |
RichardWooSJTU
pushed a commit
to RichardWooSJTU/docs
that referenced
this pull request
Apr 8, 2022
* update citation * update citation
liuTINA0907
reviewed
Apr 25, 2022
docs/eval/【Hackathon No.113】 PR.md
Outdated
| | :------------ | ---------- | --------------- | ------ | ------| | ||
| | 序号 | 核心步骤 | 完成情况（成功/不成功） | 遇到问题 |解决方法（无法解决请注明）| | ||
| | 1 | 导入分布式训练所需要的依赖包 | 完成 | 无 | 无 | | ||
| | 2 | 初始化分布式环境 | 完成 | paddlepaddle安装有时候会有一些问题、NCCL初始化有问题 | 使用export设置一些安装的库的环境变量 | |
There was a problem hiding this comment.
是否可以把NCCL初始化遇到的具体问题罗列出来？ 以及设置环境变量的解决方案。考虑后续更新改安装文档。谢谢！
liuTINA0907
reviewed
Apr 25, 2022
docs/eval/【Hackathon No.113】 PR.md
Outdated
| | 1 | 导入分布式训练所需要的依赖包 | 完成 | 无 | 无 | | ||
| | 2 | 初始化分布式环境 | 完成 | paddlepaddle安装有时候会有一些问题、NCCL初始化有问题 | 使用export设置一些安装的库的环境变量 | | ||
| | 3 | 设置分布式训练需要的优化器 | 完成 | 无 | 无 | | ||
| | 4 | 数据集拆分 | 完成 | 示例里面没有数据集的拆分案例，不会使用数据集的拆分；使用DistributedBatchSampler采样器之后DataLoader中无法指定batchsize以及shuffle参数 | 分析paddle的分布式API底层以及结合其他深度学习框架分析，发现了DistributedBatchSampler API，然后分析其底层实现，发现可以应用；分析DataLoader底层的源码，发现在指定batch_sampler参数之后不能指定batchsize、shuffle以及drop_last参数，然后在DistributedBatchSampler构建采样器的过程中指定 | |
There was a problem hiding this comment.
这里可以提供下您分析后的分布式数据集拆分案例和详细介绍。
|
已回复并且在pr中已修改 |
|
@xymyeah 请review下~ |
xymyeah
approved these changes
May 16, 2022
TCChenlong
approved these changes
May 16, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
【队名】：xd_no-bad
【序号】：113
【状态】：PR提交