Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GraphLearn-for-PyTorch(GLT) distributed examples #7402

Merged
merged 70 commits into from
Aug 4, 2023
Merged
Changes from 1 commit
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
f6dc0ed
Add GLT dist example
HuxleyHu98 May 19, 2023
714caf8
Merge branch 'pyg-team:master' into glt2pyg
husimplicity May 19, 2023
2422afc
refine docs
HuxleyHu98 May 19, 2023
8ff83f3
Merge branch 'glt2pyg' of https://github.com/husimplicity/pytorch_geo…
HuxleyHu98 May 19, 2023
0212ce0
minor
HuxleyHu98 May 21, 2023
6a531fe
minor
HuxleyHu98 May 22, 2023
75534b5
Merge branch 'pyg-team:master' into glt2pyg
husimplicity May 22, 2023
f8c6723
Merge branch 'glt2pyg' of https://github.com/husimplicity/pytorch_geo…
HuxleyHu98 May 22, 2023
05a2a95
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 22, 2023
4bf8f7b
minor
HuxleyHu98 May 25, 2023
6e1072f
minor
HuxleyHu98 May 25, 2023
af6413d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 25, 2023
a8e7c15
add papers100m cmd example
HuxleyHu98 May 25, 2023
7d09685
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 25, 2023
a757858
minor
HuxleyHu98 May 25, 2023
3367a76
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 25, 2023
54a871b
Merge branch 'pyg-team:master' into glt2pyg
husimplicity May 30, 2023
5cafdd6
Merge branch 'master' into glt2pyg
husimplicity Jun 1, 2023
9ab42bb
Merge branch 'master' into glt2pyg
husimplicity Jun 2, 2023
8d30a69
Merge branch 'master' into glt2pyg
husimplicity Jun 6, 2023
2753ed3
Merge branch 'master' into glt2pyg
husimplicity Jun 7, 2023
ea9aa82
Merge branch 'pyg-team:master' into glt2pyg
husimplicity Jun 13, 2023
5aa23ed
Merge branch 'master' into glt2pyg
husimplicity Jun 14, 2023
16724be
Merge branch 'master' into glt2pyg
husimplicity Jun 16, 2023
5396bec
Merge branch 'master' into glt2pyg
husimplicity Jun 19, 2023
2989b42
Merge branch 'master' into glt2pyg
husimplicity Jun 20, 2023
b4c61c4
Merge branch 'master' into glt2pyg
husimplicity Jun 26, 2023
8f9983e
Merge branch 'pyg-team:master' into glt2pyg
husimplicity Jun 27, 2023
7af3ede
Merge branch 'master' into glt2pyg
husimplicity Jun 28, 2023
aef296e
adjust directory structure to dist/glt
HuxleyHu98 Jun 28, 2023
1afe595
minor
HuxleyHu98 Jun 28, 2023
72821a5
Update README.md
husimplicity Jun 29, 2023
0bd075a
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 29, 2023
0aef26c
Merge branch 'master' into glt2pyg
husimplicity Jun 29, 2023
8b93d25
style
HuxleyHu98 Jun 30, 2023
74f7091
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 30, 2023
341e6bf
style
HuxleyHu98 Jun 30, 2023
39eaabd
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 30, 2023
08ccf94
add changelog
HuxleyHu98 Jun 30, 2023
3522383
Merge branch 'glt2pyg' of https://github.com/husimplicity/pytorch_geo…
HuxleyHu98 Jun 30, 2023
9e2bfd4
Merge branch 'master' into glt2pyg
husimplicity Jul 3, 2023
d3181dc
Merge branch 'master' into glt2pyg
husimplicity Jul 4, 2023
9082523
Merge branch 'master' into glt2pyg
husimplicity Jul 5, 2023
2e86235
Merge branch 'master' of https://github.com/husimplicity/pytorch_geom…
HuxleyHu98 Jul 6, 2023
f8c1f5c
Merge branch 'master' into glt2pyg
husimplicity Jul 10, 2023
632789d
Merge branch 'glt2pyg' of https://github.com/husimplicity/pytorch_geo…
HuxleyHu98 Jul 10, 2023
817e7ef
Update documentations
HuxleyHu98 Jul 10, 2023
4e1ae67
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 10, 2023
6217ad4
Merge branch 'master' into glt2pyg
husimplicity Jul 13, 2023
f1f1635
minor
HuxleyHu98 Jul 14, 2023
4c66267
Merge branch 'master' into glt2pyg
husimplicity Jul 17, 2023
2d3d22e
update
HuxleyHu98 Jul 17, 2023
fcf7c46
Merge branch 'master' into glt2pyg
husimplicity Jul 18, 2023
c4cdc26
Merge branch 'master' into glt2pyg
husimplicity Jul 19, 2023
93ff1d4
Merge branch 'master' into glt2pyg
husimplicity Jul 19, 2023
df2764f
Merge branch 'master' into glt2pyg
husimplicity Jul 20, 2023
3ecdc02
Merge branch 'master' into glt2pyg
husimplicity Jul 20, 2023
d19ad8f
Merge branch 'master' into glt2pyg
husimplicity Jul 24, 2023
1d47ef2
Merge branch 'master' into glt2pyg
husimplicity Aug 1, 2023
0edc888
Merge branch 'master' into glt2pyg
husimplicity Aug 1, 2023
958a736
Merge branch 'master' into glt2pyg
husimplicity Aug 1, 2023
161e51e
Merge branch 'master' into glt2pyg
husimplicity Aug 3, 2023
48ee10f
Merge branch 'master' into glt2pyg
husimplicity Aug 3, 2023
45d1797
Merge branch 'master' into glt2pyg
husimplicity Aug 3, 2023
a6a7d06
Merge branch 'master' into glt2pyg
husimplicity Aug 3, 2023
8113ece
Merge branch 'master' into glt2pyg
husimplicity Aug 4, 2023
4cc37f3
update
rusty1s Aug 4, 2023
4d330cd
update
rusty1s Aug 4, 2023
55df5e8
update
rusty1s Aug 4, 2023
eca1a87
Merge branch 'master' into glt2pyg
rusty1s Aug 4, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
minor
  • Loading branch information
HuxleyHu98 committed May 22, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
commit 6a531fefc472cf3f34dd3fc92d828c50d4933e11
4 changes: 2 additions & 2 deletions examples/graphlearn_for_pytorch/distributed/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Distributed (multi nodes) examples.

This example shows how to leverage [GraphLearn-for-PyTorch(GLT)](https://github.com/alibaba/graphlearn-for-pytorch) to train PyG models in distributed scenarios. The dataset in this example is `ogbn-products` from the [Open Graph Benchmark](https://ogb.stanford.edu/) and you can also train on `ogbn-papers100M` with minor modifications of the configuration file.
This example shows how to leverage [GraphLearn-for-PyTorch(GLT)](https://github.com/alibaba/graphlearn-for-pytorch) to train PyG models in distributed scenarios with GPUs. The dataset in this example is `ogbn-products` from the [Open Graph Benchmark](https://ogb.stanford.edu/) and you can also train on `ogbn-papers100M` with minor modifications of the configuration file.

To run this distributed example, you can choose to direct run the example or use our [script](launch.py) following the guidance below.

@@ -72,7 +72,7 @@ An example template for configure file is in the yaml format. e.g.
nodes:
- 0.0.0.0
- 1.1.1.1
# ssh IP ports for each node.
# ssh ports for each node.
ports: [22, 22]
# username for remote IPs.
usernames: