Skip to content
This repository has been archived by the owner on Oct 19, 2024. It is now read-only.

[Example] Fine tune OPT with 3d parallelism #716

Merged
merged 8 commits into from
Sep 25, 2022
Merged

[Example] Fine tune OPT with 3d parallelism #716

merged 8 commits into from
Sep 25, 2022

Conversation

merrymercy
Copy link
Member

@merrymercy merrymercy commented Sep 25, 2022

Update the opt fine-tuning example to use 3d parallelism

@merrymercy merrymercy changed the title [Example] Fine tune opt with 3d parallelism [Example] Fine tune OPT with 3d parallelism Sep 25, 2022
@merrymercy merrymercy merged commit a178d64 into main Sep 25, 2022
@merrymercy merrymercy deleted the opt-pp branch September 25, 2022 18:22
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant