Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix llama2_70b_lora broken link for Accelerate config file in the readme #766

Merged

Conversation

hiwotadese
Copy link
Contributor

No description provided.

@hiwotadese hiwotadese requested a review from a team as a code owner September 19, 2024 17:16
Copy link

MLCommons CLA bot:
Thank you very much for your submission, we really appreciate it. Before we can accept your contribution, we ask that you sign the MLCommons CLA (Apache 2). Please use this [Google form] (https://forms.gle/Ew1KkBVpyeJDuRw67) to initiate authorization. If you are from an MLCommons member organization, we will request that you be added to the CLA. If you are not from a member organization, we will email you a CLA to sign. For any questions, please contact support@mlcommons.org.
0 out of 1 committers have signed the MLCommons CLA.
@Hiwot Kassa
Hiwot Kassa seems not to be a GitHub user. You need a GitHub account after you become MLCommons member. If you have already a GitHub account, please add the email address used for this commit to your account.
You can retrigger this bot by commenting recheck in this Pull Request

@ShriyaPalsamudram
Copy link
Contributor

@hiwotadese can you also set gradient_clipping: 0.3 in the config?
Details are in #765

@hiwotadese
Copy link
Contributor Author

@ShriyaPalsamudram the config file here https://github.com/mlcommons/training/blob/master/llama2_70b_lora/configs/default_config.yaml already have the gradient_clipping: 0.3

@hiwotadese
Copy link
Contributor Author

recheck

@ShriyaPalsamudram ShriyaPalsamudram merged commit 1c1c619 into mlcommons:master Oct 17, 2024
1 of 3 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Oct 17, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants