Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature] release of data-juicer model checkpoints in huggingface format #48

Closed
yxdyc opened this issue Oct 27, 2023 · 0 comments · Fixed by #54
Closed

[feature] release of data-juicer model checkpoints in huggingface format #48

yxdyc opened this issue Oct 27, 2023 · 0 comments · Fixed by #54
Assignees
Labels
enhancement New feature or request

Comments

@yxdyc
Copy link
Collaborator

yxdyc commented Oct 27, 2023

Our reference models pre-trained by Data-Juicer are in Megatron format, we provide their download links as follows:

Plz @zhijianma paste the below links later.

Now, we are converting them into huggingface format, and will upload them in ModelScope and huggingface hub.

@yxdyc yxdyc converted this from a draft issue Oct 27, 2023
@yxdyc yxdyc self-assigned this Oct 27, 2023
@yxdyc yxdyc added the enhancement New feature or request label Oct 27, 2023
@yxdyc yxdyc changed the title [feature] release of data-juicer model checkpoints in hugging-face format [feature] release of data-juicer model checkpoints in huggingface format Oct 27, 2023
@zhijianma zhijianma moved this from Todo to Done in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from Done to In Progress in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from In Progress to Done in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from Done to In Progress in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from In Progress to Done in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from Done to In Progress in data-juicer Nov 1, 2023
@zhijianma zhijianma pinned this issue Nov 1, 2023
@zhijianma zhijianma unpinned this issue Nov 1, 2023
@zhijianma zhijianma pinned this issue Nov 1, 2023
@zhijianma zhijianma unpinned this issue Nov 1, 2023
@zhijianma zhijianma linked a pull request Nov 1, 2023 that will close this issue
@zhijianma zhijianma moved this from In Progress to Done in data-juicer Nov 1, 2023
@zhijianma zhijianma moved this from Done to In Progress in data-juicer Nov 1, 2023
@github-project-automation github-project-automation bot moved this from In Progress to Done in data-juicer Nov 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants