Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请教一下,chinese llama不是用lora训练的吗,我怎么看用的黄色。 #47

Open
lyccol opened this issue Jul 10, 2023 · 1 comment

Comments

@lyccol
Copy link

lyccol commented Jul 10, 2023

image

@EliverQ
Copy link
Collaborator

EliverQ commented Jul 24, 2023

确实是使用了lora训练的,这里因为最初在整理的时候看到cheinses llama的时候看到他先进行了中文继续预训练,然后又指令微调,在指令微调的时候使用了lora,并不是只进行了轻量化微调,所以就没有标了;下次更新的时候我们会考虑修改一下这个地方。 谢谢您的提问!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants