Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

微调结果不收敛是什么原因? #57

Open
xuji755 opened this issue May 8, 2023 · 0 comments
Open

微调结果不收敛是什么原因? #57

xuji755 opened this issue May 8, 2023 · 0 comments

Comments

@xuji755
Copy link

xuji755 commented May 8, 2023

从理论上觉得使用CHATGLM+PTUNING来做领域知识问答是可行的。不过我最近做了一些测试,发现我的微调结果不收敛,微调样本产生的效果不佳。不知道是我的方法有问题还是我微调样本太少。
目前我针对数据库服务器CPU使用率过高的一个单一问题,做了差不多1000个训练样本。不过从目前的训练效果来看,依然不是很好。请教一下,这方面有什么技巧吗?我是个新手,请多指教。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant