Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] add base model evaluation #2490

Merged
merged 19 commits into from
Sep 25, 2024
Merged

[CI] add base model evaluation #2490

merged 19 commits into from
Sep 25, 2024

Conversation

zhulinJulia24
Copy link
Collaborator

@zhulinJulia24 zhulinJulia24 commented Sep 20, 2024 •
edited
Loading

  1. add base model evaluation

split eval config into chat and base
split eval workflow into chat and base

  1. react chat evaluation config file to make it more easy to maintain and add internlm2.5 7b chat batch1 config
  2. add offline mode in evaluation workflow

the newest test workflow https://github.com/zhulinJulia24/lmdeploy/actions/runs/10993092563/job/30558208751

https://github.com/zhulinJulia24/lmdeploy/actions/runs/11007326237

@lvhan028 lvhan028 merged commit 2c71f27 into InternLM:main Sep 25, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lvhan028 lvhan028 lvhan028 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zhulinJulia24 @lvhan028