Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Rewrite the SRT Backend docs #2660

Open
2 tasks done
zhaochenyang20 opened this issue Dec 30, 2024 · 2 comments
Open
2 tasks done

[Feature] Rewrite the SRT Backend docs #2660

zhaochenyang20 opened this issue Dec 30, 2024 · 2 comments
Assignees
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed RLHF Using SGLang for post training

Comments

@zhaochenyang20
Copy link
Collaborator

Checklist

Motivation

This doc has been outdated for a long time:

https://sgl-project.github.io/backend/backend.html#backend-sglang-runtime-srt

  1. Only keep an explanation for server arguments and give the link to sampling parameters.
  2. Add essential explanation for server arguments. Remember to add these kinds of arguments. https://lmsys.org/blog/2024-12-04-sglang-v0-4/#data-parallelism-attention-for-deepseek-models
  3. A group of parameters have ##, ### is not allowed.
  4. Use Models From ModelScope and Run Llama 3.1 405B move to reference, and potentially adds docs for deepseek.
  5. change main readme.md.

Related resources

No such.

@zhaochenyang20 zhaochenyang20 added documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed labels Dec 30, 2024
@zhaochenyang20 zhaochenyang20 self-assigned this Dec 30, 2024
@zhaochenyang20 zhaochenyang20 added the RLHF Using SGLang for post training label Dec 30, 2024
@simveit
Copy link

simveit commented Jan 1, 2025

I can take this @zhaochenyang20

@zhaochenyang20
Copy link
Collaborator Author

@simveit Thanks so much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed RLHF Using SGLang for post training
Projects
None yet
Development

No branches or pull requests

2 participants