We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ETA: Oct. 15th (Sun) Oct 16th (Mon).
TBD
echo
TORCH_CUDA_ARCH_LIST
repetition_penalty
The text was updated successfully, but these errors were encountered:
Bump up the version to v0.2.1
55d4747
Release tracker: #1346
Successfully merging a pull request may close this issue.
ETA:
Oct. 15th (Sun)Oct 16th (Mon).Major changes
TBD
PRs to be merged before the release
echo
Implement prompt logprobs & Batched topk for computing logprobs #1328 Supporting log probabilities of prompt tokens in both engine and OpenAI API server (akaecho
) #959TORCH_CUDA_ARCH_LIST
err msg Fix error message onTORCH_CUDA_ARCH_LIST
#1239Support YaRN YaRN support implementation #1264 YaRN tests #1161(Deferred)Add(Deferred)repetition_penalty
sampling parameter Add repetition_penalty aligned with huggingface #866The text was updated successfully, but these errors were encountered: