Setting the output tokens to more than the default 100 #936
orangeelephant2013
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I am kicking the tires with Bling-Phi3 and I see that the default output tokens are limited to 100, so the output is getting truncated. How can I change and control the number of tokens for the output and response? Thank you
Beta Was this translation helpful? Give feedback.
All reactions