first draft of token usage in QA #192
Conversation
Deploying llphant with
|
| Latest commit: |
344dd7f
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://5676a38f.llphant.pages.dev |
| Branch Preview URL: | https://count-token-qa.llphant.pages.dev |
src/Chat/ChatInterface.php
Outdated
| @@ -35,4 +35,6 @@ public function setFunctions(array $functions): void; | |||
| public function addFunction(FunctionInfo $functionInfo): void; | |||
|
|
|||
| public function setModelOption(string $option, mixed $value): void; | |||
|
|
|||
| public function getTotalTokens(): int; | |||
There was a problem hiding this comment.
I'm not sure if it is a good thing to pollute the ChatInterface with this method that is specific to OpenAI
There was a problem hiding this comment.
@f-lombardo in the futur, all models will provide a way to retrieve the number of tokens used no?
There was a problem hiding this comment.
We already could get the number of tokens with Anthropic. I don't see how to get this value with Ollama and I'm not sure this will be available any time soon.
There was a problem hiding this comment.
Ok. So what about using method_exists to check if getTotalTokens exist and if not raise an exception. Sound good to you @f-lombardo
There was a problem hiding this comment.
Do you mean in the QuestionAnswering class? I think it could be a good option.
MaximeThoonsen
force-pushed
the
count-token-qa
branch
from
1696b27
to
344dd7f
Compare
No description provided.