Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add cost property to agents #614

Closed
ezpzzz19 opened this issue Nov 9, 2023 · 9 comments
Closed

add cost property to agents #614

ezpzzz19 opened this issue Nov 9, 2023 · 9 comments

Comments

@ezpzzz19
Copy link

ezpzzz19 commented Nov 9, 2023

users should be able to fetch the price from each agent involved in their chat.

@sonichi
Copy link
Contributor

sonichi commented Nov 10, 2023

@kevin666aa for you to consider adding this functionality back in v0.2

@miiiz
Copy link

miiiz commented Nov 21, 2023

just curious about the reason why cost functionality is removed in v0.2. thx.

@afourney
Copy link
Member

@kevin666aa An ideal implementation (to support analysis, tracing, etc.) would be to record the cost of each message. Adding a timestamp field would also be useful. These would support many other metrics for benchmarking etc.

@YannDubs
Copy link
Collaborator

Note: it would be nice to have that also for OpenAI assistant API. It seems that #769 wouldn't work in that case

@sonichi
Copy link
Contributor

sonichi commented Dec 3, 2023

@kevin666aa please check the comment above if you haven't.

@yiranwu0
Copy link
Collaborator

yiranwu0 commented Dec 4, 2023

Thanks. Adding tasks to #770:

  1. supporting cost calculation in assistant API
  2. record the cost of each message.
  3. Add time stamp to creation of each messages.

@miiiz
Copy link

miiiz commented Dec 13, 2023

Thanks. Adding tasks to #770:

  1. supporting cost calculation in assistant API
  2. record the cost of each message.
  3. Add time stamp to creation of each messages.

Hi. I wonder if functions are included in the cost? thanks.

@yiranwu0
Copy link
Collaborator

Thanks. Adding tasks to #770:

  1. supporting cost calculation in assistant API
  2. record the cost of each message.
  3. Add time stamp to creation of each messages.

Hi. I wonder if functions are included in the cost? thanks.

I assume you are referring to "functions" params passed to OpenAI, and yes it should be counted as completion token.

@thinkall
Copy link
Collaborator

Closing this issue due to inactivity. If you have further questions, please open a new issue or join the discussion in AutoGen Discord server: https://discord.com/invite/Yb5gwGVkE5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants