Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tembo AI billing reporting #897

Merged
merged 19 commits into from
Sep 12, 2024
Merged

Tembo AI billing reporting #897

merged 19 commits into from
Sep 12, 2024

Conversation

Jayko001
Copy link
Contributor

@Jayko001 Jayko001 commented Aug 5, 2024

No description provided.

inference-gateway/src/events_reporter.rs Outdated Show resolved Hide resolved
inference-gateway/src/events_reporter.rs Outdated Show resolved Hide resolved
@sjmiller609
Copy link
Contributor

When adding the new background worker, you can add a new file called daemon.rs, similar to in control plane. Then add to cargo.toml to create a new entrypoint, similar to in control plane, find under [[bin]]

@sjmiller609 sjmiller609 changed the title Cloud 927 Tembo AI billing reporting Aug 8, 2024
organization_id,
instance_id,
model,
MAX(completed_at) AS completed_at,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I could switch to COALESCE here to avoid SUM and MAX returning optional fields, not sure which option is more readable though

Copy link
Contributor

@sjmiller609 sjmiller609 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, just one thing about the connections

inference-gateway/src/events_reporter.rs Outdated Show resolved Hide resolved
@vrmiguel vrmiguel merged commit 7793bd7 into main Sep 12, 2024
9 checks passed
@vrmiguel vrmiguel deleted the cloud-927 branch September 12, 2024 19:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants