Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: implement-inference-martian-extension #2869

Merged
merged 1 commit into from
May 6, 2024
Merged

feat: implement-inference-martian-extension #2869

merged 1 commit into from
May 6, 2024

Conversation

henryh0x1
Copy link
Contributor

Describe Your Changes

  • Implement inference-martian-extension
  • From Martian website (https://withmartian.com/), Martian invented the first LLM router. By dynamically routing between multiple models, Martian can beat GPT-4 on performance, reduce costs by 20%-97%, and simplify the process of using AI.

Fixes Issues

  • Closes #
  • Closes #

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@henryh0x1 henryh0x1 requested a review from a team May 5, 2024 04:09
@henryh0x1 henryh0x1 changed the title feat/implement-inference-martian-extension feat: implement-inference-martian-extension May 5, 2024
@henryh0x1 henryh0x1 added type: feature request A new feature P2: nice to have Nice to have feature and removed type: feature request A new feature labels May 5, 2024
@Van-QA Van-QA force-pushed the feat/inference-martian-extension branch from badf3ba to 5366be6 Compare May 6, 2024 03:38
@hahuyhoang411
Copy link
Contributor

Works perfectly thanks @henryh0x1

cc @Van-QA

image

@Van-QA Van-QA merged commit 1e3e5a8 into dev May 6, 2024
17 checks passed
@Van-QA Van-QA deleted the feat/inference-martian-extension branch May 6, 2024 08:24
@github-actions github-actions bot added this to the v0.5.0 Broken Rice milestone May 6, 2024
@Van-QA Van-QA added the needs comms Needs to communicate changes/issue to users label May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hahuyhoang411 hahuyhoang411 hahuyhoang411 approved these changes

Assignees

@henryh0x1 henryh0x1

Labels
needs comms Needs to communicate changes/issue to users P2: nice to have Nice to have feature
Projects
Jan & Cortex
Archived in project
Milestone
v0.4.13 🌾 Broken Rice
Development

Successfully merging this pull request may close these issues.
3 participants
@henryh0x1 @hahuyhoang411 @Van-QA