Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to the new GPT-4o mini model #785

Merged
merged 1 commit into from
Jul 22, 2024
Merged

Update to the new GPT-4o mini model #785

merged 1 commit into from
Jul 22, 2024

Conversation

dkotter
Copy link
Collaborator

@dkotter dkotter commented Jul 19, 2024

Description of the Change

OpenAI recently introduced a new model, GPT-4o mini. They recommend using this model anywhere you were previously using the GPT-3.5 Turbo model, which is the model we use for excerpt generation, title generation and content resizing.

This PR updates that model and updates the number of tokens available, as this new model has a much higher limit.

Some of the main benefits from this model switch:

  • More than 60% cheaper
  • Context window increases from 16,385 tokens to 128,000 tokens
  • Training data up to Oct 2023, increased from Sep 2021
  • Better benchmarks across the board compared to GPT-3.5 Turbo
  • It's a multi-modal model so could look in the future to use it for image, video or audio tasks

How to test the Change

Ensure the Title Generation, Excerpt Generation and Content Resizing Features all still work when set to use OpenAI as the Provider

Changelog Entry

Changed - Switch from the gpt-3.5-turbo model to the new gpt-4o-mini model.

Credits

Props @dkotter

Checklist:

  • I agree to follow this project's Code of Conduct.
  • I have updated the documentation accordingly.
  • I have added tests to cover my change.
  • All new and existing tests pass.

@dkotter dkotter added this to the 3.2.0 milestone Jul 19, 2024
@dkotter dkotter self-assigned this Jul 19, 2024
@dkotter dkotter requested review from jeffpaul and a team as code owners July 19, 2024 16:27
@github-actions github-actions bot added the needs:code-review This requires code review. label Jul 19, 2024
@dkotter dkotter requested review from iamdharmesh and removed request for a team and jeffpaul July 19, 2024 16:41
Copy link
Member

@iamdharmesh iamdharmesh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for updating this @dkotter. PR LGTM and it tests well. 🎉

@dkotter dkotter merged commit f0bdd86 into develop Jul 22, 2024
15 checks passed
@dkotter dkotter deleted the feature/gpt-4o-mini branch July 22, 2024 14:53
@dkotter dkotter modified the milestones: 3.2.0, 3.1.1 Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs:code-review This requires code review.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants