Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to the OpenAI Embeddings Provider #758

Merged
merged 23 commits into from
May 9, 2024

Commits on Feb 19, 2024

  1. Switch to the new small embeddings model; keep our embedding data to …

    …512 vectors for easier storage
    dkotter committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    fa6144e View commit details
    Browse the repository at this point in the history
  2. Ensure our vector arrays are the same length before running calculati…

    …ons. Modify our calculation slightly
    dkotter committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    bc7b158 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9234d59 View commit details
    Browse the repository at this point in the history
  4. Remove code that isn't needed

    dkotter committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    794017c View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Update docblock

    dkotter committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    d4c3f84 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Configuration menu
    Copy the full SHA
    2df624c View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Configuration menu
    Copy the full SHA
    5ad469f View commit details
    Browse the repository at this point in the history
  2. Add helper methods to get the API URL, model name and max tokens, pas…

    …sing each through custom filters. Allows these to easily be used and changed by extenders
    dkotter committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    cc72cbf View commit details
    Browse the repository at this point in the history
  3. Add a helper method to get the number of dimensions each embedding sh…

    …ould have, passing a filter around this value
    dkotter committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    729e2cc View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    59d95da View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b38346b View commit details
    Browse the repository at this point in the history
  6. Add a generic generate_embedding method and use that when generating …

    …post or term embeddings. Chunk content down before we generate embeddings. Start process of changing how we compare embeddings to work with these chunks, as we now have an array of embeddings instead of a single embedding
    dkotter committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    9f11d56 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Add a helper method to get the max number of terms and add a filter a…

    …round this. Increase the max number of terms to 5000. Order terms by most used to least used
    dkotter committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    3fa96e1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cc5d800 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5a95615 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c53904f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    8a00548 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    b5fe959 View commit details
    Browse the repository at this point in the history
  7. Add a notice to trigger regeneration of embeddings. Only show our not…

    …ices to admins. Fix a bug in our hide notice script so it only triggers when the close icon is clicked. Add functionality to regenerate embeddings for all terms and delete all post embeddings. Ensure we build embeddings when running our preview function, in case the post embeddings are out of date.
    dkotter committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    2f9a023 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Configuration menu
    Copy the full SHA
    03531a7 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. Configuration menu
    Copy the full SHA
    4de6136 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Configuration menu
    Copy the full SHA
    7a31aa2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b4e85bd View commit details
    Browse the repository at this point in the history