Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REQUEST]: Inference API removing references to the _unified URL suffix #339

Open
jonathan-buttner opened this issue Feb 5, 2025 · 0 comments

Comments

@jonathan-buttner
Copy link

jonathan-buttner commented Feb 5, 2025

Description

What: Currently in the docs we have an inference API route called the chat completion route. The URL for this route requires the suffix to be _unified (_inference/chat_completion/<id>/_unified).

We'd like to rename this suffix to _stream.

When: We'd like this to be in the docs for the 8.18 and 9.0 releases.

Why: The _unified suffix is confusing to uses as it doesn't really explain why it is unified. We'd like to keep with the streaming route we already have.

Resources

This feature was initial created in this PR: elastic/elasticsearch#118696 (docs)
Feature PR: elastic/elasticsearch#117589

I have a PR to incorporate the changes from _unified to _stream here: elastic/elasticsearch#121078

I need that PR merged before I can merge a client spec PR here: elastic/elasticsearch-specification#3545

See this comment: elastic/elasticsearch-specification#3545 (comment)

Which documentation set does this change impact?

Elastic On-Prem and Cloud (all)

Feature differences

There are no differences

What release is this request related to?

8.18

Collaboration model

The engineering team

Point of contact.

Main contact: @jonathan-buttner

Stakeholders:

Notes

I'm not sure what needs to happen to ensure that the changes in the ES PR get propagated through to the new docs system. I'm happy to make changes to my ES PR to assist with that though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant