Skip to content

Commit

Permalink
Merge branch 'main' into kderusso/semantic-text-match-query-support
Browse files Browse the repository at this point in the history
  • Loading branch information
kderusso authored Dec 12, 2024
2 parents f6f57bb + e7a4436 commit c0092e8
Show file tree
Hide file tree
Showing 101 changed files with 1,710 additions and 605 deletions.
1 change: 1 addition & 0 deletions .buildkite/pipelines/periodic-packaging.template.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ steps:
- rhel-8
- rhel-9
- almalinux-8
- almalinux-9
agents:
provider: gcp
image: family/elasticsearch-{{matrix.image}}
Expand Down
1 change: 1 addition & 0 deletions .buildkite/pipelines/periodic-packaging.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ steps:
- rhel-8
- rhel-9
- almalinux-8
- almalinux-9
agents:
provider: gcp
image: family/elasticsearch-{{matrix.image}}
Expand Down
1 change: 1 addition & 0 deletions .buildkite/pipelines/periodic-platform-support.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ steps:
- rhel-8
- rhel-9
- almalinux-8
- almalinux-9
agents:
provider: gcp
image: family/elasticsearch-{{matrix.image}}
Expand Down
1 change: 1 addition & 0 deletions .buildkite/pipelines/pull-request/packaging-tests-unix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ steps:
- rhel-8
- rhel-9
- almalinux-8
- almalinux-9
PACKAGING_TASK:
- docker
- docker-cloud-ess
Expand Down
5 changes: 5 additions & 0 deletions docs/changelog/117840.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
pr: 117840
summary: Fix timeout ingesting an empty string into a `semantic_text` field
area: Machine Learning
type: bug
issues: []
11 changes: 11 additions & 0 deletions docs/changelog/118103.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
pr: 118103
summary: "Remove any references to org.elasticsearch.core.RestApiVersion#V_7"
area: Infra/Core
type: breaking
issues: []
breaking:
title: "Remove any references to org.elasticsearch.core.RestApiVersion#V_7"
area: REST API
details: "This PR removes all references to V_7 in the Rest API. V7 features marked for deprecation have been removed."
impact: "This change is breaking for any external plugins/clients that rely on the V_7 enum or deprecated version 7 functionality"
notable: false
6 changes: 6 additions & 0 deletions docs/changelog/118435.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
pr: 118435
summary: '`_score` should not be a reserved attribute in ES|QL'
area: ES|QL
type: enhancement
issues:
- 118460
74 changes: 71 additions & 3 deletions docs/reference/connector/docs/connectors-release-notes.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,76 @@
Prior to version *8.16.0*, the connector release notes were published as part of the {enterprise-search-ref}/changelog.html[Enterprise Search documentation].
====

*Release notes*:
[discrete]
[[es-connectors-release-notes-8-17-0]]
=== 8.17.0

* <<es-connectors-release-notes-8-16-0>>
No notable changes in this release.

include::release-notes/connectors-release-notes-8.16.0.asciidoc[]
[discrete]
[[es-connectors-release-notes-8-16-1]]
=== 8.16.1

[discrete]
[[es-connectors-release-notes-8-16-1-bug-fixes]]
==== Bug fixes

* Fixed a bug in the Outlook Connector where having deactivated users could cause the sync to fail.
See https://github.com/elastic/connectors/pull/2967[*PR 2967*].
* Fixed a bug where the Confluence connector was not downloading some blog post documents due to unexpected response format.
See https://github.com/elastic/connectors/pull/2984[*PR 2984*].

[discrete]
[[es-connectors-release-notes-8-16-0]]
=== 8.16.0

[discrete]
[[es-connectors-release-notes-deprecation-notice]]
==== Deprecation notices

* *Direct index access for connectors and sync jobs*
+
IMPORTANT: Directly accessing connector and sync job state through `.elastic-connectors*` indices is deprecated, and will be disallowed entirely in a future release.

* Instead, the Elasticsearch Connector APIs should be used. Connectors framework code now uses the <<connector-apis,Connector APIs>> by default.
See https://github.com/elastic/connectors/pull/2884[*PR 2902*].

* *Docker `enterprise-search` namespace deprecation*
+
IMPORTANT: The `enterprise-search` Docker namespace is deprecated and will be discontinued in a future release.
+
Starting in `8.16.0`, Docker images are being transitioned to the new `integrations` namespace, which will become the sole location for future releases. This affects the https://github.com/elastic/connectors[Elastic Connectors] and https://github.com/elastic/data-extraction-service[Elastic Data Extraction Service].
+
During this transition period, images are published to both namespaces:
+
** *Example*:
+
Deprecated namespace::
`docker.elastic.co/enterprise-search/elastic-connectors:v8.16.0`
+
New namespace::
`docker.elastic.co/integrations/elastic-connectors:v8.16.0`
+
Users should migrate to the new `integrations` namespace as soon as possible to ensure continued access to future releases.

[discrete]
[[es-connectors-release-notes-8-16-0-enhancements]]
==== Enhancements

* Docker images now use Chainguard's Wolfi base image (`docker.elastic.co/wolfi/jdk:openjdk-11-dev`), replacing the previous `ubuntu:focal` base.

* The Sharepoint Online connector now works with the `Sites.Selected` permission instead of the broader permission `Sites.Read.All`.
See https://github.com/elastic/connectors/pull/2762[*PR 2762*].

* Starting in 8.16.0, connectors will start using proper SEMVER, with `MAJOR.MINOR.PATCH`, which aligns with Elasticsearch/Kibana versions. This drops the previous `.BUILD` suffix, which we used to release connectors between Elastic stack releases. Going forward, these inter-stack-release releases will be suffixed instead with `+<timestamp>`, aligning with Elastic Agent and conforming to SEMVER.
See https://github.com/elastic/connectors/pull/2749[*PR 2749*].

* Connector logs now use UTC timestamps, instead of machine-local timestamps. This only impacts logging output.
See https://github.com/elastic/connectors/pull/2695[*PR 2695*].

[discrete]
[[es-connectors-release-notes-8-16-0-bug-fixes]]
==== Bug fixes

* The Dropbox connector now fetches the files from team shared folders.
See https://github.com/elastic/connectors/pull/2718[*PR 2718*].

This file was deleted.

24 changes: 12 additions & 12 deletions docs/reference/inference/inference-apis.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -48,21 +48,21 @@ When adaptive allocations are enabled:

For more information about adaptive allocations and resources, refer to the {ml-docs}/ml-nlp-auto-scale.html[trained model autoscaling] documentation.

//[discrete]
//[[default-enpoints]]
//=== Default {infer} endpoints
[discrete]
[[default-enpoints]]
=== Default {infer} endpoints

//Your {es} deployment contains some preconfigured {infer} endpoints that makes it easier for you to use them when defining `semantic_text` fields or {infer} processors.
//The following list contains the default {infer} endpoints listed by `inference_id`:
Your {es} deployment contains preconfigured {infer} endpoints which makes them easier to use when defining `semantic_text` fields or using {infer} processors.
The following list contains the default {infer} endpoints listed by `inference_id`:

//* `.elser-2-elasticsearch`: uses the {ml-docs}/ml-nlp-elser.html[ELSER] built-in trained model for `sparse_embedding` tasks (recommended for English language texts)
//* `.multilingual-e5-small-elasticsearch`: uses the {ml-docs}/ml-nlp-e5.html[E5] built-in trained model for `text_embedding` tasks (recommended for non-English language texts)
* `.elser-2-elasticsearch`: uses the {ml-docs}/ml-nlp-elser.html[ELSER] built-in trained model for `sparse_embedding` tasks (recommended for English language texts)
* `.multilingual-e5-small-elasticsearch`: uses the {ml-docs}/ml-nlp-e5.html[E5] built-in trained model for `text_embedding` tasks (recommended for non-English language texts)

//Use the `inference_id` of the endpoint in a <<semantic-text,`semantic_text`>> field definition or when creating an <<inference-processor,{infer} processor>>.
//The API call will automatically download and deploy the model which might take a couple of minutes.
//Default {infer} enpoints have {ml-docs}/ml-nlp-auto-scale.html#nlp-model-adaptive-allocations[adaptive allocations] enabled.
//For these models, the minimum number of allocations is `0`.
//If there is no {infer} activity that uses the endpoint, the number of allocations will scale down to `0` automatically after 15 minutes.
Use the `inference_id` of the endpoint in a <<semantic-text,`semantic_text`>> field definition or when creating an <<inference-processor,{infer} processor>>.
The API call will automatically download and deploy the model which might take a couple of minutes.
Default {infer} enpoints have {ml-docs}/ml-nlp-auto-scale.html#nlp-model-adaptive-allocations[adaptive allocations] enabled.
For these models, the minimum number of allocations is `0`.
If there is no {infer} activity that uses the endpoint, the number of allocations will scale down to `0` automatically after 15 minutes.


[discrete]
Expand Down
Loading

0 comments on commit c0092e8

Please sign in to comment.