🎉 New Source: Elasticsearch

[nilkamalthakuria]

What

In this PR I am adding a new source Elasticsearch connector.

How

Written in Java using Elasticsearch's High Level Rest Client HLRC

Recommended reading order

1. ElasticsearchSource.java
2. ElasticsearchConnection.java
3. ElasticsearchTypeMapper.java

🚨 User Impact 🚨

New connector now has type mappings for objects, which are handled recursively, along with other Elasticsearch data types.
The previous PR lacked this feature.

Pre-merge Checklist

Expand the relevant checklist and delete the others.

New Connector

Community member or Airbyter

• Community member? Grant edit access to maintainers (instructions)
• Secrets in the connector's spec are annotated with airbyte_secret
• Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
• Code reviews completed
• Documentation updated
  • Connector's README.md
  • Connector's bootstrap.md. See description and examples
  • docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
  • docs/integrations/README.md
  • airbyte-integrations/builds.md
• PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

• Create a non-forked branch based on this PR and test the below items on it
• Build is successful
• If new credentials are required for use in CI, add them to GSM. Instructions.
• /test connector=connectors/<name> command is passing
• New Connector version released on Dockerhub by running the /publish command described here
• After the connector is published, connector added to connector index as described here
• Seed specs have been re-generated by building the platform and committing the changes to the seed spec files, as described here

Tests

Unit

Integration

Acceptance

[CLAassistant]

All committers have signed the CLA.

[marcosmarxm]

Would be grateful if someone could point me the fix for the missing docker image. I built the connector using docker build . -t airbyte/source-elasticsearch:dev, but it shows as missing during integration testing.

Please run ./gradlew airbyte-integrations:connectors:source-elasticsearch:integrationTest

[nilkamalthakuria]

@marcosmarxm Here are the acceptance test logs. Screenshot is attached in the first comment.
Test Results — ElasticsearchSourceAcceptanceTest .pdf

[marcosmarxm]

/test connector=connectors/source-elasticsearch

🕑 connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2616397557
✅ connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2616397557
No Python unittests run

Build Passed

Test summary info:

All Passed

[marcosmarxm]

/test connector=connectors/source-elasticsearch

🕑 connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2658984509
❌ connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2658984509
🐛 https://gradle.com/s/sgrdt3i6az5fu

Build Failed

Test summary info:

Could not find result summary

[marcosmarxm]

/test connector=connectors/source-elasticsearch

🕑 connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2659114685
✅ connectors/source-elasticsearch https://github.com/airbytehq/airbyte/actions/runs/2659114685
No Python unittests run

Build Passed

Test summary info:

All Passed

[marcosmarxm]

/publish connector=connectors/source-elasticsearch

🕑 Publishing the following connectors:
connectors/source-elasticsearch
https://github.com/airbytehq/airbyte/actions/runs/2659176386

Connector	Did it publish?	Were definitions generated?
connectors/source-elasticsearch	✅	✅

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

[marcosmarxm]

thanks @nilkamalthakuria