Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dependencies to docker-compose #19321

Conversation

gosusnp
Copy link
Contributor

@gosusnp gosusnp commented Nov 10, 2022

What

The bootloader should run before the other applications.
If the bootloader fails, it is likely a sign that the setup failed and that we may have an unexpected state that is not safe for the other applications.
We should define the bootloader as a dependencies for the applications that depends on it.

Reverts #19306

How

Use conditional depends_on.

  • Use docker compose v2 in our tooling
  • Update documentation to use docker compose v2
  • Update docker compose configs to have services depend on airbyte-bootloader terminating successfully

Release Notes

Starting from version 0.40.27, Airbyte will require docker compose v2.

It means that docker-compose v2 will be required in order to upgrade any Airbyte instance running with docker.
Docker compose v2 should be available by default with most recent docker desktop installations. For linux environments, please refer to the docker documentation https://docs.docker.com/compose/install/linux/.
Note that docker-compose v2 should act as a drop-in replacement for most docker-compose usage.

Following this upgrade, Airbyte will have an explicit check that prevents the application from starting in case of conflicting configuration that would prevent active connections from running properly.

In case of errors upon upgrade, please refer to the troubleshooting documentation https://docs.airbyte.com/troubleshooting/on-deploying

@gosusnp gosusnp temporarily deployed to more-secrets November 10, 2022 23:04 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 11, 2022 02:13 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 22, 2022 22:28 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 22, 2022 22:28 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 00:34 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 00:35 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 00:50 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 00:50 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 01:10 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 01:10 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 01:28 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 01:29 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 17:34 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 17:34 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 17:55 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 17:56 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 18:24 Inactive
@gosusnp gosusnp temporarily deployed to more-secrets November 23, 2022 18:24 Inactive
@octavia-squidington-iv octavia-squidington-iv added the area/frontend Related to the Airbyte webapp label Jan 9, 2023
@gosusnp gosusnp temporarily deployed to more-secrets January 9, 2023 23:05 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 9, 2023 23:05 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 17:41 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 17:42 — with GitHub Actions Inactive
@gosusnp gosusnp requested a review from sophia-wiley January 10, 2023 18:50
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 18:52 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 18:52 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 19:36 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 10, 2023 19:38 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 00:19 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 00:20 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 01:20 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 01:20 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 01:57 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 01:58 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 02:20 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 02:22 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 17:04 — with GitHub Actions Inactive
@gosusnp gosusnp temporarily deployed to more-secrets January 12, 2023 17:06 — with GitHub Actions Inactive
@gosusnp gosusnp merged commit c6b8279 into master Jan 12, 2023
@gosusnp gosusnp deleted the revert-19306-revert-19257-gosusnp/add-dependencies-to-docker-compose branch January 12, 2023 18:41
jbfbell pushed a commit that referenced this pull request Jan 13, 2023
* Revert "Revert "Add dependencies to docker-compose (#19257)" (#19306)"

This reverts commit b16f28f.

* Bump docker-compose version

* test

* Revert "test"

This reverts commit c3b28c9.

* Bump docker compose version to 3.8

* test

* test

* Use a newer docker for platform build

* test

* Use docker compose v2

* Update docker for frontend e2e

* Use docker compose v2 for e2e tests

* Update tools to use docker compose v2

* Update more docker compose references to v2

* Update docker compose usage in docs

* Update deploying airbyte docs

* Fix permission

* Case insensistive check

* Add extra mention for docker compose in upgrading airbyte

* Improve upgrade docker note
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation area/frontend Related to the Airbyte webapp connectors/source/zuora
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants