Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

airbyte-ci: run live tests against connection listed in metadata #42574

Merged
merged 14 commits into from
Aug 2, 2024

Conversation

clnoll
Copy link
Contributor

@clnoll clnoll commented Jul 26, 2024

What

Updates the connectors test pipeline to run live tests if there's a sandbox account.

Depends on #42860 and #42577, which adds the live tests configuration info to the metadata.yaml for each connector that has a sandbox account in integration-test-sandboxes workspace.

Closes #42465.

Copy link

vercel bot commented Jul 26, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Aug 2, 2024 2:39am

@clnoll clnoll marked this pull request as draft July 26, 2024 19:45
@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch 3 times, most recently from 7376bc3 to 74c3b4e Compare July 26, 2024 22:11
@octavia-squidington-iii octavia-squidington-iii removed the area/connectors Connector related issues label Jul 26, 2024
@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch from 74c3b4e to d0fa5f2 Compare July 26, 2024 22:14
@clnoll clnoll requested a review from alafanechere July 26, 2024 22:28
@clnoll clnoll changed the title WIP: run live tests against connection listed in metadata airbyte-ci: run live tests against connection listed in metadata Jul 26, 2024
@clnoll clnoll marked this pull request as ready for review July 26, 2024 22:28
sentry_dsn: ${{ secrets.SENTRY_AIRBYTE_CI_DSN }}
git_branch: ${{ github.head_ref }}
git_revision: ${{ steps.fetch_last_commit_id_pr.outputs.commit_id }}
github_token: ${{ env.PAT }}
github_maintenance_token: ${{ secrets.GH_PAT_MAINTENANCE_OSS }}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would prefer not to have to use this in addition to env.PAT, but env.PAT isn't scoped properly to run the live tests, and secrets. GH_PAT_MAINTENANCE_OSS isn't scoped properly for the rest of the tests.

@@ -50,6 +50,7 @@ def __init__(
ci_gcp_credentials: Optional[Secret] = None,
ci_git_user: Optional[str] = None,
ci_github_access_token: Optional[Secret] = None,
ci_github_maintenance_token: Optional[Secret] = None,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd really love to use ci_github_access_token here, and make the extra effort of generating a token / PAT with the right level of permissions. I don't think there's a strong reason to differentiate both token logically in code.

@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch from d0fa5f2 to dd250a4 Compare July 30, 2024 18:57
@clnoll clnoll requested a review from a team as a code owner July 30, 2024 18:57
@octavia-squidington-iii octavia-squidington-iii added the area/connectors Connector related issues label Jul 30, 2024
@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch from 885afa9 to 2256e56 Compare July 31, 2024 17:52
@octavia-squidington-iii octavia-squidington-iii removed the area/connectors Connector related issues label Jul 31, 2024
@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch from ce1a216 to 0015590 Compare July 31, 2024 22:49
@octavia-squidington-iii octavia-squidington-iii added the area/connectors Connector related issues label Jul 31, 2024
@clnoll clnoll force-pushed the catherine/run-live-tests-against-metadata-connection branch from 16f815a to c5ec8d7 Compare August 1, 2024 03:08
@octavia-squidington-iii octavia-squidington-iii removed the area/documentation Improvements or additions to documentation label Aug 2, 2024
@octavia-squidington-iii octavia-squidington-iii removed the area/documentation Improvements or additions to documentation label Aug 2, 2024
@natikgadzhi
Copy link
Contributor

natikgadzhi commented Aug 2, 2024 via email

BenGalewsky pushed a commit to BenGalewsky/airbyte that referenced this pull request Aug 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Live tests: automate test runs against sandbox accounts.
4 participants