SAT: script to create PR to migrate GA connector to high test strictness level.

[alafanechere]

The create_prs.py script will create one PR per GA connectors to migrate to high test strictness level.

What it does:

1. Iterate on all GA connectors in source_definitions.yaml
2. Create a branch for each GA connector
3. Locally migrate acceptance_test_config.yml to the latest format
4. Commit and push the changes on this branch
5. Open a PR for this branch
6. Run a SAT on this branch by posting a /test comment on the PR

An example of the PR it creates can be found here

PR get created with the following labels:

• area/connectors
• team/connectors-python
• type/enhancement
• test-strictness-level

PR are added to the following project: SAT-high-test-strictness-level.

Please forgive me for duplicating a lot of code from create_issues.py. I think it's good enough in the context that this script will be used: a couple of times.

[github-actions]

Affected Connector Report

NOTE ⚠️ Changes in this PR affect the following connectors. Make sure to do the following as needed:

• Run integration tests
• Bump connector version
• Add changelog
• Publish the new version

❌ Sources (63)

Connector	Version	Changelog	Publish
source-airtable	0.1.3	✅	✅
source-amazon-ads	0.1.24	✅	✅
source-amazon-seller-partner	0.2.28	✅	✅
source-amazon-sqs	0.1.0	✅	✅
source-amplitude	0.1.17	✅	✅
source-appsflyer	0.1.0	⚠ (doc not found)	⚠ (not in seed)
source-asana	0.1.4	✅	✅
source-azure-table	0.1.3	✅	✅
source-braintree	0.1.3	✅	✅
source-cart	0.2.0	❌ (changelog missing)	✅
source-chargebee	0.1.16	✅	❌ (diff seed version)
source-commercetools	0.1.0	✅	✅
source-confluence	0.1.1	✅	✅
source-datadog	0.1.0	✅	✅
source-delighted	0.1.4	✅	✅
source-drift	0.2.5	✅	✅
source-facebook-marketing	0.2.72	✅	✅
source-facebook-pages	0.1.6	✅	✅
source-freshcaller	0.1.0	✅	✅
source-freshsales	0.1.2	✅	✅
source-freshservice	0.1.1	✅	✅
source-github	0.3.7	✅	✅
source-gitlab	0.1.6	✅	✅
source-google-ads	0.2.3	✅	✅
source-google-search-console	0.1.18	✅	✅
source-greenhouse	0.3.0	✅	✅
source-harvest	0.1.11	✅	✅
source-instagram	1.0.0	✅	✅
source-iterable	0.1.21	✅	✅
source-klaviyo	0.1.10	✅	✅
source-lemlist	0.1.1	❌ (changelog missing)	❌ (diff seed version)
source-lever-hiring	0.1.3	✅	✅
source-linnworks	0.1.5	❌ (changelog missing)	✅
source-mailchimp	0.2.15	✅	✅
source-mailgun	0.1.0	⚠ (doc not found)	✅
source-monday	0.1.4	✅	✅
source-notion	0.1.10	✅	✅
source-okta	0.1.13	✅	✅
source-onesignal	0.1.2	✅	✅
source-openweather	0.1.6	✅	✅
source-outreach	0.1.2	✅	✅
source-pardot	0.1.0	⚠ (doc not found)	⚠ (not in seed)
source-paystack	0.1.1	✅	✅
source-pinterest	0.1.9	✅	✅
source-pipedrive	0.1.13	✅	✅
source-plaid	0.3.2	❌ (changelog missing)	✅
source-posthog	0.1.7	✅	✅
source-prestashop	0.2.0	⚠ (doc not found)	✅
source-quickbooks-singer	0.1.5	⚠ (doc not found)	✅
source-recharge	0.2.4	❌ (changelog missing)	✅
source-retently	0.1.2	✅	✅
source-salesforce	1.0.24	✅	✅
source-salesloft	0.1.3	✅	✅
source-sendgrid	0.2.16	✅	✅
source-sentry	0.1.7	✅	✅
source-strava	0.1.2	✅	✅
source-surveymonkey	0.1.11	✅	✅
source-tplcentral	0.1.0	✅	⚠ (not in seed)
source-twilio	0.1.13	✅	✅
source-youtube-analytics	0.1.3	✅	✅
source-zendesk-sunshine	0.1.1	✅	✅
source-zendesk-talk	0.1.5	✅	✅
source-zenloop	0.1.3	✅	✅

• See "Actionable Items" below for how to resolve warnings and errors.

✅ Destinations (0)

Connector	Version	Changelog	Publish

• See "Actionable Items" below for how to resolve warnings and errors.

Actionable Items

(click to expand)

Category	Status	Actionable Item
Version	❌ mismatch	The version of the connector is different from its normal variant. Please bump the version of the connector.
	⚠ doc not found	The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug.
Changelog	⚠ doc not found	The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug.
	❌ changelog missing	There is no chnagelog for the current version of the connector. If you are the author of the current version, please add a changelog.
Publish	⚠ not in seed	The connector is not in the seed file (e.g. source_definitions.yaml), so its publication status cannot be checked. This can be normal (e.g. some connectors are cloud-specific, and only listed in the cloud seed file). Please double-check to make sure that it is not a bug.
	❌ diff seed version	The connector exists in the seed file, but the latest version is not listed there. This usually means that the latest version is not published. Please use the /publish command to publish the latest version.

[evantahler]

I think there might be something wrong with the dependencies (requirements.txt). Other than that, 👍!

[evantahler]

That's a big deps change - was this intentional?

[evantahler]

This seems kind of scary

[evantahler]

Oh, and the tests should pass :D

[alafanechere]

I think there might be something wrong with the dependencies (requirements.txt). Other than that, 👍!

@evantahler this is because I installed SAT package from the virtualenv I created for this tooling.
The requirements.txt in this PR is only scoped for the tools/strictness_level_migration.
I just ran pip install -e . from source-acceptance test. And then ran pip freeze > requirements.txt in tools/strictness_level_migration. This is not great but I don't think it's going to hurt. And SAT is not published to PyPi so we can't just pip install sat.

[evantahler]

Ok, that makes sense for the requirements!