Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 New Source: Aha [low-code cdk] #18893

Merged
merged 12 commits into from
Nov 15, 2022
Merged

🎉 New Source: Aha [low-code cdk] #18893

merged 12 commits into from
Nov 15, 2022

Conversation

bala-ceg
Copy link
Contributor

@bala-ceg bala-ceg commented Nov 3, 2022

What

Aha Integration: https://www.aha.io/api/

How

Added the end points of features,releases,goals,users and ideas

Recommended reading order

  1. spec.yaml
  2. aha.yaml
  3. schemas\

🚨 User Impact 🚨

No Impact. New Feature

Pre-merge Checklist

Expand the relevant checklist and delete the others.

New Connector

Tests

Unit

Put your unit tests output here.

Integration

Put your integration tests output here.

Acceptance Screenshot 2022-11-03 at 12 17 40 PM

@marcosmarxm
Copy link
Member

Hello @bala-ceg, Marcos from Airbyte here 👋 . We received more than 25 new contributions along the weekend. One is yours 🎉 thank so much for! Our team is limited and maybe the review process can take longer than expected. As described in the Airbyte's Hacktoberfest your contribution was submitted before November 2nd and it is eligible to win the prize. The review process will validate other requirements. I ask to you patience until someone from the team review it.

Because I reviewed some contributions for Hacktoberfest so far I saw some common patterns you can check in advance:

  • Make sure you have added connector documentation to /docs/integrations/
  • Remove the file catalog from /integration_tests
  • Edit the sample_config.json inside /integration_tests
  • For the configured_catalog you can use only json_schema: {}
  • Add title to all properties in the spec.yaml
  • Make sure the documentationUrl in the spec.yaml redirect to Airbyte's future connector page, eg: connector Airtable the documentationUrl: https://docs.airbyte.com/integrations/sources/airtable
  • Review now new line at EOF (end-of-file) for all files.

If possible send to me a DM in Slack with the tests credentials, this process will make easier to us run integration tests and publish your connector. If you only has production keys, make sure to create a bootstrap.md explaining how to get the keys.

@marcosmarxm
Copy link
Member

Hello! I'm going to be out of the office this Friday and won't be able to review your contribution again today, I return next Monday. So far, most contributions look solid and are almost done to be approved. As said in Chris' comment all contributions made before 2-November are eligible to receive the prize and have 2 weeks to merge the contributions. But I ensure next week we're going to have your contribution merged. If you have questions about the implementation you can send them in #hacktoberfest-2022 in Airbyte's Slack.

Sorry the inconvenience and see you again next week, thank you so much for your contribution!

@github-actions github-actions bot added the area/documentation Improvements or additions to documentation label Nov 7, 2022
@bala-ceg
Copy link
Contributor Author

bala-ceg commented Nov 7, 2022

Thanks @marcosmarxm for taking time to review this. DM'ed you on slack with test credentials and to the best of my knowledge I think I have all checklist items fulfilled

  • Make sure you have added connector documentation to /docs/integrations/
  • Remove the file catalog from /integration_tests
  • Edit the sample_config.json inside /integration_tests
  • For the configured_catalog you can use only json_schema: {}
  • Add title to all properties in the spec.yaml
  • [x ] Make sure the documentationUrl in the spec.yaml redirect to Airbyte's future connector page, eg: connector Airtable the documentationUrl: https://docs.airbyte.com/integrations/sources/airtable
  • Review now new line at EOF (end-of-file) for all files.

Copy link
Member

@marcosmarxm marcosmarxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some comments please check them.

@bala-ceg bala-ceg requested a review from marcosmarxm November 8, 2022 07:51
@bala-ceg
Copy link
Contributor Author

bala-ceg commented Nov 9, 2022

@marcosmarxm I addressed the review comments. Can you please review them?

Copy link
Member

@marcosmarxm marcosmarxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The paginator is not used yet.

@marcosmarxm
Copy link
Member

marcosmarxm commented Nov 14, 2022

/test connector=connectors/source-aha

🕑 connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3465751776
❌ connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3465751776
🐛 https://gradle.com/s/kriorkzlxwzbm

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - AssertionError:  Rec...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: This connector does not implement incremental sync
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:51: The previous connector image could not be retrieved.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:229: The previous connector image could not be retrieved.
=================== 1 failed, 23 passed, 3 skipped in 45.88s ===================

@bala-ceg
Copy link
Contributor Author

/test connector=connectors/source-aha

🕑 connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3465751776
❌ connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3465751776
🐛 https://gradle.com/s/kriorkzlxwzbm

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - AssertionError:  Rec...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: This connector does not implement incremental sync
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:51: The previous connector image could not be retrieved.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:229: The previous connector image could not be retrieved.
=================== 1 failed, 23 passed, 3 skipped in 45.88s ===================

Screenshot 2022-11-15 at 6 19 38 AM

@marcosmarxm in my local setup all tests are passing, can you please help me in fixing the test failures

@marcosmarxm
Copy link
Member

marcosmarxm commented Nov 15, 2022

/test connector=connectors/source-aha

🕑 connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3466719200
✅ connectors/source-aha https://github.com/airbytehq/airbyte/actions/runs/3466719200
Python tests coverage:

	 Name                                                 Stmts   Miss  Cover   Missing
	 ----------------------------------------------------------------------------------
	 source_acceptance_test/base.py                          12      4    67%   16-19
	 source_acceptance_test/config.py                       139      5    96%   87, 93, 235, 239-240
	 source_acceptance_test/conftest.py                     196     92    53%   35, 41-43, 48, 54, 60, 66, 72-74, 93, 98-100, 106-108, 114-115, 120-121, 126, 132, 141-150, 156-161, 176, 200, 231, 237, 243-248, 256-261, 269-282, 287-293, 300-311, 318-334
	 source_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 source_acceptance_test/tests/test_core.py              394    111    72%   53, 58, 87-95, 100-107, 111-112, 116-117, 293, 331-348, 357-365, 369-374, 380, 413-418, 456-463, 506-508, 511, 576-584, 596-599, 604, 660-661, 667, 670, 706-716, 729-754
	 source_acceptance_test/tests/test_incremental.py       158     14    91%   52-59, 64-77, 240
	 source_acceptance_test/utils/asserts.py                 37      2    95%   57-58
	 source_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 source_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 source_acceptance_test/utils/connector_runner.py       112     50    55%   23-26, 32, 36, 39-68, 71-73, 76-78, 81-83, 86-88, 91-93, 96-114, 148-150
	 source_acceptance_test/utils/json_schema_helper.py     105     13    88%   30-31, 38, 41, 65-68, 96, 120, 190-192
	 ----------------------------------------------------------------------------------
	 TOTAL                                                 1557    349    78%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: This connector does not implement incremental sync
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:88: The previous connector image could not be retrieved.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:358: The previous connector image could not be retrieved.
======================== 26 passed, 3 skipped in 48.89s ========================

@marcosmarxm
Copy link
Member

marcosmarxm commented Nov 15, 2022

/publish connector=connectors/source-aha

🕑 Publishing the following connectors:
connectors/source-aha
https://github.com/airbytehq/airbyte/actions/runs/3466887788


Connector Did it publish? Were definitions generated?
connectors/source-aha

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

Copy link
Member

@marcosmarxm marcosmarxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @bala-ceg

@marcosmarxm marcosmarxm merged commit 4fbd061 into airbytehq:master Nov 15, 2022
@bala-ceg
Copy link
Contributor Author

Thanks @marcosmarxm for helping me merge this connector

@marcosmarxm marcosmarxm changed the title 🎉 New Source: Aha 🎉 New Source: Aha [low-code cdk] Nov 18, 2022
akashkulk pushed a commit that referenced this pull request Dec 2, 2022
* 🎉 New Source: Aha

* addressing the comments

* addressing review comments

* addressing review comments & removing newly added EoL

* fixing end of file line

* fixing end of file line

* including paginator

* Fixing the pagination issue

* Removing the contents from sample_config.json

* fix schema, tests and add aha to source def

* format files

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
@sajarin sajarin added internal and removed bounty labels Dec 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants