Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

introduce persistence code for service account table #11944

Conversation

subodh1810
Copy link
Contributor

@subodh1810 subodh1810 commented Apr 12, 2022

Issue : #11968

@subodh1810 subodh1810 self-assigned this Apr 12, 2022
@subodh1810 subodh1810 changed the base branch from master to create-workspace-service-accounts-table April 12, 2022 22:33
@subodh1810 subodh1810 marked this pull request as ready for review April 13, 2022 13:25
type: string
serviceAccountEmail:
type: string
jsonCredential:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nitpick. It would be helpful to add a sample json credential here, or just add a reference to the mock_serivce_key.json file. Sometimes it is hard to find how a json column should look like.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could this just be a string type? I.e. do we ever actually want to deserialize the cred; my understanding is that the fact that it's a JSON blob is just an implementation detail of GCP and we shouldn't need to care about it

regardless, I do agree that an example would be useful for future reference

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

^ agree with this. The pro for having a json column is that it is easier to search. However, I imagine that in reality we seldom have to search anything from the credentials. So there is not much benefit from storing the json type here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have added a comment for reference to the example, I think there is more value in keeping this as JsonNode data type cause it makes sure that the data type is in sync with the database + the key of service account is in JSON format

description: Integration specific blob. Must be a valid JSON string.
type: object
existingJavaType: com.fasterxml.jackson.databind.JsonNode
hmacKey:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nitpick. Same for the hmac key. Would be nice to have a sample json here.

…-persistence-code-for-service-account-table

# Conflicts:
#	airbyte-config/persistence/src/main/java/io/airbyte/config/persistence/DbConverter.java
@subodh1810 subodh1810 temporarily deployed to more-secrets April 25, 2022 21:17 Inactive
@subodh1810 subodh1810 temporarily deployed to more-secrets April 25, 2022 21:17 Inactive
* implement secret handling for workspace_service_account table

* add new line to the mock json

* get rid of file

* address review comments

* update method name and add comment
@subodh1810 subodh1810 merged commit b1eba9e into create-workspace-service-accounts-table Apr 26, 2022
@subodh1810 subodh1810 deleted the introduce-persistence-code-for-service-account-table branch April 26, 2022 13:48
subodh1810 added a commit that referenced this pull request Apr 26, 2022
* implement migration to create workspace_service_account table

* make all columns non nullable

* introduce persistence code for service account table (#11944)

* implement persistence code for workspace_service_account table

* update yaml

* implement secret handling for workspace_service_account table (#11946)

* implement secret handling for workspace_service_account table

* add new line to the mock json

* get rid of file

* address review comments

* update method name and add comment
suhomud pushed a commit that referenced this pull request May 23, 2022
* implement migration to create workspace_service_account table

* make all columns non nullable

* introduce persistence code for service account table (#11944)

* implement persistence code for workspace_service_account table

* update yaml

* implement secret handling for workspace_service_account table (#11946)

* implement secret handling for workspace_service_account table

* add new line to the mock json

* get rid of file

* address review comments

* update method name and add comment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants