Skip to content

Commit

Permalink
Java DB Source connector licenses to Elv2 (#27737)
Browse files Browse the repository at this point in the history 
* Java DB Source connector licenses to Elv2

* Bump PR Ids
  • Loading branch information
@evantahler
evantahler authored Jun 29, 2023
1 parent e5949bc commit 9ce3cc6
Show file tree
Hide file tree
Showing 34 changed files with 503 additions and 495 deletions.
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-bigquery/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,5 @@ ENV APPLICATION source-bigquery
COPY --from=build /airbyte /airbyte

# Airbyte's build system uses these labels to know what to name and tag the docker images produced by this Dockerfile.
LABEL io.airbyte.version=0.2.3
LABEL io.airbyte.version=0.3.0
LABEL io.airbyte.name=airbyte/source-bigquery
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-bigquery/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c
dockerImageTag: 0.2.3
dockerImageTag: 0.3.0
dockerRepository: airbyte/source-bigquery
githubIssueLabel: source-bigquery
icon: bigquery.svg
license: MIT
license: ELv2
name: BigQuery
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mongodb-strict-encrypt/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-mongodb-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.19
LABEL io.airbyte.version=0.2.0
LABEL io.airbyte.name=airbyte/source-mongodb-strict-encrypt
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mongodb-strict-encrypt/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b2e713cd-cc36-4c0a-b5bd-b47cb8a0561e
dockerImageTag: 0.1.19
dockerImageTag: 0.2.0
dockerRepository: airbyte/source-mongodb-strict-encrypt
githubIssueLabel: source-mongodb-v2
icon: mongodb.svg
license: MIT
license: ELv2
name: MongoDb
releaseStage: alpha
documentationUrl: https://docs.airbyte.com/integrations/sources/mongodb-v2
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mongodb-v2/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-mongodb-v2

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.19
LABEL io.airbyte.version=0.2.0
LABEL io.airbyte.name=airbyte/source-mongodb-v2
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mongodb-v2/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b2e713cd-cc36-4c0a-b5bd-b47cb8a0561e
dockerImageTag: 0.1.19
dockerImageTag: 0.2.0
dockerRepository: airbyte/source-mongodb-v2
githubIssueLabel: source-mongodb-v2
icon: mongodb.svg
license: MIT
license: ELv2
name: MongoDb
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mssql-strict-encrypt/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-mssql-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=1.0.19
LABEL io.airbyte.version=1.1.0
LABEL io.airbyte.name=airbyte/source-mssql-strict-encrypt
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mssql-strict-encrypt/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b5ea17b1-f170-46dc-bc31-cc744ca984c1
dockerImageTag: 1.0.19
dockerImageTag: 1.1.0
dockerRepository: airbyte/source-mssql-strict-encrypt
githubIssueLabel: source-mssql
icon: mssql.svg
license: MIT
license: ELv2
name: Microsoft SQL Server (MSSQL)
releaseStage: alpha
documentationUrl: https://docs.airbyte.com/integrations/sources/mssql
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mssql/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-mssql

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=1.0.19
LABEL io.airbyte.version=1.1.0
LABEL io.airbyte.name=airbyte/source-mssql
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mssql/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b5ea17b1-f170-46dc-bc31-cc744ca984c1
dockerImageTag: 1.0.19
dockerImageTag: 1.1.0
dockerRepository: airbyte/source-mssql
githubIssueLabel: source-mssql
icon: mssql.svg
license: MIT
license: ELv2
name: Microsoft SQL Server (MSSQL)
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mysql-strict-encrypt/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,6 @@ ENV APPLICATION source-mysql-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=2.0.25
LABEL io.airbyte.version=2.1.0

LABEL io.airbyte.name=airbyte/source-mysql-strict-encrypt
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mysql-strict-encrypt/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: 435bb9a5-7887-4809-aa58-28c27df0d7ad
dockerImageTag: 2.0.25
dockerImageTag: 2.1.0
dockerRepository: airbyte/source-mysql-strict-encrypt
githubIssueLabel: source-mysql
icon: mysql.svg
license: MIT
license: ELv2
name: MySQL
releaseStage: beta
documentationUrl: https://docs.airbyte.com/integrations/sources/mysql
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-mysql/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,6 @@ ENV APPLICATION source-mysql

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=2.0.25
LABEL io.airbyte.version=2.1.0

LABEL io.airbyte.name=airbyte/source-mysql
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-mysql/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: 435bb9a5-7887-4809-aa58-28c27df0d7ad
dockerImageTag: 2.0.25
dockerImageTag: 2.1.0
dockerRepository: airbyte/source-mysql
githubIssueLabel: source-mysql
icon: mysql.svg
license: MIT
license: ELv2
name: MySQL
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-oracle-strict-encrypt/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,5 @@ ENV TZ UTC

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.3.24
LABEL io.airbyte.version=0.4.0
LABEL io.airbyte.name=airbyte/source-oracle-strict-encrypt
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-oracle-strict-encrypt/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b39a7370-74c3-45a6-ac3a-380d48520a83
dockerImageTag: 0.3.24
dockerImageTag: 0.4.0
dockerRepository: airbyte/source-oracle-strict-encrypt
githubIssueLabel: source-oracle
icon: oracle.svg
license: MIT
license: ELv2
name: Oracle DB
releaseStage: alpha
documentationUrl: https://docs.airbyte.com/integrations/sources/oracle
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-oracle/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV TZ UTC
COPY build/distributions/${APPLICATION}*.tar ${APPLICATION}.tar
RUN tar xf ${APPLICATION}.tar --strip-components=1

LABEL io.airbyte.version=0.3.25
LABEL io.airbyte.version=0.4.0
LABEL io.airbyte.name=airbyte/source-oracle
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-oracle/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: b39a7370-74c3-45a6-ac3a-380d48520a83
dockerImageTag: 0.3.25
dockerImageTag: 0.4.0
dockerRepository: airbyte/source-oracle
githubIssueLabel: source-oracle
icon: oracle.svg
license: MIT
license: ELv2
name: Oracle DB
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-postgres-strict-encrypt/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-postgres-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=2.0.34
LABEL io.airbyte.version=2.1.0
LABEL io.airbyte.name=airbyte/source-postgres-strict-encrypt
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-postgres-strict-encrypt/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@ data:
connectorType: source
definitionId: decd338e-5647-4c0b-adf4-da0e75f5a750
maxSecondsBetweenMessages: 7200
dockerImageTag: 2.0.34
dockerImageTag: 2.1.0
dockerRepository: airbyte/source-postgres-strict-encrypt
githubIssueLabel: source-postgres
icon: postgresql.svg
license: MIT
license: ELv2
name: Postgres
releaseStage: generally_available
documentationUrl: https://docs.airbyte.com/integrations/sources/postgres
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-postgres/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-postgres

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=2.0.34
LABEL io.airbyte.version=2.1.0
LABEL io.airbyte.name=airbyte/source-postgres
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-postgres/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,12 @@ data:
connectorSubtype: database
connectorType: source
definitionId: decd338e-5647-4c0b-adf4-da0e75f5a750
dockerImageTag: 2.0.34
dockerImageTag: 2.1.0
maxSecondsBetweenMessages: 7200
dockerRepository: airbyte/source-postgres
githubIssueLabel: source-postgres
icon: postgresql.svg
license: MIT
license: ELv2
name: Postgres
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-redshift/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-redshift

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.3.17
LABEL io.airbyte.version=0.4.0
LABEL io.airbyte.name=airbyte/source-redshift
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-redshift/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: e87ffa8e-a3b5-f69c-9076-6011339de1f6
dockerImageTag: 0.3.17
dockerImageTag: 0.4.0
dockerRepository: airbyte/source-redshift
githubIssueLabel: source-redshift
icon: redshift.svg
license: MIT
license: ELv2
name: Redshift
registries:
cloud:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-snowflake/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,5 +24,5 @@ ENV APPLICATION source-snowflake

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.36
LABEL io.airbyte.version=0.2.0
LABEL io.airbyte.name=airbyte/source-snowflake
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-snowflake/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,11 @@ data:
connectorSubtype: database
connectorType: source
definitionId: e2d65910-8c8b-40a1-ae7d-ee2416b2bfa2
dockerImageTag: 0.1.36
dockerImageTag: 0.2.0
dockerRepository: airbyte/source-snowflake
githubIssueLabel: source-snowflake
icon: snowflake.svg
license: MIT
license: ELv2
name: Snowflake
registries:
cloud:
Expand Down
90 changes: 45 additions & 45 deletions docs/integrations/sources/bigquery.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,41 +18,41 @@ The BigQuery source does not alter the schema present in your database. Dependin

The BigQuery data types mapping:

| BigQuery Type | Resulting Type | Notes |
| :--- | :--- | :--- |
| `BOOL` | Boolean | |
| `INT64` | Number | |
| `FLOAT64` | Number | |
| `NUMERIC` | Number | |
| `BIGNUMERIC` | Number | |
| `STRING` | String | |
| `BYTES` | String | |
| `DATE` | String | In ISO8601 format |
| `DATETIME` | String | In ISO8601 format |
| `TIMESTAMP` | String | In ISO8601 format |
| `TIME` | String | |
| `ARRAY` | Array | |
| `STRUCT` | Object | |
| `GEOGRAPHY` | String | |
| BigQuery Type | Resulting Type | Notes |
| :------------ | :------------- | :---------------- |
| `BOOL` | Boolean | |
| `INT64` | Number | |
| `FLOAT64` | Number | |
| `NUMERIC` | Number | |
| `BIGNUMERIC` | Number | |
| `STRING` | String | |
| `BYTES` | String | |
| `DATE` | String | In ISO8601 format |
| `DATETIME` | String | In ISO8601 format |
| `TIMESTAMP` | String | In ISO8601 format |
| `TIME` | String | |
| `ARRAY` | Array | |
| `STRUCT` | Object | |
| `GEOGRAPHY` | String | |

### Features

| Feature | Supported | Notes |
| :--- | :--- | :--- |
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes | |
| Change Data Capture | No | |
| SSL Support | Yes | |
| Feature | Supported | Notes |
| :------------------ | :-------- | :---- |
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes | |
| Change Data Capture | No | |
| SSL Support | Yes | |

## Getting started

### Requirements

To use the BigQuery source, you'll need:

* A Google Cloud Project with BigQuery enabled
* A Google Cloud Service Account with the "BigQuery User" and "BigQuery Data Editor" roles in your GCP project
* A Service Account Key to authenticate into your Service Account
- A Google Cloud Project with BigQuery enabled
- A Google Cloud Service Account with the "BigQuery User" and "BigQuery Data Editor" roles in your GCP project
- A Service Account Key to authenticate into your Service Account

See the setup guide for more information about how to create the required resources.

Expand All @@ -76,30 +76,30 @@ Follow the [Creating and Managing Service Account Keys](https://cloud.google.com

You should now have all the requirements needed to configure BigQuery as a source in the UI. You'll need the following information to configure the BigQuery source:

* **Project ID**
* **Default Dataset ID \[Optional\]**: the schema name if only one schema is interested. Dramatically boost source discover operation.
* **Credentials JSON**: the contents of your Service Account Key JSON file
- **Project ID**
- **Default Dataset ID \[Optional\]**: the schema name if only one schema is interested. Dramatically boost source discover operation.
- **Credentials JSON**: the contents of your Service Account Key JSON file

Once you've configured BigQuery as a source, delete the Service Account Key from your computer.

## CHANGELOG

### source-bigquery

| Version | Date | Pull Request | Subject |
| :--- | :--- | :--- | :--- |
| 0.2.3 | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.2.2 | 2022-09-22 | [16902](https://github.com/airbytehq/airbyte/pull/16902) | Source BigQuery: added user agent header |
| 0.2.1 | 2022-09-14 | [15668](https://github.com/airbytehq/airbyte/pull/15668) | Wrap logs in AirbyteLogMessage |
| 0.2.0 | 2022-07-26 | [14362](https://github.com/airbytehq/airbyte/pull/14362) | Integral columns are now discovered as int64 fields. |
| 0.1.9 | 2022-07-14 | [14574](https://github.com/airbytehq/airbyte/pull/14574) | Removed additionalProperties:false from JDBC source connectors |
| 0.1.8 | 2022-06-17 | [13864](https://github.com/airbytehq/airbyte/pull/13864) | Updated stacktrace format for any trace message errors |
| 0.1.7 | 2022-04-11 | [11484](https://github.com/airbytehq/airbyte/pull/11484) | BigQuery connector escape column names |
| 0.1.6 | 2022-02-14 | [10256](https://github.com/airbytehq/airbyte/pull/10256) | Add `-XX:+ExitOnOutOfMemoryError` JVM option |
| 0.1.5 | 2021-12-23 | [8434](https://github.com/airbytehq/airbyte/pull/8434) | Update fields in source-connectors specifications |
| 0.1.4 | 2021-09-30 | [\#6524](https://github.com/airbytehq/airbyte/pull/6524) | Allow `dataset_id` null in spec |
| 0.1.3 | 2021-09-16 | [\#6051](https://github.com/airbytehq/airbyte/pull/6051) | Handle NPE `dataset_id` is not provided |
| 0.1.2 | 2021-09-16 | [\#6135](https://github.com/airbytehq/airbyte/pull/6135) | 🐛 BigQuery source: Fix nested structs |
| 0.1.1 | 2021-07-28 | [\#4981](https://github.com/airbytehq/airbyte/pull/4981) | 🐛 BigQuery source: Fix nested arrays |
| 0.1.0 | 2021-07-22 | [\#4457](https://github.com/airbytehq/airbyte/pull/4457) | 🎉 New Source: Big Query. |

| Version | Date | Pull Request | Subject |
| :------ | :--------- | :------------------------------------------------------- | :---------------------------------------------------------------------------------------------------------------------------------------- |
| 0.3.0 | 2023-06-26 | [27737](https://github.com/airbytehq/airbyte/pull/27737) | License Update: Elv2 |
| 0.2.3 | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.2.2 | 2022-09-22 | [16902](https://github.com/airbytehq/airbyte/pull/16902) | Source BigQuery: added user agent header |
| 0.2.1 | 2022-09-14 | [15668](https://github.com/airbytehq/airbyte/pull/15668) | Wrap logs in AirbyteLogMessage |
| 0.2.0 | 2022-07-26 | [14362](https://github.com/airbytehq/airbyte/pull/14362) | Integral columns are now discovered as int64 fields. |
| 0.1.9 | 2022-07-14 | [14574](https://github.com/airbytehq/airbyte/pull/14574) | Removed additionalProperties:false from JDBC source connectors |
| 0.1.8 | 2022-06-17 | [13864](https://github.com/airbytehq/airbyte/pull/13864) | Updated stacktrace format for any trace message errors |
| 0.1.7 | 2022-04-11 | [11484](https://github.com/airbytehq/airbyte/pull/11484) | BigQuery connector escape column names |
| 0.1.6 | 2022-02-14 | [10256](https://github.com/airbytehq/airbyte/pull/10256) | Add `-XX:+ExitOnOutOfMemoryError` JVM option |
| 0.1.5 | 2021-12-23 | [8434](https://github.com/airbytehq/airbyte/pull/8434) | Update fields in source-connectors specifications |
| 0.1.4 | 2021-09-30 | [\#6524](https://github.com/airbytehq/airbyte/pull/6524) | Allow `dataset_id` null in spec |
| 0.1.3 | 2021-09-16 | [\#6051](https://github.com/airbytehq/airbyte/pull/6051) | Handle NPE `dataset_id` is not provided |
| 0.1.2 | 2021-09-16 | [\#6135](https://github.com/airbytehq/airbyte/pull/6135) | 🐛 BigQuery source: Fix nested structs |
| 0.1.1 | 2021-07-28 | [\#4981](https://github.com/airbytehq/airbyte/pull/4981) | 🐛 BigQuery source: Fix nested arrays |
| 0.1.0 | 2021-07-22 | [\#4457](https://github.com/airbytehq/airbyte/pull/4457) | 🎉 New Source: Big Query. |
Loading

0 comments on commit 9ce3cc6

Please sign in to comment.