-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Source Jira: Add Board, Epic, and Sprint-related streams and improve …
…request caching (#6621) * Create separate cache file per stream and add projects and start_date config * Add project id to issue record * Add projectId to issue schema * Add BoardIssues stream * Add SprintIssues stream * Add Epics stream and deduplicate state code * Add EpicIssues stream and additional fields for Issues stream * Add story points to sprint issues * Add new streams to test catalog * Update gitignore * Rename cache boolean and fix test catalog * Fix streams that depend on Issues stream * Fix sprint_issues stream * Add more fields to issues stream and format * Add option to expand issue changelogs * Remove epic_issues stream * Expand project descriptions * Show rendered fields for epics * Include project key * Include project key in issues stream * Address comments * Use CDK caching * Remove extra changes * Fix sprints stream reading from non-scrum boards * Format
- Loading branch information
Showing
10 changed files
with
430 additions
and
123 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
4 changes: 3 additions & 1 deletion
4
airbyte-integrations/connectors/source-jira/integration_tests/invalid_config.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,7 @@ | ||
{ | ||
"api_token": "invalid_token", | ||
"domain": "invaliddomain.atlassian.net", | ||
"email": "test@test.com" | ||
"email": "test@test.com", | ||
"projects": ["invalidproject"], | ||
"start_date": "2021-09-25T00:00:00Z" | ||
} |
24 changes: 24 additions & 0 deletions
24
airbyte-integrations/connectors/source-jira/source_jira/schemas/board_issues.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
{ | ||
"$schema": "http://json-schema.org/draft-07/schema#", | ||
"type": "object", | ||
"properties": { | ||
"expand": { | ||
"type": "string" | ||
}, | ||
"id": { | ||
"type": "string" | ||
}, | ||
"self": { | ||
"type": "string" | ||
}, | ||
"key": { | ||
"type": "string" | ||
}, | ||
"fields": { | ||
"type": "object" | ||
}, | ||
"boardId": { | ||
"type": "string" | ||
} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -16,6 +16,9 @@ | |
}, | ||
"projectId": { | ||
"type": "string" | ||
}, | ||
"projectKey": { | ||
"type": "string" | ||
} | ||
} | ||
} |
64 changes: 64 additions & 0 deletions
64
airbyte-integrations/connectors/source-jira/source_jira/schemas/epics.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,64 @@ | ||
{ | ||
"$schema": "http://json-schema.org/draft-07/schema#", | ||
"type": "object", | ||
"properties": { | ||
"expand": { | ||
"type": "string", | ||
"description": "Expand options that include additional issue details in the response.", | ||
"readOnly": true, | ||
"xml": { | ||
"attribute": true | ||
} | ||
}, | ||
"id": { | ||
"type": "string", | ||
"description": "The ID of the epic.", | ||
"readOnly": true | ||
}, | ||
"self": { | ||
"type": "string", | ||
"description": "The URL of the epic details.", | ||
"format": "uri", | ||
"readOnly": true | ||
}, | ||
"key": { | ||
"type": "string", | ||
"description": "The key of the epic.", | ||
"readOnly": true | ||
}, | ||
"fields": { | ||
"type": "object", | ||
"properties": { | ||
"summary": { | ||
"type": ["string", "null"], | ||
"description": "Epic summary" | ||
}, | ||
"description": { | ||
"type": ["string", "null"], | ||
"description": "Epic description" | ||
}, | ||
"status": { | ||
"type": ["string", "object"], | ||
"description": "Epic status" | ||
}, | ||
"updated": { | ||
"type": ["string", "null"], | ||
"format": "date-time", | ||
"description": "This field is not shown in schema / swagger, but exists in records and we use it as cursor fiekd." | ||
} | ||
}, | ||
"additionalProperties": {} | ||
}, | ||
"projectId": { | ||
"type": "string", | ||
"description": "The ID of the project containing the epic.", | ||
"readOnly": true | ||
}, | ||
"projectKey": { | ||
"type": "string", | ||
"description": "The key of the project containing the epic.", | ||
"readOnly": true | ||
} | ||
}, | ||
"additionalProperties": false | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
24 changes: 24 additions & 0 deletions
24
airbyte-integrations/connectors/source-jira/source_jira/schemas/sprint_issues.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
{ | ||
"$schema": "http://json-schema.org/draft-07/schema#", | ||
"type": "object", | ||
"properties": { | ||
"expand": { | ||
"type": "string" | ||
}, | ||
"id": { | ||
"type": "string" | ||
}, | ||
"self": { | ||
"type": "string" | ||
}, | ||
"key": { | ||
"type": "string" | ||
}, | ||
"fields": { | ||
"type": "object" | ||
}, | ||
"sprintId": { | ||
"type": "number" | ||
} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.