Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load GitHub's Releases #53

Merged
merged 3 commits into from
Feb 21, 2019
Merged

Load GitHub's Releases #53

merged 3 commits into from
Feb 21, 2019

Conversation

raphael-riel
Copy link
Contributor

(Will not load tag-only releases as seen in this repo's release tab)

Tested against: https://github.com/foosel/OctoPrint/releases

Output:

(tap-github) ~/p/tap-github> (tap-github-iTq1Y_tM) python tap_github.py -c config.json --properties properties.json
{"type": "STATE", "value": {}}
INFO Starting sync of repository: foosel/OctoPrint
{"type": "SCHEMA", "stream": "releases", "schema": {"selected": true, "type": ["null", "object"], "additionalProperties": false, "properties": {"_sdc_repository": {"type": ["string"]}, "id": {"type": ["null", "string"]}, "url": {"type": ["null", "string"]}, "html_url": {"type": ["null", "string"]}, "target_commitish": {"type": ["null", "string"]}, "tag_name": {"type": ["null", "string"]}, "name": {"type": ["null", "string"]}, "body": {"type": ["null", "string"]}, "draft": {"type": ["null", "boolean"]}, "prerelease": {"type": ["null", "boolean"]}, "author": {"type": ["null", "object"], "additionalProperties": false, "properties": {"login": {"type": ["null", "string"]}, "id": {"type": ["null", "integer"]}}}, "created_at": {"type": ["null", "string"], "format": "date-time"}, "published_at": {"type": ["null", "string"], "format": "date-time"}}}, "key_properties": ["id"]}
INFO METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.3798220157623291, "tags": {"endpoint": "releases", "http_status_code": 200, "status": "succeeded"}}
WARNING Removed 22 paths during transforms:
	assets
	assets_url
	author.avatar_url
	author.events_url
	author.followers_url
	author.following_url
	author.gists_url
	author.gravatar_id
	author.html_url
	author.node_id
	author.organizations_url
	author.received_events_url
	author.repos_url
	author.site_admin
	author.starred_url
	author.subscriptions_url
	author.type
	author.url
	node_id
	tarball_url
	upload_url
	zipball_url
WARNING Removed paths list: ['assets', 'assets_url', 'author.avatar_url', 'author.events_url', 'author.followers_url', 'author.following_url', 'author.gists_url', 'author.gravatar_id', 'author.html_url', 'author.node_id', 'author.organizations_url', 'author.received_events_url', 'author.repos_url', 'author.site_admin', 'author.starred_url', 'author.subscriptions_url', 'author.type', 'author.url', 'node_id', 'tarball_url', 'upload_url', 'zipball_url']

[snip]

{"type": "RECORD", "stream": "releases", "record": {"url": "https://api.github.com/repos/foosel/OctoPrint/releases/78203", "html_url": "https://github.com/foosel/OctoPrint/releases/tag/1.0.0-rc1", "id": "78203", "tag_name": "1.0.0-rc1", "target_commitish": "master", "name": "1.0.0 RC 1", "draft": false, "author": {"login": "foosel", "id": 83657}, "prerelease": true, "created_at": "2013-10-20T12:39:38.000000Z", "published_at": "2013-10-28T17:02:32.000000Z", "body": "", "_sdc_repository": "foosel/OctoPrint"}, "time_extracted": "2019-01-17T20:58:53.443766Z"}
INFO METRIC: {"type": "counter", "metric": "record_count", "value": 76, "tags": {"endpoint": "releases"}}
{"type": "STATE", "value": {"bookmarks": {"foosel/OctoPrint": {"releases": {"since": "2019-01-17T20:58:53.443766Z"}}}}}
(tap-github) ~/p/tap-github> (tap-github-iTq1Y_tM)

Please take note of the "skipped" bookmark while loading.

@sminnee
Copy link
Contributor

sminnee commented Feb 9, 2019

Seems reasonable to me.

@KAllan357
Copy link
Contributor

Thanks!

@KAllan357 KAllan357 merged commit acac606 into singer-io:master Feb 21, 2019
@KAllan357
Copy link
Contributor

Released in 1.4.0

AJWurts pushed a commit to villagelabsco/tap-github that referenced this pull request Oct 24, 2024
* Schema for Releases

* Load Releases from API

* Remove the probably non-working bookmark
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants