-
Notifications
You must be signed in to change notification settings - Fork 397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(streaming): add new s3 streaming utility #1719
feat(streaming): add new s3 streaming utility #1719
Conversation
Codecov ReportBase: 99.27% // Head: 98.22% // Decreases project coverage by
Additional details and impacted files@@ Coverage Diff @@
## develop #1719 +/- ##
===========================================
- Coverage 99.27% 98.22% -1.06%
===========================================
Files 129 137 +8
Lines 6086 6304 +218
Branches 407 427 +20
===========================================
+ Hits 6042 6192 +150
- Misses 20 81 +61
- Partials 24 31 +7
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. ☔ View full report at Codecov. |
8e7b6f2
to
e1b7e05
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
superb! Added some initial comments before I have more bandwidth for a full review.
Pushed the final docs changes, including docs index and project readme to highlight as a new feature too. |
775e6f0
to
28e2040
Compare
Issue number: #1692
Summary
This PR adds a new utility to stream data from S3.
Changes
New utility called
streaming
and a newS3Object
class. Includes common data transformations and a wayto implement custom data transformations and add them to the data pipeline.
User experience
Checklist
If your change doesn't seem to apply, please leave them unchecked.
Is this a breaking change?
RFC issue number:
Checklist:
Acknowledgment
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.
View rendered docs/utilities/streaming.md