-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
State that Datastore IO is not supported in Streaming scenario. #7758
Conversation
R: @aaltay |
2fcf23f
to
9f9015a
Compare
@@ -53,6 +53,9 @@ | |||
|
|||
class ReadFromDatastore(PTransform): | |||
"""A ``PTransform`` for reading from Google Cloud Datastore. | |||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can drop this change. Web site changes are sufficient. The reasons this notice is not consistent, there are other IOs that will not work in streaming mode and they do not have comments. It is also likely to not get updated as the support is added.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I still feel that we should add such information to code base as well.
But concerned of two independent sources of truth that can go out of sync.
9f9015a
to
e95ca0b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you
* Initial plumbing for collection group queries * Don't assume direct children for collection group queries. * trim document path to DocumentReference * add unit tests * ensure all_descendants is set after calling other query methods * port test for node impl * port tests from node impl * Fix collection group test on Python 2.7. Blacken. * Use '_all_descendants' in 'Query.__eq__'. * Ensure '_all_descendants' propagates when narrowing query. * Refactor collection group system tests. Skip the one for 'where', because it requires a custom index. * Match node test's collection group ID / expected output. See: https://github.com/googleapis/nodejs-firestore/pull/578/files#diff-6b8febc8d51ea01205628091b3611eacR1188 * Match Node test for filter on '__name__'. Note that this still doesn't pass, so remains skipped. * Blacken. * Fix / unskip systest for collection groups w/ filter on '__name__'. * Blacken * 100% coverage. * Lint
Users try to utilize Datastore IO with Python Streaming that is not supported.
Explicitly state in documentation that this scenario is not supported.
Follow this checklist to help us incorporate your contribution quickly and easily:
[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.It will help us expedite review of your Pull Request if you tag someone (e.g.
@username
) to look at it.Post-Commit Tests Status (on master branch)