Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix BigQuery RowAsDictJsonCoder output type in Python 3 #7727

Merged
merged 1 commit into from
Feb 5, 2019

Conversation

charlesccychen
Copy link
Contributor

This change allows the BigQuery tornadoes example pipeline to run on Dataflow with Python 3.


Follow this checklist to help us incorporate your contribution quickly and easily:

  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

@charlesccychen
Copy link
Contributor Author

R: @tvalentyn @aaltay
CC: @markflyhigh

@tvalentyn
Copy link
Contributor

Run Python Postcommit

@tvalentyn
Copy link
Contributor

Run Python PostCommit

@tvalentyn
Copy link
Contributor

Run Python Postcommit

@tvalentyn
Copy link
Contributor

Run Python Postcommit

@charlesccychen
Copy link
Contributor Author

Run Portable_Python PreCommit

@charlesccychen
Copy link
Contributor Author

Run Python PreCommit

except ValueError as e:
raise ValueError('%s. %s' % (e, JSON_COMPLIANCE_ERROR))

def decode(self, encoded_table_row):
return json.loads(encoded_table_row)
return json.loads(encoded_table_row.decode('utf-8'))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please check that this works with Tornadoes example on DirectRunner?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this continues to work with both DirectRunner and DataflowRunner.

@charlesccychen charlesccychen merged commit d11c128 into apache:master Feb 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants