Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-5315] Partially port Avroio module #7644

Merged
merged 3 commits into from
Feb 4, 2019

Conversation

RobbeSneyders
Copy link
Contributor

@RobbeSneyders RobbeSneyders commented Jan 28, 2019

This is is part of a series of PRs with goal to make Apache Beam PY3 compatible. The proposal with the outlined approach has been documented here: https://s.apache.org/beam-python-3.

This PR partially ports the avroio module.
4 tests (2x the same 2 tests, for Avro and FastAvro) are still failing. I created BEAM-6522 to track this.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
--- --- --- ---

@RobbeSneyders
Copy link
Contributor Author

Tests currently fail due to tox.ini changes. When #7583 gets merged, this should not be an issue anymore.

@tvalentyn
Copy link
Contributor

retest this please

1 similar comment
@tvalentyn
Copy link
Contributor

retest this please

@tvalentyn
Copy link
Contributor

tvalentyn commented Jan 30, 2019

Thanks @RobbeSneyders . @aaltay or @charlesccychen - please help with the merge. Thank you!

@aaltay
Copy link
Member

aaltay commented Jan 31, 2019

hey @RobbeSneyders could you resolve the conflict please?

commands =
python --version
pip --version
{toxinidir}/scripts/run_tox_cleanup.sh
python setup.py nosetests --tests {[testenv:py3]modules}
python apache_beam/examples/complete/autocomplete_test.py
python setup.py nosetests --ignore-files vcfio_test\.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about we skip VCF IO tests in Python 3, to keep tox.ini cleaner?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mean let's add @skip statement to the test class in vcfio_test.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, sounds good.

commands =
python --version
pip --version
{toxinidir}/scripts/run_tox_cleanup.sh
python setup.py nosetests --tests {[testenv:py3]modules}
python apache_beam/examples/complete/autocomplete_test.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like this line shouldn't be here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test is executed in all other tox environments. I don't know why it is added separately, so I also don't know why we shouldn't do it in Python 3.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As per 245facd we try to execute one test outside of the test suite to make sure nothing fails if we do so.

@RobbeSneyders
Copy link
Contributor Author

PTAL

@tvalentyn
Copy link
Contributor

LGTM. Thank you.

@charlesccychen
Copy link
Contributor

Thanks, this LGTM.

@charlesccychen charlesccychen merged commit eaa902c into apache:master Feb 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants