Skip to content
This repository has been archived by the owner on May 3, 2023. It is now read-only.

Add Travis-CI config to build aarch64 wheels #99

Merged
merged 1 commit into from
Oct 3, 2020
Merged

Add Travis-CI config to build aarch64 wheels #99

merged 1 commit into from
Oct 3, 2020

Conversation

janaknat
Copy link
Contributor

@janaknat janaknat commented Sep 9, 2020

Travis-CI allows for the creation of aarch64 wheels.

Graviton2 instances can be used to build aarch64 artifacts by using the following tag:

arch: arm64-graviton2
dist: focal
virt: vm
group: edge

@janaknat
Copy link
Contributor Author

janaknat commented Sep 9, 2020

This will require the tests be run in travis-ci.com instead of travis-ci.org.

The steps to transition can be found at: https://docs.travis-ci.com/user/migrate/open-source-repository-migration
A PR for additional info on migration: travis-ci/docs-travis-ci-com#2886

Successful build log: https://travis-ci.com/github/janaknat/pandas-wheels/builds/183585039

@janaknat
Copy link
Contributor Author

Blog post detailing Graviton2 support in Travis-CI: https://blog.travis-ci.com/2020-09-11-arm-on-aws

@TomAugspurger
Copy link
Contributor

Thanks. Is NumPy building and shipping aarch64 wheels?

@janaknat
Copy link
Contributor Author

@TomAugspurger Yes NumPy has started shipping aarch64 wheels: https://pypi.org/project/numpy/#files

@janaknat
Copy link
Contributor Author

Any feedback on this?

@TomAugspurger
Copy link
Contributor

TomAugspurger commented Sep 14, 2020 via email

@mattip
Copy link

mattip commented Sep 14, 2020

NumPy is not using travis-ci.com, it is using travis-ci.org. In order to move to travis-ci.com, as I have commented elsewhere, we need a way to resolve the issue that creating a travis-ci.com login requires giving them read-write access to all your private and public github repos.

@janaknat
Copy link
Contributor Author

@mattip @TomAugspurger Can we migrate Macpython/pandas-wheels to travis-ci.com and try with Graviton2? Similar to what was done with scipy-wheels (MacPython/scipy-wheels#93).

@mattip
Copy link

mattip commented Sep 28, 2020

I can do the legwork to migrate the repo (under my alias @multibuilder) if the core maintainers sign off on the idea. This would mean they would now need to sign into travis-ci.com rather than travis-ci.org or ask me in order to manage the build settings: set secrets, stop/start specific builds. Automatic triggering would work as before. We recently migrated the scipy-wheel build to travis-ci.com, so this second migration should be easier.

@janaknat
Copy link
Contributor Author

@TomAugspurger Is migration to travis-ci.com okay?

@TomAugspurger
Copy link
Contributor

@mattip if you're able to do the migration under the @multibulider account, that'd be great.

@mattip
Copy link

mattip commented Sep 30, 2020

Closing/Reopening to trigger the build on travis-ci.com

@mattip mattip closed this Sep 30, 2020
@mattip mattip reopened this Sep 30, 2020
@mattip
Copy link

mattip commented Sep 30, 2020

For future reference the steps are:

  • go to MacPython/settings (for org owners) ->installed github apps -> add the repo that wishes to migrate
  • go to https://travis-ci.com/organizations/MacPython/migrate (again, for org owners), the repo should appear there. Authorize the transition.
  • come back to a PR, close/open to restart the build.

So you can ignore the "continuous-integration/travis-ci/pr" CI failure, since that is from the old webhook at travis-ci.org and look at the "Travis CI - Pull Request" line instead, which should take you to travis-ci.com.

@janaknat
Copy link
Contributor Author

Thanks @mattip

.travis.yml Outdated
- MB_ML_VER=2014
- DOCKER_TEST_IMAGE=multibuild/xenial_arm64v8
# Following generated with
# travis encrypt -r MacPython/pandas-wheels WHEELHOUSE_UPLOADER_SECRET=<the api key>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Has this secret been uploaded? I don't see it in https://travis-ci.com/github/MacPython/pandas-wheels/settings, but I'm not sure if I should be seeing it.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are correct. The secret is wrong anyway, it should be the secret(s) from anaconda.org, like the azure pipeline.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So someone will need to add those tokens to travis-ci.com

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added PANDAS_STAGING_UPLOAD_TOKEN and PANDAS_NIGHTLY_UPLOAD_TOKEN through the travis UI.

.travis.yml Outdated Show resolved Hide resolved
.travis.yml Outdated Show resolved Hide resolved
@TomAugspurger
Copy link
Contributor

Alrighty, hopefully this works. Thanks for your help here Matti and @janaknat.

@TomAugspurger TomAugspurger merged commit a8b157b into MacPython:master Oct 3, 2020
This was referenced Nov 27, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants