Arch Migrator #46

regro-cf-autotick-bot · 2024-03-22T07:54:31Z

This feedstock is being rebuilt as part of the aarch64/ppc64le migration.

Feel free to merge the PR if CI is all green, but please don't close it
without reaching out the the ARM migrators first at @conda-forge/arm-arch.

If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

_{This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/8386951364, please use this URL for debugging.}

Fixes #36

…nda-forge-pinning 2024.03.21.15.27.47

conda-forge-webservices · 2024-03-22T07:54:39Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

…nda-forge-pinning 2024.07.02.10.47.51

Michael-J-Ward · 2024-09-20T13:27:30Z

@charlesbluca is there something I can do on the datafusion-python side to help with this?

Separately, is it safe to close apache/datafusion-python#701 as completed? This is the last open PR referenced in that issue, but my guess is that the current error is something other than the maturin version.

…nda-forge-pinning 2024.09.23.09.40.07

charlesbluca · 2024-09-23T15:13:53Z

@charlesbluca is there something I can do on the datafusion-python side to help with this?

The failures are a little foreign to me, just pushed latest main to this branch so we can have an updated picture of what's not working here

Separately, is it safe to close apache/datafusion-python#701 as completed?

Yup, I think at this point it's safe to close that out as resolved

jakirkham · 2024-10-02T18:28:32Z

@conda-forge-admin , please re-render

…nda-forge-pinning 2024.10.02.13.37.37

jakirkham · 2024-10-02T19:04:59Z

@conda-forge-admin , please re-render

…nda-forge-pinning 2024.10.02.13.37.37

conda-forge.yml

jakirkham · 2024-10-02T20:03:49Z

Seeing the following error on CI:

error: linking with `/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/bin/powerpc64le-conda-linux-gnu-cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/x86_64-unknown-linux-gnu/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/x86_64-unknown-linux-gnu/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/x86_64-unknown-linux-gnu/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/.cargo/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_/bin:/opt/conda/condabin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/bin:/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_/bin:/opt/conda/bin:/opt/conda/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/conda/bin" VSLANG="1033" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/bin/powerpc64le-conda-linux-gnu-cc" "-Wl,--version-script=/tmp/rustcOtpgS0/list" "-Wl,--no-undefined-version" "-m64" "/tmp/rustcOtpgS0/symbols.o" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/deps/datafusion_python.datafusion_python.4563b0520d950985-cgu.0.rcgu.o" "-Wl,--as-needed" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/deps" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/release/deps" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/build/bzip2-sys-ca7d57325964d3fd/out/lib" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/build/lzma-sys-dd952e7a922abd0d/out" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/build/zstd-sys-dad6231f79856429/out" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/build/ring-d9595e46809589f4/out" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/build/libmimalloc-sys-b76601fd01f468e4/out" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/powerpc64le-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/tmp/rustcOtpgS0/libring-10b0972fbbc585ba.rlib" "/tmp/rustcOtpgS0/libzstd_sys-783f7d7f2ba9e443.rlib" "/tmp/rustcOtpgS0/liblzma_sys-87b2372ba5946fb0.rlib" "/tmp/rustcOtpgS0/libbzip2_sys-6e775cde18ea21af.rlib" "/tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/powerpc64le-unknown-linux-gnu/lib/libcompiler_builtins-6bfd94ce73b7199e.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/lib/rustlib/powerpc64le-unknown-linux-gnu/lib" "-o" "/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/work/target/powerpc64le-unknown-linux-gnu/release/deps/libdatafusion_python.so" "-Wl,--gc-sections" "-shared" "-Wl,-soname=libdatafusion_python.so" "-Wl,-z,relro,-z,now" "-Wl,-O1" "-Wl,--strip-debug" "-nodefaultlibs" "-s" "-Wl,-rpath-link,/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_/lib" "-Wl,-rpath,/home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_/lib"
  = note: /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o): in function `_mi_process_init':
          static.c:(.text.startup._mi_process_init+0x58): relocation truncated to fit: R_PPC64_REL24 against symbol `atexit' defined in .text section in /home/conda/feedstock_root/build_artifacts/datafusion_1727896622153/_build_env/bin/../powerpc64le-conda-linux-gnu/sysroot/usr/lib64/libc_nonshared.a(atexit.oS)
          static.c:(.text.startup._mi_process_init+0x6c): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_options_init' defined in .text._mi_options_init section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x9c): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_prim_thread_init_auto_done' defined in .text._mi_prim_thread_init_auto_done section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0xb4): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_heap_set_default_direct' defined in .text._mi_heap_set_default_direct section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0xc8): relocation truncated to fit: R_PPC64_REL24 against symbol `mi_process_init' defined in .text.mi_process_init section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0xe0): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_random_reinit_if_weak' defined in .text._mi_random_reinit_if_weak section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x10c): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_thread_id' defined in .text._mi_thread_id section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x130): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_random_init' defined in .text._mi_random_init section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x148): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_heap_random_next' defined in .text._mi_heap_random_next section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x168): relocation truncated to fit: R_PPC64_REL24 against symbol `_mi_heap_random_next' defined in .text._mi_heap_random_next section in /tmp/rustcOtpgS0/liblibmimalloc_sys-7da080d6381c3c3d.rlib(98cfcaec7182b1d8-static.o)
          static.c:(.text.startup._mi_process_init+0x188): additional relocation overflows omitted from the output
          collect2: error: ld returned 1 exit status

jakirkham · 2024-10-02T20:24:56Z

recipe/build.sh

+# Taken from clangdev's recipe
+# https://github.com/conda-forge/clangdev-feedstock/blob/01fc5e3e0fc690db85151dcb3ff512e6aa876be7/recipe/build.sh#L51-L56
+# disable -fno-plt due to some GCC bug causing linker errors, see
+# https://github.com/llvm/llvm-project/issues/51205
+if [[ "$target_platform" == "linux-ppc64le" ]]; then
+  CFLAGS="$(echo $CFLAGS | sed 's/-fno-plt //g')"
+  CXXFLAGS="$(echo $CXXFLAGS | sed 's/-fno-plt //g')"
+fi
+


Looks like the aforementioned error ( #46 (comment) ) may be fixed by dropping the -fno-plt compiler flag. A similar approach is taken in the clangdev feedstock. Note this also references upstream issue ( llvm/llvm-project#51205 )

conda-forge.yml

jakirkham · 2024-10-02T21:29:29Z

@conda-forge-admin , please re-render

…nda-forge-pinning 2024.10.02.19.54.49

jakirkham · 2024-10-02T22:35:34Z

recipe/meta.yaml

 test:
-  imports:
-    - datafusion
  commands:
    - pip check
+    - python -c 'from importlib.util import find_spec; assert find_spec("datafusion")'
+    - python -c 'import datafusion'                                                     # [build_platform != target_platform]
  requires:
    - pip


This testing should work better when cross-compiling. Will allow us to reenable testing there

conda-forge.yml

jakirkham · 2024-10-02T22:37:14Z

@conda-forge-admin , please re-render

…nda-forge-pinning 2024.10.02.19.54.49

jakirkham · 2024-10-02T22:42:57Z

@conda-forge-admin , please re-render

…nda-forge-pinning 2024.10.02.19.54.49

recipe/meta.yaml

charlesbluca

Thanks @jakirkham!

charlesbluca · 2024-10-03T15:19:02Z

Looks like we're still seeing storage pressures during the resulting builds (link)

Hopefully shouldn't be a blocker to the ppc64le builds but worth noting if the swapfile changes weren't sufficient to resolve

EDIT:

Looks like we're all green!

https://github.com/conda-forge/datafusion-feedstock/runs/31036235544

jakirkham · 2024-10-03T18:23:53Z

Thanks Charles! 🙏

Also random question, which browser are you using?

charlesbluca · 2024-10-03T18:32:03Z

Was actually going to ask you the same question when I saw the vertical tabs in your screenshot 😂 what are you using?

I'm on Microsoft Edge, I've enjoyed the native support for vertical tabs and sidebar apps but could definitely leave the increased Copilot pushing and general Microsoft-isms behind

jakirkham · 2024-10-03T19:30:17Z

Actually the tabs are coming from Azure Pipelines. The browser is Safari

Ah ok. Thanks for sharing! 🙏

regro-cf-autotick-bot added 2 commits March 22, 2024 07:54

migration: ArchRebuild

b0e0592

MNT: Re-rendered with conda-build 24.1.2, conda-smithy 3.33.0, and co…

ac08e80

…nda-forge-pinning 2024.03.21.15.27.47

regro-cf-autotick-bot requested review from andygrove, charlesbluca and cpcloud as code owners March 22, 2024 07:54

charlesbluca mentioned this pull request Jun 12, 2024

Bump maturin version to satisfy conda-forge constraints? apache/datafusion-python#701

Closed

charlesbluca added 2 commits July 2, 2024 09:39

Merge remote-tracking branch 'upstream/main' into bot-pr_arch_h1e510c

62659b2

MNT: Re-rendered with conda-build 24.3.0, conda-smithy 3.36.2, and co…

2b81736

…nda-forge-pinning 2024.07.02.10.47.51

Michael-J-Ward mentioned this pull request Sep 20, 2024

Tracking issue for release of DF 42 apache/datafusion-python#879

Closed

7 tasks

charlesbluca added 2 commits September 23, 2024 08:07

Merge remote-tracking branch 'upstream/main' into bot-pr_arch_h0e510c

e9e0eba

MNT: Re-rendered with conda-build 24.3.0, conda-smithy 3.40.1, and co…

6fcbc44

…nda-forge-pinning 2024.09.23.09.40.07

Cross-compile all arch builds

85a7699

conda-forge-webservices[bot] and others added 2 commits October 2, 2024 18:31

MNT: Re-rendered with conda-build 24.9.0, conda-smithy 3.41.1, and co…

3c0891d

…nda-forge-pinning 2024.10.02.13.37.37

Remove Docker images from Azure too

fd3843d

MNT: Re-rendered with conda-build 24.9.0, conda-smithy 3.41.1, and co…

32dc910

…nda-forge-pinning 2024.10.02.13.37.37

jakirkham reviewed Oct 2, 2024

View reviewed changes

conda-forge.yml Outdated Show resolved Hide resolved

Drop -fno-plt on linux_ppc64le

3608b8c

jakirkham reviewed Oct 2, 2024

View reviewed changes

conda-forge.yml Show resolved Hide resolved

Run tests for native builds only

b7b4c91

conda-forge-webservices[bot] and others added 2 commits October 2, 2024 21:32

MNT: Re-rendered with conda-build 24.9.0, conda-smithy 3.41.1, and co…

e8165a5

…nda-forge-pinning 2024.10.02.19.54.49

Adapt testing for cross-compilation

dd0645b

jakirkham reviewed Oct 2, 2024

View reviewed changes

conda-forge.yml Outdated Show resolved Hide resolved

Enable testing when cross-compiling

e29f807

conda-forge-webservices[bot] and others added 2 commits October 2, 2024 22:40

MNT: Re-rendered with conda-build 24.9.0, conda-smithy 3.41.1, and co…

e8fe039

…nda-forge-pinning 2024.10.02.19.54.49

On Linux, use 20GiB swap file

6c63ba6

conda-forge-webservices[bot] and others added 3 commits October 2, 2024 22:45

MNT: Re-rendered with conda-build 24.9.0, conda-smithy 3.41.1, and co…

c64ef1a

…nda-forge-pinning 2024.10.02.19.54.49

Fix comparison to only import on native

6f2cafe

Bump build/number to 1

a4de1d2

jakirkham reviewed Oct 3, 2024

View reviewed changes

recipe/meta.yaml Outdated Show resolved Hide resolved

Changing quoting style in tests for Windows

166dba6

charlesbluca approved these changes Oct 3, 2024

View reviewed changes

charlesbluca merged commit c83386d into conda-forge:main Oct 3, 2024
26 checks passed

regro-cf-autotick-bot deleted the bot-pr_arch_h1e510c branch October 3, 2024 14:56

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Arch Migrator #46

Arch Migrator #46

regro-cf-autotick-bot commented Mar 22, 2024 •

edited by jakirkham

Loading

conda-forge-webservices bot commented Mar 22, 2024 •

edited by conda-forge-admin

Loading

Michael-J-Ward commented Sep 20, 2024

charlesbluca commented Sep 23, 2024

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

charlesbluca left a comment

charlesbluca commented Oct 3, 2024 •

edited

Loading

jakirkham commented Oct 3, 2024

charlesbluca commented Oct 3, 2024

jakirkham commented Oct 3, 2024

Arch Migrator #46

Arch Migrator #46

Conversation

regro-cf-autotick-bot commented Mar 22, 2024 • edited by jakirkham Loading

conda-forge-webservices bot commented Mar 22, 2024 • edited by conda-forge-admin Loading

Michael-J-Ward commented Sep 20, 2024

charlesbluca commented Sep 23, 2024

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

jakirkham Oct 2, 2024

Choose a reason for hiding this comment

jakirkham commented Oct 2, 2024

jakirkham Oct 2, 2024

Choose a reason for hiding this comment

jakirkham commented Oct 2, 2024

jakirkham commented Oct 2, 2024

charlesbluca left a comment

Choose a reason for hiding this comment

charlesbluca commented Oct 3, 2024 • edited Loading

jakirkham commented Oct 3, 2024

charlesbluca commented Oct 3, 2024

jakirkham commented Oct 3, 2024

regro-cf-autotick-bot commented Mar 22, 2024 •

edited by jakirkham

Loading

conda-forge-webservices bot commented Mar 22, 2024 •

edited by conda-forge-admin

Loading

charlesbluca commented Oct 3, 2024 •

edited

Loading