perlPackages.XMLParser fails to cross-compile #36675

bgamari · 2018-03-09T17:34:19Z

Issue description

Cross-compiling perlPackages.XMLParser on nixpkgs' staging branch (e.g. with @shlevy's perl cross-compilation patch, 306d5cd) fails.

Steps to reproduce

$ git -C nixpkgs show
commit 306d5cdf03ad6375861a20b8885ef38699ca3c23
...
$ cat test.nix
let
  nixpkgs = import ./nixpkgs {};
  crossPkgs = import ./nixpkgs { crossSystem = nixpkgs.lib.systems.examples.armv7l-hf-multiplatform; };
in crossPkgs.perlPackages.XMLParser
$ nix-build ./test.nix
...
patching sources
configuring
patching ./samples/xmlfilter...
patching ./samples/canonical...
patching ./samples/xmlstats...
patching ./samples/xmlcomments...

Expat must be installed prior to building XML::Parser and I can't find
it in the standard library directories. Install 'expat-devel' package with your
OS package manager. See 'README'.

Or you can download expat from:

http://sourceforge.net/projects/expat/

If expat is installed, but in a non-standard directory, then use the
following options to Makefile.PL:

    EXPATLIBPATH=...  To set the directory in which to find libexpat

    EXPATINCPATH=...  To set the directory in which to find expat.h

For example:

    perl Makefile.PL EXPATLIBPATH=/home/me/lib EXPATINCPATH=/home/me/include

Note that if you build against a shareable library in a non-standard location
you may (on some platforms) also have to set your LD_LIBRARY_PATH environment
variable at run time for perl to find the library.

Checking if your kit is complete...
Warning: prerequisite LWP 0 not found.
Looks good
ERROR from evaluation of /tmp/nix-build-perl-XML-Parser-2.41-arm-unknown-linux-gnueabihf.drv-0/XML-Parser-2.41/Expat/Makefile.PL: Can't load module Tie::Hash::NamedCapture, dynamic loading not available in this perl.
  (You may need to build a new perl executable which either supports
  dynamic loading or has the Tie::Hash::NamedCapture module statically linked into it.)
 at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
Compilation failed in require at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
BEGIN failed--compilation aborted at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
Compilation failed in require at ./Makefile.PL line 3.
BEGIN failed--compilation aborted at ./Makefile.PL line 3.
builder for '/nix/store/g4qzia34nq5r4zizhp3vhl712lavqrkd-perl-XML-Parser-2.41-arm-unknown-linux-gnueabihf.drv' failed with exit code 255
error: build of '/nix/store/g4qzia34nq5r4zizhp3vhl712lavqrkd-perl-XML-Parser-2.41-arm-unknown-linux-gnueabihf.drv' failed

Technical details

Hmmm...

$ nix-shell -p nix-info --run "nix-info -m"
error: undefined variable 'nix-info' at (string):1:94
(use '--show-trace' to show detailed location information)

The text was updated successfully, but these errors were encountered:

shlevy · 2018-03-11T20:23:22Z

@bgamari I'm not really sure what's causing this, and am not sure when I'll have a chance to dig in... sorry!

bgamari · 2018-03-11T21:06:44Z

Perhaps we should back out the perl cross-compilation support until this is fixed? This is currently a bit of a regression from master.

shlevy · 2018-03-11T21:17:24Z

Wait, how did this work on master? You can't cross-compile perl modules at all there.

bgamari · 2018-03-11T23:50:48Z

Shea Levy <notifications@github.com> writes:

Wait, how did this work on master? You can't cross-compile perl modules at all there.

IIRC it works via binfmt.

shlevy · 2018-03-12T00:23:22Z

I'm a bit hesitant to revert an unambiguous if partial improvement for the pure true cross-country case, but I don't want to gratuitously break things, even inherently impure/unsupported things like binfmt for cross. Do you have any thoughts on how you can fit your needs without requiring us to solve all binfmt-capable cases at once?

bgamari · 2018-03-12T15:02:47Z

I'm a bit hesitant to revert an unambiguous if partial improvement for the pure true cross-country case

Quite understandable; I also don't mind just reverting the patch in my branch.

shlevy · 2018-03-12T16:17:44Z

cross-country

😅

Anyway, I'd like to look at a full build-native perl for cross-compilation, and hopefully when we can get that in it will address this or make it easier to debug.

bgamari · 2018-03-27T20:01:42Z

@shlevy fixed this in (IIRC) cb88f21.

bgamari · 2018-04-23T02:23:42Z

Hmmm, is this actually fixed, @shlevy? I still seem to be seeing it on a variant of cd2cb15.

shlevy · 2018-04-23T10:06:15Z

What error are you getting?

bgamari · 2018-04-23T18:01:48Z

The same error as was reported above:

ERROR from evaluation of /tmp/nix-build-perl-XML-Parser-2.41-arm-unknown-linux-gnueabihf.drv-0/XML-Parser-2.41/Expat/Makefile.PL: Can't load module Tie::Hash::NamedCapture, dynamic loading not available in this perl.
  (You may need to build a new perl executable which either supports
  dynamic loading or has the Tie::Hash::NamedCapture module statically linked into it.)
 at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
Compilation failed in require at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
BEGIN failed--compilation aborted at /nix/store/1v96mbpfg5g9n58b74q5yafdfbhl1kj9-perl-5.24.3-arm-unknown-linux-gnueabihf/lib/perl5/5.24.3/English.pm line 155.
Compilation failed in require at ./Makefile.PL line 3.
BEGIN failed--compilation aborted at ./Makefile.PL line 3.

shlevy · 2018-04-24T11:40:45Z

Did this ever work for you since my perl cross changes?

bgamari · 2018-04-24T16:14:18Z

I thought so but this seems to suggest I was wrong. Reopening.

dtzWill · 2018-04-24T23:32:20Z

subscribes

ElvishJerricco · 2018-06-04T03:15:39Z

I'm also getting this. I think it's caused by the check_lib usage. http://search.cpan.org/~mattn/Devel-CheckLib-1.13/lib/Devel/CheckLib.pm Looks like it will use the native C compiler that was used to build perl to check if the linker flags work. Obviously this won't work when cross compiling. Derp that's just a warning.

ElvishJerricco · 2018-06-04T03:39:01Z

In the meantime, I'm reverting 54a13b0 locally as a workaround. That commit broke @shlevy's work on cross compiling NixOS.

bgamari · 2018-07-31T15:31:31Z

I don't mean to instigate a scripting-language-war but it seems like a nice way around this issue would be to reimplement these scripts in a language more suitable to cross-compilation (e.g. Python). Continuing to use perl in this capacity is almost certain to be a persistent source of cross-compilation headaches.

shlevy · 2018-07-31T15:56:55Z

💯

ElvishJerricco · 2018-07-31T16:31:24Z

Yea. Eliminating as much perl as possible from NixOS would be a big win IMO.

c0bw3b · 2018-11-21T12:28:18Z

Fixed in #48258

bgamari closed this as completed Mar 27, 2018

bgamari reopened this Apr 24, 2018

bgamari mentioned this issue May 20, 2018

[RFC] A large batch of cross-compilation fixes #30882

Closed

8 tasks

bgamari mentioned this issue Oct 14, 2018

[WIP] Port switch-to-configuration script to Python #48378

Closed

9 tasks

c0bw3b added the 6.topic: cross-compilation Building packages on a different platform than they will be used on label Nov 21, 2018

c0bw3b closed this as completed Nov 21, 2018

erictapen mentioned this issue Nov 8, 2019

perlPackages.XMLParser: cross compilation is broken #73011

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

perlPackages.XMLParser fails to cross-compile #36675

perlPackages.XMLParser fails to cross-compile #36675

bgamari commented Mar 9, 2018 •

edited

Loading

shlevy commented Mar 11, 2018

bgamari commented Mar 11, 2018 •

edited

Loading

shlevy commented Mar 11, 2018

bgamari commented Mar 11, 2018 via email

shlevy commented Mar 12, 2018

bgamari commented Mar 12, 2018

shlevy commented Mar 12, 2018

bgamari commented Mar 27, 2018

bgamari commented Apr 23, 2018

shlevy commented Apr 23, 2018

bgamari commented Apr 23, 2018

shlevy commented Apr 24, 2018

bgamari commented Apr 24, 2018

dtzWill commented Apr 24, 2018

ElvishJerricco commented Jun 4, 2018 •

edited

Loading

ElvishJerricco commented Jun 4, 2018

bgamari commented Jul 31, 2018

shlevy commented Jul 31, 2018

ElvishJerricco commented Jul 31, 2018

c0bw3b commented Nov 21, 2018

perlPackages.XMLParser fails to cross-compile #36675

perlPackages.XMLParser fails to cross-compile #36675

Comments

bgamari commented Mar 9, 2018 • edited Loading

Issue description

Steps to reproduce

Technical details

shlevy commented Mar 11, 2018

bgamari commented Mar 11, 2018 • edited Loading

shlevy commented Mar 11, 2018

bgamari commented Mar 11, 2018 via email

shlevy commented Mar 12, 2018

bgamari commented Mar 12, 2018

shlevy commented Mar 12, 2018

bgamari commented Mar 27, 2018

bgamari commented Apr 23, 2018

shlevy commented Apr 23, 2018

bgamari commented Apr 23, 2018

shlevy commented Apr 24, 2018

bgamari commented Apr 24, 2018

dtzWill commented Apr 24, 2018

ElvishJerricco commented Jun 4, 2018 • edited Loading

ElvishJerricco commented Jun 4, 2018

bgamari commented Jul 31, 2018

shlevy commented Jul 31, 2018

ElvishJerricco commented Jul 31, 2018

c0bw3b commented Nov 21, 2018

bgamari commented Mar 9, 2018 •

edited

Loading

bgamari commented Mar 11, 2018 •

edited

Loading

ElvishJerricco commented Jun 4, 2018 •

edited

Loading