Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

linux/bootstrap-tools: move libstdc++ out of default library search path #209054

Merged
merged 1 commit into from
Jan 12, 2023

Conversation

trofi
Copy link
Contributor

@trofi trofi commented Jan 4, 2023

This change allows building new gcc during bootstrap without fear of pulling in outdated libstdc++.so after g++ switched from bootstrapTools to freshly built g++.

Noticed when tried to add early bootstrap stage to rebuild gcc before glibc is fully untangled from bootstrapTools as a failure to built binutils:

ld: dwp.o: in function `__gnu_cxx::new_allocator<gold::Dwp_output_file::Contribution>::allocate(unsigned long, void const*)':
/nix/store/...-gcc-11.3.0/include/c++/11.3.0/ext/new_allocator.h:116: undefined reference to `std::__throw_bad_array_new_length()'

The change survives existing bootstrap and unblockes early gcc bootstrap.

Description of changes
Things done
  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 23.05 Release Notes (or backporting 22.11 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
    • (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes
  • Fits CONTRIBUTING.md.

This change allows building new gcc during bootstrap without fear of
pulling in outdated libstdc++.so after g++ switched from bootstrapTools
to freshly built g++.

Noticed when tried to add early bootstrap stage to rebuild `gcc` before
`glibc` is fully untangled from `bootstrapTools` as a failure to built
`binutils`:

    ld: dwp.o: in function `__gnu_cxx::new_allocator<gold::Dwp_output_file::Contribution>::allocate(unsigned long, void const*)':
    /nix/store/...-gcc-11.3.0/include/c++/11.3.0/ext/new_allocator.h:116: undefined reference to `std::__throw_bad_array_new_length()'

The change survives existing bootstrap and unblockes early `gcc` bootstrap.
Copy link

@ghost ghost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+2 Thank you for figuring this out! We should definitely merge this.

@@ -17,6 +17,15 @@ else
LD_BINARY=$out/lib/ld-*so.?
fi

# path to version-specific libraries, like libstdc++.so
LIBSTDCXX_SO_DIR=$(echo $out/lib/gcc/*/*)
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I checked that for all 16 of our existing bootstrap-files tarballs there is only one subdirectory under lib/gcc, and only one subdirectory beneath that (unpack-bootstrap-tools.sh is a huge pain because every time we touch it we have to rebuild the whole universe).

@ghost ghost mentioned this pull request Jan 9, 2023
4 tasks
@trofi trofi requested a review from Ericson2314 January 9, 2023 21:19
@trofi trofi merged commit 4433093 into NixOS:staging Jan 12, 2023
@trofi trofi deleted the stdcxx-out-of-bootstrap-lib branch January 12, 2023 18:28
@trofi
Copy link
Contributor Author

trofi commented Jan 14, 2023

This regressed tests for bootstrap tarball building:

$ nix build --no-link -f ./pkgs/stdenv/linux/make-bootstrap-tools.nix
...
       > /nix/store/82k0qrddaa84i5nl3zv3f3bcadwwcxli-test-bootstrap-tools/bin/bar: error while loading shared libraries: libstdc++.so.6: cannot open shared object file: No such file or directory

I think it's a pure test issue. Test does not use any wrappers and assumes certain directory layout.

Looking.

trofi added a commit to trofi/nixpkgs that referenced this pull request Jan 14, 2023
After NixOS#209054 we started moving
libstdc++.so out of default glibc's paths. This exposed bootstrap
tools build failure as:

    $ nix build --no-link -f ./pkgs/stdenv/linux/make-bootstrap-tools.nix
    ...
    >
    .../bin/bar: error while loading shared libraries: libstdc++.so.6:
       cannot open shared object file: No such file or directory

Note that bootstrap itself did not break. The change only expands
handcrafted `-rpath` entries.
@trofi
Copy link
Contributor Author

trofi commented Jan 14, 2023

Proposed the fix as #210752

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant