Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade nixpkgs to release 23.11 #18311

Closed
siddarthkay opened this issue Dec 28, 2023 · 9 comments · Fixed by #19369
Closed

Upgrade nixpkgs to release 23.11 #18311

siddarthkay opened this issue Dec 28, 2023 · 9 comments · Fixed by #19369
Assignees
Labels

Comments

@siddarthkay
Copy link
Contributor

siddarthkay commented Dec 28, 2023

A nixpkgs upgrade is available 23.11 -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

This solves our requirement to upgrade golang beyond 1.20

changes form our existing 23.05 -> NixOS/nixpkgs@23.05...23.11

@siddarthkay siddarthkay changed the title Upgrade nixpkgs to release 23.11 Upgrade nixpkgs to release 23.11 Dec 28, 2023
@siddarthkay
Copy link
Contributor Author

siddarthkay commented Dec 28, 2023

first challenge I faced when building with 23.11 is with zprint 1.2.8

------------------------------------------------------------------------------------------------------------------------
Produced artifacts:
 /private/tmp/nix-build-zprint-1.2.8.drv-0/zprint (executable)
========================================================================================================================
Finished generating 'zprint' in 5m 51s.
buildPhase completed in 5 minutes 54 seconds
installing
post-installation fixup
checking for references to /private/tmp/nix-build-zprint-1.2.8.drv-0/ in /
nix/store/32l504qgj32mh1yxwmgs9qsz2wdykvvl-zprint-1.2.8...
patching script interpreter paths in /nix/store/32l504qgj32mh1yxwmgs9qsz2wdykvvl-zprint-1.2.8
stripping (with command strip and flags -S) in  
/nix/store/32l504qgj32mh1yxwmgs9qsz2wdykvvl-zprint-1.2.8/bin
error: output '/nix/store/32l504qgj32mh1yxwmgs9qsz2wdykvvl-zprint-1.2.8' is not allowed to refer 
to the following paths:
/nix/store/gy4xl9nhyyc17fsxjqnq4inyncwbqcv8-graalvm-ce-21.0.1
error: build of '/nix/store/1gng5my9ipv4yghm4y16chna3bz9chkf-zprint-1.2.8.drv',
'/nix/store/ngkg5qa2702a4vcc9axj606gww190p8m-clj-kondo-2023.09.07.drv',
'/nix/store/zrbjql28c6rsiv2z8jsba3l07pm9a8gb-clojure-lsp-2023.08.06-00.28.06.drv' 
 failed

maybe @yqrashawn can help?

@siddarthkay siddarthkay linked a pull request Dec 29, 2023 that will close this issue
5 tasks
@siddarthkay
Copy link
Contributor Author

This issue is potentially related to java being bumped up to 21 in this nixpkgs release...

@yqrashawn
Copy link
Contributor

It's fixed here NixOS/nixpkgs#269479
But not in 23.1.1
Can we use master? Or it's too unstable?

@siddarthkay
Copy link
Contributor Author

Nice, thanks for the reference @yqrashawn : I too was trying to remove those references manually.
But I can try using the commit mentioned in this PR :)

@siddarthkay
Copy link
Contributor Author

That error is fixed now the next challenge is building go-mobile for android
stacktrace below

error: builder for '/nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv' 
failed with exit code 1;
       last 10 log lines:
       > building
       >
       > Building status-go for: android/arm64
       > /nix/store/cpm4xfas3c0s5zl0k70wsybl4a39llz7-gomobile-unstable-2022-05-18/bin/gomobile: 
       /nix/store/cpm4xfas3c0s5zl0k70wsybl4a39llz7-gomobile-unstable-2022-05-18/bin/gobind -lang=go,java 
       -outdir=/private/tmp/nix-build-status-go-0.171.39-debfe1c-android.drv-0/gomobile-work -tags=
       gowaku_skip_migrations,gowaku_no_rln github.com/status-im/status-go/mobile failed: exit status 1
       > unable to import bind/java: [-: # golang.org/x/mobile/bind/java
       > go/src/golang.org/x/mobile/bind/java/context_android.go:9:10: fatal error: 'jni.h' file not found
       > #include <jni.h>
       >          ^~~~~~~
       > 1 error generated.]
       >
       For full logs, run 
       'nix log /nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv'.
error: build of '/nix/store/9d6c6zba0dwva2r6xj86zc4hlzxy3zcf-watchman-4.9.0.drv',
 '/nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv', 
 '/nix/store/nam12rxlzaiwgnkr2cr55cg1lw73khsj-status-mobile-node-deps-1.25.0-patched.drv' failed
make: *** [run-android] Error 1

@jakubgs
Copy link
Member

jakubgs commented Jan 2, 2024

Can we use master? Or it's too unstable?

@yqrashawn I would avoid using master as indeed it is unstable. Either we should wait for the fix to go into nixos-23.11 or we have to fork nixos-23.11 and apply the fix there.

@siddarthkay
Copy link
Contributor Author

That error is fixed now the next challenge is building go-mobile for android stacktrace below

error: builder for '/nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv' 
failed with exit code 1;
       last 10 log lines:
       > building
       >
       > Building status-go for: android/arm64
       > /nix/store/cpm4xfas3c0s5zl0k70wsybl4a39llz7-gomobile-unstable-2022-05-18/bin/gomobile: 
       /nix/store/cpm4xfas3c0s5zl0k70wsybl4a39llz7-gomobile-unstable-2022-05-18/bin/gobind -lang=go,java 
       -outdir=/private/tmp/nix-build-status-go-0.171.39-debfe1c-android.drv-0/gomobile-work -tags=
       gowaku_skip_migrations,gowaku_no_rln github.com/status-im/status-go/mobile failed: exit status 1
       > unable to import bind/java: [-: # golang.org/x/mobile/bind/java
       > go/src/golang.org/x/mobile/bind/java/context_android.go:9:10: fatal error: 'jni.h' file not found
       > #include <jni.h>
       >          ^~~~~~~
       > 1 error generated.]
       >
       For full logs, run 
       'nix log /nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv'.
error: build of '/nix/store/9d6c6zba0dwva2r6xj86zc4hlzxy3zcf-watchman-4.9.0.drv',
 '/nix/store/hmv9pf8szjdpw34nhybim221zrr0vvia-status-go-0.171.39-debfe1c-android.drv', 
 '/nix/store/nam12rxlzaiwgnkr2cr55cg1lw73khsj-status-mobile-node-deps-1.25.0-patched.drv' failed
make: *** [run-android] Error 1

This was an issue with gomobile and was fixed by upgrading go to 1.20 and using this commit as a patch : golang/mobile@406ed3a

@siddarthkay
Copy link
Contributor Author

new issues yay :

iOS build fails on CI with :

[2024-03-22T16:10:36.477Z] [StatusImPR] Processing Info.plist
[2024-03-22T16:10:36.477Z] [StatusImPR] Running script Bundle React Native code and images
[2024-03-22T16:10:36.477Z] ** ARCHIVE FAILED **
[2024-03-22T16:10:36.477Z] 
[2024-03-22T16:10:36.477Z] 
[2024-03-22T16:10:36.477Z] The following build commands failed:
[2024-03-22T16:10:36.478Z] 	PhaseScriptExecution Bundle\ React\ Native\ code\ and\ images /Users/jenkins/
Library/Developer/Xcode/DerivedData/StatusIm-duvifmrkbphbxndmvvwbjhurkcbx/Build/
Intermediates.noindex/ArchiveIntermediates/StatusImPR/IntermediateBuildFilesPath/StatusIm.build/
Release-iphoneos/StatusImPR.build/Script-3AAD2AD524A3A60E0075D594.sh 
(in target 'StatusImPR' from project 'StatusIm')
[2024-03-22T16:10:36.478Z] (1 failure)
[2024-03-22T16:10:36.478Z] [StatusImPR] Generating Status\ PR.app.dSYM
[2024-03-22T16:10:36.478Z] [18:10:35]: Exit status: 65

@siddarthkay
Copy link
Contributor Author

second issue locally when running make shell TARGET=ios is :

error: builder for '/nix/store/y9mrh8y22ggnj1j7l1pxnq1cxamrbwpq-xcode-wrapper-plus-15.0.drv' 
failed with exit code 141

and when trying to inspect the derivation i get :

[nix-shell:/nix/store]$ nix derivation show yng7zcgghnwyharghq09rncg74hwi2yd-xcode-wrapper-15.0.drv
path '/nix/store/yng7zcgghnwyharghq09rncg74hwi2yd-xcode-wrapper-15.0.drv' 
does not contain a 'flake.nix', searching up
error: could not find a flake.nix file

siddarthkay added a commit that referenced this issue Mar 25, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 25, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 26, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 26, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 27, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 27, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 27, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 29, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Mar 29, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Golang` from `1.19` -> `1.20`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Apr 1, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Apr 1, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Apr 1, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
siddarthkay added a commit that referenced this issue Apr 1, 2024
fixes #18311

This PR upgrades `nixpkgs` to latest release version of 23-11
ref -> https://github.com/NixOS/nixpkgs/releases/tag/23.11

- `Gradle` from `8.0.1` -> `8.4`
- `Git` from `2.40.1` -> `2.42.0`
- `Curl` from `8.0.1` -> `8.4.0`
- `OpenSSL` from `3.0.8` -> `3.0.13`
- `NodeJS` from `18.16.0` -> `18.19.1`
-  `Python` from `3.10.11` -> `3.10.13`
- `Clojure` from `1.11.1.1273` -> `1.11.1.1413`
- and some more stuff

- `xcbeautify` , this was added in 23-11 ->NixOS/nixpkgs#289446
- `idb-companion`, this was also added in 23-11 -> NixOS/nixpkgs#296440
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants