Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dotnet: november 2024 upgrades and infrastructure changes #355753

Merged
merged 29 commits into from
Nov 19, 2024

Conversation

corngood
Copy link
Contributor

@corngood corngood commented Nov 13, 2024

Cc: @NixOS/dotnet

Fixes: #355500
Closes: #355642

The big breaking infrastructure changes are:

  • dotnet: split setup hooks into wrapper for runtime/sdk

This allows the setup hooks for dotnet to be changed without sdk/runtime rebuilds (VMR etc).

  • dotnet: move dotnet_root to $out/share/dotnet

This is consistent with packaging guidelines.

  • write some release notes for these.

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@corngood
Copy link
Contributor Author

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 355753


x86_64-linux

❌ 1 package failed to build:
  • cavalier
✅ 167 packages built:
  • ArchiSteamFarm
  • alcom
  • alttpr-opentracker
  • am2rlauncher
  • avalonia
  • avalonia-ilspy
  • azure-functions-core-tools
  • beatsabermodmanager
  • bicep
  • bililiverecorder
  • blendfarm
  • boogie
  • btcpayserver
  • btcpayserver-altcoins
  • celeste64
  • certdump
  • clps2c-compiler
  • csharp-ls
  • csharpier
  • csharprepl
  • cyclonedx-cli
  • dafny
  • denaro
  • dependency-track
  • depotdownloader
  • discordchatexporter-cli
  • dotnet-aspnetcore
  • dotnet-aspnetcore_6
  • dotnet-aspnetcore_7
  • dotnet-outdated
  • dotnet-repl
  • dotnet-runtime
  • dotnet-runtime_6
  • dotnet-runtime_7
  • dotnet-sdk
  • dotnet-sdk_6
  • dotnet-sdk_7
  • dotnetCorePackages.aspnetcore_9_0
  • dotnetCorePackages.dotnet_8.aspnetcore
  • dotnetCorePackages.dotnet_8.aspnetcore.man
  • dotnetCorePackages.dotnet_8.runtime
  • dotnetCorePackages.dotnet_8.runtime.man
  • dotnetCorePackages.dotnet_8.sdk
  • dotnetCorePackages.dotnet_8.sdk.man
  • dotnetCorePackages.dotnet_8.vmr
  • dotnetCorePackages.dotnet_8.vmr.man
  • dotnetCorePackages.dotnet_9.aspnetcore
  • dotnetCorePackages.dotnet_9.aspnetcore.man
  • dotnetCorePackages.dotnet_9.runtime
  • dotnetCorePackages.dotnet_9.runtime.man
  • dotnetCorePackages.dotnet_9.sdk
  • dotnetCorePackages.dotnet_9.sdk.man
  • dotnetCorePackages.dotnet_9.vmr
  • dotnetCorePackages.dotnet_9.vmr.man
  • dotnetCorePackages.runtime_9_0
  • dotnetCorePackages.sdk_6_0_1xx
  • dotnetCorePackages.sdk_7_0_1xx
  • dotnetCorePackages.sdk_7_0_3xx
  • dotnetCorePackages.sdk_8_0_1xx
  • dotnetCorePackages.sdk_8_0_3xx
  • dotnetCorePackages.sdk_9_0
  • eventstore
  • fable
  • famistudio
  • fantomas
  • formula
  • fsautocomplete
  • galaxy-buds-client
  • garnet
  • gh-gei
  • git-credential-manager
  • github-runner
  • gitversion
  • godot3-mono
  • godot3-mono-debug-server
  • godot3-mono-export-templates
  • godot3-mono-headless
  • godot3-mono-headless.dev
  • godot3-mono-headless.man
  • godot3-mono-server
  • godot3-mono.dev
  • godot3-mono.man
  • godot_4-mono
  • godot_4-mono.debug
  • godot_4-mono.man
  • ilspycmd
  • inklecate
  • jackett
  • jellyfin
  • jetbrains.clion
  • jetbrains.rider
  • juniper
  • kavita
  • knossosnet
  • kryptor
  • libation
  • lidarr
  • lubelogger
  • lumafly
  • marksman
  • mqttmultimeter
  • msbuild
  • naps2
  • nbxplorer
  • netcoredbg
  • networkminer
  • nexusmods-app
  • nexusmods-app-unfree
  • omnisharp-roslyn
  • openra
  • opentabletdriver
  • openutau
  • osu-lazer
  • pablodraw
  • parabolic
  • pbm
  • pinta
  • pre-commit
  • pre-commit.dist
  • prowlarr
  • ps3-disc-dumper
  • pupdate
  • python311Packages.asteroid-filterbanks
  • python311Packages.asteroid-filterbanks.dist
  • python311Packages.clr-loader
  • python311Packages.clr-loader.dist
  • python311Packages.pyannote-audio
  • python311Packages.pyannote-audio.dist
  • python311Packages.pythonnet
  • python311Packages.pythonnet.dist
  • python312Packages.asteroid-filterbanks
  • python312Packages.asteroid-filterbanks.dist
  • python312Packages.clr-loader
  • python312Packages.clr-loader.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • python312Packages.pythonnet
  • python312Packages.pythonnet.dist
  • radarr
  • readarr
  • recyclarr
  • renode
  • renode-unstable
  • retrospy
  • roslyn
  • roslyn-ls
  • ryujinx
  • scarab
  • seq-cli
  • skeditor
  • slskd
  • smtp4dev
  • sonarr
  • space-station-14-launcher
  • tagger
  • technitium-dns-server
  • tone
  • torrentstream
  • upgrade-assistant
  • vintagestory
  • vrcadvert
  • wasabibackend
  • whisper-ctranslate2
  • whisper-ctranslate2.dist
  • wiseunpacker
  • xivlauncher
  • yafc-ce

@corngood corngood marked this pull request as ready for review November 14, 2024 19:39
@nix-owners nix-owners bot requested a review from jtojnar November 14, 2024 19:41
@github-actions github-actions bot added 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 8.has: documentation 8.has: changelog labels Nov 14, 2024
@@ -8,22 +8,24 @@
{ package ? null
, maintainer ? null
, predicate ? null
, get-script ? pkg: pkg.updateScript or null
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jtojnar would you mind taking a look at the update.nix changes?

I've used it to implement update-dotnet-lockfiles.nix, which is quite similar but uses a different attribute. This way it benefits from parallel execution, log aggregation and all the other good stuff the python script does.

I was wondering if aliases should just be unconditionally disabled?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I would just disable aliases unconditionally.

But why not just rename the fetch-deps to updateScript?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fetch-deps just does lockfile generation. It's often called from updateScript, but can be run on its own. Quite a few packages only have fetch-deps.

I've been thinking it would be nice to have some sort of abstraction of lockfile generation, but I'm not exactly sure where to start. I noticed that nix-update has --generate-lockfile, but it looks like that might only understand cargo lockfiles.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I would just disable aliases unconditionally.

this is done now

@GGG-KILLER
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 355753


x86_64-linux

⏩ 2 packages blacklisted:
  • nixos-install-tools
  • tests.nixos-functions.nixos-test
❌ 3 packages failed to build:
  • cavalier
  • slskd
  • tests.writers.simple.fsharpNoNugetDeps
✅ 181 packages built:
  • ArchiSteamFarm
  • alcom
  • alttpr-opentracker
  • am2rlauncher
  • avalonia
  • avalonia-ilspy
  • azure-functions-core-tools
  • beatsabermodmanager
  • bicep
  • bililiverecorder
  • blendfarm
  • boogie (dotnetPackages.Boogie)
  • btcpayserver
  • btcpayserver-altcoins
  • celeste64
  • certdump
  • clps2c-compiler
  • csharp-ls
  • csharpier
  • csharprepl
  • cyclonedx-cli
  • dafny
  • denaro
  • dependency-track
  • depotdownloader
  • discordchatexporter-cli
  • dotnet-aspnetcore (dotnet-aspnetcore_8 ,dotnetCorePackages.aspnetcore_8_0)
  • dotnet-aspnetcore_6 (dotnetCorePackages.aspnetcore_6_0)
  • dotnet-aspnetcore_7 (dotnetCorePackages.aspnetcore_7_0)
  • dotnet-outdated
  • dotnet-repl
  • dotnet-runtime (dotnet-runtime_8 ,dotnetCorePackages.runtime_8_0)
  • dotnet-runtime_6 (dotnetCorePackages.runtime_6_0)
  • dotnet-runtime_7 (dotnetCorePackages.runtime_7_0)
  • dotnet-sdk (dotnet-sdk_8 ,dotnetCorePackages.sdk_8_0 ,dotnetCorePackages.sdk_8_0_4xx)
  • dotnet-sdk_6 (dotnetCorePackages.sdk_6_0 ,dotnetCorePackages.sdk_6_0_4xx)
  • dotnet-sdk_7 (dotnetCorePackages.sdk_7_0 ,dotnetCorePackages.sdk_7_0_4xx)
  • dotnetCorePackages.aspnetcore_9_0
  • dotnetCorePackages.dotnet_8.aspnetcore
  • dotnetCorePackages.dotnet_8.aspnetcore.man
  • dotnetCorePackages.dotnet_8.runtime
  • dotnetCorePackages.dotnet_8.runtime.man
  • dotnetCorePackages.dotnet_8.sdk
  • dotnetCorePackages.dotnet_8.sdk.man
  • dotnetCorePackages.dotnet_8.vmr
  • dotnetCorePackages.dotnet_8.vmr.man
  • dotnetCorePackages.dotnet_9.aspnetcore
  • dotnetCorePackages.dotnet_9.aspnetcore.man
  • dotnetCorePackages.dotnet_9.runtime
  • dotnetCorePackages.dotnet_9.runtime.man
  • dotnetCorePackages.dotnet_9.sdk
  • dotnetCorePackages.dotnet_9.sdk.man
  • dotnetCorePackages.dotnet_9.vmr
  • dotnetCorePackages.dotnet_9.vmr.man
  • dotnetCorePackages.runtime_9_0
  • dotnetCorePackages.sdk_6_0_1xx
  • dotnetCorePackages.sdk_7_0_1xx
  • dotnetCorePackages.sdk_7_0_3xx
  • dotnetCorePackages.sdk_8_0_1xx
  • dotnetCorePackages.sdk_8_0_3xx
  • dotnetCorePackages.sdk_9_0 (dotnetCorePackages.sdk_9_0_1xx)
  • eventstore
  • fable
  • famistudio
  • fantomas
  • formula
  • fsautocomplete
  • galaxy-buds-client
  • garnet
  • gh-gei
  • git-credential-manager
  • github-runner
  • gitversion
  • godot3-mono
  • godot3-mono-debug-server
  • godot3-mono-export-templates
  • godot3-mono-headless
  • godot3-mono-headless.dev
  • godot3-mono-headless.man
  • godot3-mono-server
  • godot3-mono.dev
  • godot3-mono.man
  • godot_4-mono
  • godot_4-mono.debug
  • godot_4-mono.man
  • ilspycmd
  • inklecate
  • jackett
  • jellyfin
  • jetbrains.clion
  • jetbrains.rider
  • juniper
  • kavita
  • knossosnet
  • kryptor
  • libation
  • lidarr
  • lubelogger
  • lumafly
  • marksman
  • mqttmultimeter
  • msbuild
  • naps2
  • nbxplorer
  • netcoredbg
  • networkminer
  • nexusmods-app
  • nexusmods-app-unfree
  • omnisharp-roslyn
  • openra
  • opentabletdriver
  • openutau
  • osu-lazer
  • pablodraw
  • parabolic
  • pbm
  • pinta
  • pre-commit
  • pre-commit.dist
  • prowlarr
  • ps3-disc-dumper
  • pupdate
  • python311Packages.asteroid-filterbanks
  • python311Packages.asteroid-filterbanks.dist
  • python311Packages.clr-loader
  • python311Packages.clr-loader.dist
  • python311Packages.pyannote-audio
  • python311Packages.pyannote-audio.dist
  • python311Packages.pythonnet
  • python311Packages.pythonnet.dist
  • python312Packages.asteroid-filterbanks
  • python312Packages.asteroid-filterbanks.dist
  • python312Packages.clr-loader
  • python312Packages.clr-loader.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • python312Packages.pythonnet
  • python312Packages.pythonnet.dist
  • radarr
  • readarr
  • recyclarr
  • renode
  • renode-unstable
  • retrospy
  • roslyn
  • roslyn-ls
  • ryujinx
  • scarab
  • seq-cli
  • skeditor
  • smtp4dev
  • sonarr
  • space-station-14-launcher
  • tagger
  • technitium-dns-server
  • tests.dotnet.final-attrs.check-output
  • tests.dotnet.final-attrs.output-matches-const
  • tests.dotnet.final-attrs.override-has-no-effect
  • tests.dotnet.final-attrs.override-modifies-output
  • tests.dotnet.nuget-deps.derivation
  • tests.dotnet.nuget-deps.file
  • tests.dotnet.nuget-deps.list
  • tests.dotnet.nuget-deps.null
  • tests.dotnet.project-references
  • tests.dotnet.structured-attrs.check-output
  • tests.dotnet.structured-attrs.no-structured-attrs
  • tests.dotnet.use-dotnet-from-env.fallback
  • tests.dotnet.use-dotnet-from-env.use-dotnet-path-env
  • tests.dotnet.use-dotnet-from-env.use-dotnet-root-env
  • tests.dotnet.use-dotnet-from-env.without-fallback
  • tone
  • torrentstream
  • upgrade-assistant
  • vintagestory
  • vrcadvert
  • wasabibackend
  • whisper-ctranslate2
  • whisper-ctranslate2.dist
  • wiseunpacker
  • xivlauncher
  • yafc-ce

@GGG-KILLER
Copy link
Contributor

GGG-KILLER commented Nov 16, 2024

cavalier and slskd are due to unrelated packages being broken (cava-0.10.2 and nodejs-18.20.5 respectfully) so I think we can ignore them.

However tests.writers.simple.fsharpNoNugetDeps might be related to this and the logs show no signs of why:

test test-writers-fsharp-no-nuget-deps.fsx failed

@corngood
Copy link
Contributor Author

tests.writers.simple.fsharpNoNugetDeps should be fixed now.

@corngood
Copy link
Contributor Author

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review


aarch64-darwin

⏩ 10 packages marked as broken and skipped:
  • alcom
  • avalonia
  • certdump
  • pablodraw
  • python312Packages.asteroid-filterbanks
  • python312Packages.asteroid-filterbanks.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • whisper-ctranslate2
  • whisper-ctranslate2.dist
✅ 102 packages built:
  • ArchiSteamFarm
  • avalonia-ilspy
  • azure-functions-core-tools
  • bicep
  • bililiverecorder
  • blendfarm
  • boogie
  • btcpayserver
  • btcpayserver-altcoins
  • clps2c-compiler
  • csharp-ls
  • csharpier
  • csharprepl
  • cyclonedx-cli
  • dafny
  • dependency-track
  • depotdownloader
  • dotnet-aspnetcore
  • dotnet-aspnetcore_6
  • dotnet-aspnetcore_7
  • dotnet-outdated
  • dotnet-repl
  • dotnet-runtime
  • dotnet-runtime_6
  • dotnet-runtime_7
  • dotnet-sdk
  • dotnet-sdk_6
  • dotnet-sdk_7
  • dotnetCorePackages.aspnetcore_9_0
  • dotnetCorePackages.dotnet_8.aspnetcore
  • dotnetCorePackages.dotnet_8.aspnetcore.man
  • dotnetCorePackages.dotnet_8.runtime
  • dotnetCorePackages.dotnet_8.runtime.man
  • dotnetCorePackages.dotnet_8.sdk
  • dotnetCorePackages.dotnet_8.sdk.man
  • dotnetCorePackages.dotnet_8.vmr
  • dotnetCorePackages.dotnet_8.vmr.man
  • dotnetCorePackages.dotnet_9.aspnetcore
  • dotnetCorePackages.dotnet_9.aspnetcore.man
  • dotnetCorePackages.dotnet_9.runtime
  • dotnetCorePackages.dotnet_9.runtime.man
  • dotnetCorePackages.dotnet_9.sdk
  • dotnetCorePackages.dotnet_9.sdk.man
  • dotnetCorePackages.dotnet_9.vmr
  • dotnetCorePackages.dotnet_9.vmr.man
  • dotnetCorePackages.runtime_9_0
  • dotnetCorePackages.sdk_6_0_1xx
  • dotnetCorePackages.sdk_7_0_1xx
  • dotnetCorePackages.sdk_7_0_3xx
  • dotnetCorePackages.sdk_8_0_1xx
  • dotnetCorePackages.sdk_8_0_3xx
  • dotnetCorePackages.sdk_9_0
  • famistudio
  • fantomas
  • formula
  • fsautocomplete
  • garnet
  • gh-gei
  • git-credential-manager
  • github-runner
  • gitversion
  • ilspycmd
  • jackett
  • jellyfin
  • juniper
  • knossosnet
  • kryptor
  • libation
  • lubelogger
  • marksman
  • msbuild
  • nbxplorer
  • netcoredbg
  • omnisharp-roslyn
  • openutau
  • pre-commit
  • pre-commit.dist
  • prowlarr
  • python311Packages.asteroid-filterbanks
  • python311Packages.asteroid-filterbanks.dist
  • python311Packages.clr-loader
  • python311Packages.clr-loader.dist
  • python311Packages.pyannote-audio
  • python311Packages.pyannote-audio.dist
  • python311Packages.pythonnet
  • python311Packages.pythonnet.dist
  • python312Packages.clr-loader
  • python312Packages.clr-loader.dist
  • python312Packages.pythonnet
  • python312Packages.pythonnet.dist
  • radarr
  • recyclarr
  • roslyn
  • roslyn-ls
  • seq-cli
  • smtp4dev
  • sonarr
  • torrentstream
  • upgrade-assistant
  • vrcadvert
  • wiseunpacker
  • yafc-ce

@GGG-KILLER
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 355753


x86_64-linux

⏩ 2 packages blacklisted:
  • nixos-install-tools
  • tests.nixos-functions.nixos-test
❌ 13 packages failed to build:
  • cavalier
  • pre-commit
  • pre-commit.dist
  • python311Packages.asteroid-filterbanks
  • python311Packages.asteroid-filterbanks.dist
  • python311Packages.pyannote-audio
  • python311Packages.pyannote-audio.dist
  • python312Packages.asteroid-filterbanks
  • python312Packages.asteroid-filterbanks.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • whisper-ctranslate2
  • whisper-ctranslate2.dist
✅ 171 packages built:
  • ArchiSteamFarm
  • alcom
  • alttpr-opentracker
  • am2rlauncher
  • avalonia
  • avalonia-ilspy
  • azure-functions-core-tools
  • beatsabermodmanager
  • bicep
  • bililiverecorder
  • blendfarm
  • boogie (dotnetPackages.Boogie)
  • btcpayserver
  • btcpayserver-altcoins
  • celeste64
  • certdump
  • clps2c-compiler
  • csharp-ls
  • csharpier
  • csharprepl
  • cyclonedx-cli
  • dafny
  • denaro
  • dependency-track
  • depotdownloader
  • discordchatexporter-cli
  • dotnet-aspnetcore (dotnet-aspnetcore_8 ,dotnetCorePackages.aspnetcore_8_0)
  • dotnet-aspnetcore_6 (dotnetCorePackages.aspnetcore_6_0)
  • dotnet-aspnetcore_7 (dotnetCorePackages.aspnetcore_7_0)
  • dotnet-outdated
  • dotnet-repl
  • dotnet-runtime (dotnet-runtime_8 ,dotnetCorePackages.runtime_8_0)
  • dotnet-runtime_6 (dotnetCorePackages.runtime_6_0)
  • dotnet-runtime_7 (dotnetCorePackages.runtime_7_0)
  • dotnet-sdk (dotnet-sdk_8 ,dotnetCorePackages.sdk_8_0 ,dotnetCorePackages.sdk_8_0_4xx)
  • dotnet-sdk_6 (dotnetCorePackages.sdk_6_0 ,dotnetCorePackages.sdk_6_0_4xx)
  • dotnet-sdk_7 (dotnetCorePackages.sdk_7_0 ,dotnetCorePackages.sdk_7_0_4xx)
  • dotnetCorePackages.aspnetcore_9_0
  • dotnetCorePackages.dotnet_8.aspnetcore
  • dotnetCorePackages.dotnet_8.aspnetcore.man
  • dotnetCorePackages.dotnet_8.runtime
  • dotnetCorePackages.dotnet_8.runtime.man
  • dotnetCorePackages.dotnet_8.sdk
  • dotnetCorePackages.dotnet_8.sdk.man
  • dotnetCorePackages.dotnet_8.vmr
  • dotnetCorePackages.dotnet_8.vmr.man
  • dotnetCorePackages.dotnet_9.aspnetcore
  • dotnetCorePackages.dotnet_9.aspnetcore.man
  • dotnetCorePackages.dotnet_9.runtime
  • dotnetCorePackages.dotnet_9.runtime.man
  • dotnetCorePackages.dotnet_9.sdk
  • dotnetCorePackages.dotnet_9.sdk.man
  • dotnetCorePackages.dotnet_9.vmr
  • dotnetCorePackages.dotnet_9.vmr.man
  • dotnetCorePackages.runtime_9_0
  • dotnetCorePackages.sdk_6_0_1xx
  • dotnetCorePackages.sdk_7_0_1xx
  • dotnetCorePackages.sdk_7_0_3xx
  • dotnetCorePackages.sdk_8_0_1xx
  • dotnetCorePackages.sdk_8_0_3xx
  • dotnetCorePackages.sdk_9_0 (dotnetCorePackages.sdk_9_0_1xx)
  • eventstore
  • fable
  • famistudio
  • fantomas
  • formula
  • fsautocomplete
  • galaxy-buds-client
  • garnet
  • gh-gei
  • git-credential-manager
  • github-runner
  • gitversion
  • godot3-mono
  • godot3-mono-debug-server
  • godot3-mono-export-templates
  • godot3-mono-headless
  • godot3-mono-headless.dev
  • godot3-mono-headless.man
  • godot3-mono-server
  • godot3-mono.dev
  • godot3-mono.man
  • godot_4-mono
  • godot_4-mono.debug
  • godot_4-mono.man
  • ilspycmd
  • inklecate
  • jackett
  • jellyfin
  • jetbrains.clion
  • jetbrains.rider
  • juniper
  • kavita
  • knossosnet
  • kryptor
  • libation
  • lidarr
  • lubelogger
  • lumafly
  • marksman
  • mqttmultimeter
  • msbuild
  • naps2
  • nbxplorer
  • netcoredbg
  • networkminer
  • nexusmods-app
  • nexusmods-app-unfree
  • omnisharp-roslyn
  • openra
  • opentabletdriver
  • openutau
  • osu-lazer
  • pablodraw
  • parabolic
  • pbm
  • pinta
  • prowlarr
  • ps3-disc-dumper
  • pupdate
  • python311Packages.clr-loader
  • python311Packages.clr-loader.dist
  • python311Packages.pythonnet
  • python311Packages.pythonnet.dist
  • python312Packages.clr-loader
  • python312Packages.clr-loader.dist
  • python312Packages.pythonnet
  • python312Packages.pythonnet.dist
  • radarr
  • readarr
  • recyclarr
  • renode
  • renode-unstable
  • retrospy
  • roslyn
  • roslyn-ls
  • ryujinx
  • scarab
  • seq-cli
  • skeditor
  • slskd
  • smtp4dev
  • sonarr
  • space-station-14-launcher
  • tagger
  • technitium-dns-server
  • tests.dotnet.final-attrs.check-output
  • tests.dotnet.final-attrs.output-matches-const
  • tests.dotnet.final-attrs.override-has-no-effect
  • tests.dotnet.final-attrs.override-modifies-output
  • tests.dotnet.nuget-deps.derivation
  • tests.dotnet.nuget-deps.file
  • tests.dotnet.nuget-deps.list
  • tests.dotnet.nuget-deps.null
  • tests.dotnet.project-references
  • tests.dotnet.structured-attrs.check-output
  • tests.dotnet.structured-attrs.no-structured-attrs
  • tests.dotnet.use-dotnet-from-env.fallback
  • tests.dotnet.use-dotnet-from-env.use-dotnet-path-env
  • tests.dotnet.use-dotnet-from-env.use-dotnet-root-env
  • tests.dotnet.use-dotnet-from-env.without-fallback
  • tests.writers.simple.fsharpNoNugetDeps
  • tone
  • torrentstream
  • upgrade-assistant
  • vintagestory
  • vrcadvert
  • wasabibackend
  • wiseunpacker
  • xivlauncher
  • yafc-ce

@corngood
Copy link
Contributor Author

corngood commented Nov 18, 2024

@GGG-KILLER do you have any logs for those failures? whisper-ctranslate2 for example, builds locally for me, and isn't failing on hydra.

cavalier is fixed in staging (#355948)

@GGG-KILLER
Copy link
Contributor

GGG-KILLER commented Nov 18, 2024

@GGG-KILLER do you have any logs for those failures? whisper-ctranslate2 for example, builds locally for me, and isn't failing on hydra.

This all seems to be a result of pre-commit failing:

       For full logs, run 'nix log /nix/store/6agas29d8hbn70166fnk2r5vwgrqz7qz-pre-commit-4.0.1.drv'.
error: 1 dependencies of derivation '/nix/store/plmm6rfjx0qhdwzw1dc8d0rd8gznny90-python3.11-asteroid-filterbanks-0.4.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/pmara3wrf3bgfg0yissqncr0a5q7b6mw-python3.12-asteroid-filterbanks-0.4.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/dgf6sdif34w6yy201nni6fk573jpkvdz-python3.11-pyannote-audio-3.3.1.drv' failed to build
error: 1 dependencies of derivation '/nix/store/7fhxjf0mz7qghkpp4r0ix8c1qkkc0x6i-python3.12-pyannote-audio-3.3.1.drv' failed to build
run-test-writers-fsharp-no-nuget-deps.fsx> building '/nix/store/bipm7b12fjkqavv4s2j41bz1pdjpvzwf-run-test-writers-fsharp-no-nuget-deps.fsx.drv'
error: 1 dependencies of derivation '/nix/store/c0mhq810dirds3d25ag5pz5kzjyd61a6-whisper-ctranslate2-0.4.6.drv' failed to build

Which in turn failed because of a test (perhaps flaky?):

=================================== FAILURES ===================================
_______________________ test_install_pre_commit_and_run ________________________
[gw1] linux -- Python 3.12.7 /nix/store/px2nj16i5gc3d4mnw5l1nclfdxhry61p-python3-3.12.7/bin/python3.12
tempdir_factory = <tests.conftest.tempdir_factory.<locals>.TmpdirFactory object at 0x7fffe2ec6060>
store = <pre_commit.store.Store object at 0x7fffe2ec6090>

    def test_install_pre_commit_and_run(tempdir_factory, store):
        path = make_consuming_repo(tempdir_factory, 'script_hooks_repo')
        with cwd(path):
            assert install(C.CONFIG_FILE, store, hook_types=['pre-commit']) == 0
    
            ret, output = _get_commit_output(tempdir_factory)
>           assert ret == 0
E           assert 1 == 0

tests/commands/install_uninstall_test.py:160: AssertionError
----------------------------- Captured stdout call -----------------------------
pre-commit installed at .git/hooks/pre-commit

I'll try again, didn't even notice it finished since I just left it running and left to do something else 😅

@GGG-KILLER
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 355753


x86_64-linux

⏩ 2 packages blacklisted:
  • nixos-install-tools
  • tests.nixos-functions.nixos-test
❌ 1 package failed to build:
  • cavalier
✅ 183 packages built:
  • ArchiSteamFarm
  • alcom
  • alttpr-opentracker
  • am2rlauncher
  • avalonia
  • avalonia-ilspy
  • azure-functions-core-tools
  • beatsabermodmanager
  • bicep
  • bililiverecorder
  • blendfarm
  • boogie (dotnetPackages.Boogie)
  • btcpayserver
  • btcpayserver-altcoins
  • celeste64
  • certdump
  • clps2c-compiler
  • csharp-ls
  • csharpier
  • csharprepl
  • cyclonedx-cli
  • dafny
  • denaro
  • dependency-track
  • depotdownloader
  • discordchatexporter-cli
  • dotnet-aspnetcore (dotnet-aspnetcore_8 ,dotnetCorePackages.aspnetcore_8_0)
  • dotnet-aspnetcore_6 (dotnetCorePackages.aspnetcore_6_0)
  • dotnet-aspnetcore_7 (dotnetCorePackages.aspnetcore_7_0)
  • dotnet-outdated
  • dotnet-repl
  • dotnet-runtime (dotnet-runtime_8 ,dotnetCorePackages.runtime_8_0)
  • dotnet-runtime_6 (dotnetCorePackages.runtime_6_0)
  • dotnet-runtime_7 (dotnetCorePackages.runtime_7_0)
  • dotnet-sdk (dotnet-sdk_8 ,dotnetCorePackages.sdk_8_0 ,dotnetCorePackages.sdk_8_0_4xx)
  • dotnet-sdk_6 (dotnetCorePackages.sdk_6_0 ,dotnetCorePackages.sdk_6_0_4xx)
  • dotnet-sdk_7 (dotnetCorePackages.sdk_7_0 ,dotnetCorePackages.sdk_7_0_4xx)
  • dotnetCorePackages.aspnetcore_9_0
  • dotnetCorePackages.dotnet_8.aspnetcore
  • dotnetCorePackages.dotnet_8.aspnetcore.man
  • dotnetCorePackages.dotnet_8.runtime
  • dotnetCorePackages.dotnet_8.runtime.man
  • dotnetCorePackages.dotnet_8.sdk
  • dotnetCorePackages.dotnet_8.sdk.man
  • dotnetCorePackages.dotnet_8.vmr
  • dotnetCorePackages.dotnet_8.vmr.man
  • dotnetCorePackages.dotnet_9.aspnetcore
  • dotnetCorePackages.dotnet_9.aspnetcore.man
  • dotnetCorePackages.dotnet_9.runtime
  • dotnetCorePackages.dotnet_9.runtime.man
  • dotnetCorePackages.dotnet_9.sdk
  • dotnetCorePackages.dotnet_9.sdk.man
  • dotnetCorePackages.dotnet_9.vmr
  • dotnetCorePackages.dotnet_9.vmr.man
  • dotnetCorePackages.runtime_9_0
  • dotnetCorePackages.sdk_6_0_1xx
  • dotnetCorePackages.sdk_7_0_1xx
  • dotnetCorePackages.sdk_7_0_3xx
  • dotnetCorePackages.sdk_8_0_1xx
  • dotnetCorePackages.sdk_8_0_3xx
  • dotnetCorePackages.sdk_9_0 (dotnetCorePackages.sdk_9_0_1xx)
  • eventstore
  • fable
  • famistudio
  • fantomas
  • formula
  • fsautocomplete
  • galaxy-buds-client
  • garnet
  • gh-gei
  • git-credential-manager
  • github-runner
  • gitversion
  • godot3-mono
  • godot3-mono-debug-server
  • godot3-mono-export-templates
  • godot3-mono-headless
  • godot3-mono-headless.dev
  • godot3-mono-headless.man
  • godot3-mono-server
  • godot3-mono.dev
  • godot3-mono.man
  • godot_4-mono
  • godot_4-mono.debug
  • godot_4-mono.man
  • ilspycmd
  • inklecate
  • jackett
  • jellyfin
  • jetbrains.clion
  • jetbrains.rider
  • juniper
  • kavita
  • knossosnet
  • kryptor
  • libation
  • lidarr
  • lubelogger
  • lumafly
  • marksman
  • mqttmultimeter
  • msbuild
  • naps2
  • nbxplorer
  • netcoredbg
  • networkminer
  • nexusmods-app
  • nexusmods-app-unfree
  • omnisharp-roslyn
  • openra
  • opentabletdriver
  • openutau
  • osu-lazer
  • pablodraw
  • parabolic
  • pbm
  • pinta
  • pre-commit
  • pre-commit.dist
  • prowlarr
  • ps3-disc-dumper
  • pupdate
  • python311Packages.asteroid-filterbanks
  • python311Packages.asteroid-filterbanks.dist
  • python311Packages.clr-loader
  • python311Packages.clr-loader.dist
  • python311Packages.pyannote-audio
  • python311Packages.pyannote-audio.dist
  • python311Packages.pythonnet
  • python311Packages.pythonnet.dist
  • python312Packages.asteroid-filterbanks
  • python312Packages.asteroid-filterbanks.dist
  • python312Packages.clr-loader
  • python312Packages.clr-loader.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • python312Packages.pythonnet
  • python312Packages.pythonnet.dist
  • radarr
  • readarr
  • recyclarr
  • renode
  • renode-unstable
  • retrospy
  • roslyn
  • roslyn-ls
  • ryujinx
  • scarab
  • seq-cli
  • skeditor
  • slskd
  • smtp4dev
  • sonarr
  • space-station-14-launcher
  • tagger
  • technitium-dns-server
  • tests.dotnet.final-attrs.check-output
  • tests.dotnet.final-attrs.output-matches-const
  • tests.dotnet.final-attrs.override-has-no-effect
  • tests.dotnet.final-attrs.override-modifies-output
  • tests.dotnet.nuget-deps.derivation
  • tests.dotnet.nuget-deps.file
  • tests.dotnet.nuget-deps.list
  • tests.dotnet.nuget-deps.null
  • tests.dotnet.project-references
  • tests.dotnet.structured-attrs.check-output
  • tests.dotnet.structured-attrs.no-structured-attrs
  • tests.dotnet.use-dotnet-from-env.fallback
  • tests.dotnet.use-dotnet-from-env.use-dotnet-path-env
  • tests.dotnet.use-dotnet-from-env.use-dotnet-root-env
  • tests.dotnet.use-dotnet-from-env.without-fallback
  • tests.writers.simple.fsharpNoNugetDeps
  • tone
  • torrentstream
  • upgrade-assistant
  • vintagestory
  • vrcadvert
  • wasabibackend
  • whisper-ctranslate2
  • whisper-ctranslate2.dist
  • wiseunpacker
  • xivlauncher
  • yafc-ce

@GGG-KILLER
Copy link
Contributor

GGG-KILLER commented Nov 18, 2024

Yep, seems we indeed have a flaky test on pre-commit @corngood, maybe we should open an issue to notify maintainers or just leave this as a one-off?

Copy link
Contributor

@GGG-KILLER GGG-KILLER left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Considering we've already confirmed that the cavalier failure is caused by cava (which doesn't use .NET), I think we can proceed with this.

cava build logs
error: builder for '/nix/store/g0mjcanixacvsvn7zqlm4x9fvl30q0i9-cava-0.10.2.drv' failed with exit code 1;
       last 23 log lines:
       > Using versionCheckHook
       > Running phase: unpackPhase
       > unpacking source archive /nix/store/7n3i4i7mf29fwap22m4srqy73c8vv55n-source
       > source root is source
       > Running phase: patchPhase
       > Running phase: autoreconfPhase
       > autoreconf: export WARNINGS=
       > autoreconf: Entering directory '.'
       > autoreconf: configure.ac: not using Gettext
       > autoreconf: running: aclocal --force -I m4
       > aclocal: warning: couldn't open directory 'm4': No such file or directory
       > configure.ac:306: error: _AX_CHECK_GL_MANUAL_LIBS_GENERIC: argument must not be empty
       > lib/m4sugar/m4sh.m4:690: _AS_IF_ELSE is expanded from...
       > lib/m4sugar/m4sh.m4:697: AS_IF is expanded from...
       > /nix/store/fvdsb9i4vb8ca77s8lh60cil33m36dmk-autoconf-archive-2024.10.16/share/aclocal/ax_check_gl.m4:187: _AX_CHECK_GL_MANUAL_LIBS_GENERIC is expanded from...
       > lib/m4sugar/m4sh.m4:595: AS_CASE is expanded from...
       > /nix/store/fvdsb9i4vb8ca77s8lh60cil33m36dmk-autoconf-archive-2024.10.16/share/aclocal/ax_check_gl.m4:253: AX_CHECK_GL is expanded from...
       > lib/m4sugar/m4sh.m4:697: AS_IF is expanded from...
       > lib/m4sugar/m4sh.m4:697: AS_IF is expanded from...
       > configure.ac:306: the top level
       > autom4te: error: /nix/store/ab13djpkv4pyii8lvz4106bimy62db59-gnum4-1.4.19/bin/m4 failed with exit status: 1
       > aclocal: error: /nix/store/wky99hgy2w2nb3a6hzgk96yqdbi95zsj-autoconf-2.72/bin/autom4te failed with exit status: 1
       > autoreconf: error: aclocal failed with exit status: 1
       For full logs, run 'nix log /nix/store/g0mjcanixacvsvn7zqlm4x9fvl30q0i9-cava-0.10.2.drv'.
error: 1 dependencies of derivation '/nix/store/1fv8pya4r4n8khk5s03bwg641ck54f39-cavalier-2024.1.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/f5n6amln3psrfyc9zw9amx3f0zv9ljbr-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/1nzw2k4kklivg8mj8yygafcv9abvffnl-review-shell.drv' failed to build

@corngood
Copy link
Contributor Author

Yep, seems we indeed have a flaky test on pre-commit @corngood, maybe we should open an issue to notify maintainers or just leave this as a one-off?

Probably a good idea. Do you have a log of the failure you could attach to it?

@corngood corngood merged commit b0d941e into NixOS:master Nov 19, 2024
30 checks passed
@corngood corngood deleted the dotnet-next branch November 19, 2024 00:20
@GGG-KILLER
Copy link
Contributor

GGG-KILLER commented Nov 19, 2024

Probably a good idea. Do you have a log of the failure you could attach to it?

Might have deleted it, but nothing nix-collect-garbage -d and nix build .#pre-commit in loop cannot solve.
I'll try to reproduce if I cannot find it and open the issue.

@corngood
Copy link
Contributor Author

nixpkgs-review usually leaves log files in ~/.cache/nixpkgs-review.

@GGG-KILLER
Copy link
Contributor

Yeah, the thing is I usually delete that after I run it and everything passes it, but I can't remember if I did it or not. Will check though, thanks for reminding me 😅

@GGG-KILLER
Copy link
Contributor

Yeah, after 571 attempts I wasn't able to reproduce it. Might be something related to building multiple things in parallel as is usual with nixpkgs-review.

If I run into this again I'll report it, but for now I don't think I have more time to spend on trying to reproduce this.

giggio added a commit to giggio/dotfiles that referenced this pull request Nov 25, 2024
Errors coming from PR 355753
See:
NixOS/nixpkgs#355753
Had to pass the runtime to Global tools
@emilazy emilazy added the backport release-24.11 Backport PR automatically label Nov 25, 2024
Copy link
Contributor

Backport failed for release-24.11, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin release-24.11
git worktree add -d .worktree/backport-355753-to-release-24.11 origin/release-24.11
cd .worktree/backport-355753-to-release-24.11
git switch --create backport-355753-to-release-24.11
git cherry-pick -x 06ac81f61c82ffa40d14ab48fe560bf7602033b4 ca2a33dfba1674e8f4278b24e78e16eea29c49b5 6bed24773e134d7427a48cfdb856665f5f4b3c05 ddd08e404f21d39ae6592ae359f416e7b0fd8462 42d69ab59a80edf0c79b112f7a9b6dd86858c2cd d2d56972fc89f280233f86184a69bc995866ae6a 003135da3224fc76cff37045891ef4b05712741d f9cb431d6d858665c2497eb58072d92e8eb871be 97318b96d6d093ba93b825b03b065fb3d07ad1c4 193378ead289f55648c17b84226827bfcc21e5e2 4219a941581cd45d1b86c6af974be51d041d10cd aa0289eda408174dc490a729ed77d6542ec2e49d d9f506c5c35456ea5e49a5ab91593e8c2caf0937 bcd669f23f863c223e8fabcf19c595cedcedf921 5b462ef57a789729df844667d5257044688c6686 6e919bf975ce6e43f2fcb1ef63a5ce565cfda50d 112a4c48c609b7d1ba72c4d3f9000a2e8cba93e4 bfaca46529ff6590600e6df3b376e88cf7c0c9e3 e3736259f7c94971d95f975f720bcb47e3a18a14 9fb173da9421094875609cd6fd5ec98a7d48da05 3d38ecca0ceadf29599b892ac556fb6602ca1892 845066f50e082bf13ee122bb209bd24e332708c8 aa319c6f1e150efc6c21326979d40088c28564a1 0a5c33f88babc47401cf68042b4b2cc8102e561a f2da78e1be67b0c3915c5a84c96fbcf7e104227c df4effe419dc16d02329973f1db97e10e5394d6f 24570a33b5021fe1f7df7a94502bd9865fb55b3f 9c88243f6dc7615153202e6b7202c241563787c1 fd3d60b2edbb0333c8ae925d053cf56d0438c379

@Smaug123
Copy link
Contributor

Any ideas about this, which happens after pulling this in and attempting to upgrade to the net9 SDK? It only happens with a .config/dotnet-tools.json that contains Fantomas; deleting Fantomas but keeping FSharp.Analyzers is fine.

> nix build .#default.passthru.fetch-deps && ./result nix/deps.nix
fetching dependencies for WoofWare.Myriad.Plugins
Running phase: unpackPhase
unpacking source archive /nix/store/23ygy509rwqv4vz47av39xp9safqpvf6-abhkjibr7vgp6nzb907n90pj6qd265jp-source
source root is abhkjibr7vgp6nzb907n90pj6qd265jp-source
Running phase: patchPhase
Running phase: configureNuget
The template "NuGet Config" was created successfully.

Processing post-creation actions...


Running phase: updateAutotoolsGnuConfigScriptsPhase
Running phase: configurePhase
Executing dotnetConfigureHook
Unhandled exception: System.ArgumentException: '' is not a valid version string.
   at NuGet.Versioning.VersionRange.Parse(String value, Boolean allowFloating)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.DeserializeConvertable(JsonConverter converter, JsonReader reader, Type objectType, Object existingV
alue)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.ResolvePropertyAndCreatorValues(JsonObjectContract contract, JsonProperty containerProperty, JsonRea
der reader, Type objectType)
[snip]
   at Microsoft.DotNet.Cli.ToolPackage.ToolPackageDownloader.DownloadAndExtractPackage(PackageId packageId, INuGetPackageDownloader nugetPackageDownloader, String packagesRootPath, NuGetVersion packageVersion, PackageSourceLocation packageSourceLocation, Boolean includeUnlisted)
   at Microsoft.DotNet.Cli.ToolPackage.ToolPackageDownloader.<>c__DisplayClass8_0.<InstallPackage>b__0()
   at Microsoft.DotNet.Cli.TransactionalAction.Run[T](Func`1 action, Action commit, Action rollback)
   at Microsoft.DotNet.Tools.Tool.Restore.ToolRestoreCommand.InstallPackages(ToolManifestPackage package, Nullable`1 configFile)
   at System.Linq.Enumerable.ArraySelectIterator`2.Fill(ReadOnlySpan`1 source, Span`1 destination, Func`2 func)
   at System.Linq.Enumerable.ArraySelectIterator`2.ToArray()
   at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
   at Microsoft.DotNet.Tools.Tool.Restore.ToolRestoreCommand.Execute()
   at System.CommandLine.Invocation.InvocationPipeline.Invoke(ParseResult parseResult)
   at System.CommandLine.ParseResult.Invoke()
   at Microsoft.DotNet.Cli.Program.ProcessArgs(String[] args, TimeSpan startupTime, ITelemetry telemetryClient)

(This is from Smaug123/WoofWare.Myriad#302 at commit 2712bf2.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.topic: dotnet Language: .NET 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 6.topic: python 8.has: changelog 8.has: documentation 10.rebuild-darwin: 101-500 10.rebuild-linux: 101-500 backport release-24.11 Backport PR automatically
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update request: dotnetCorePackages.*_9_0 9.0.100-rc.2.24474.119.0.100
6 participants