Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shuffle ParseSink code in preparation for git hashing support #9024

Merged
merged 4 commits into from
Sep 25, 2023

Conversation

Ericson2314
Copy link
Member

Motivation

Setting up existing code for #8918

Context

Tracking issue #8919

Priorities

Add 👍 to pull requests you find important.

@Ericson2314 Ericson2314 changed the title Shufle ParseSink code in preparation for git hashing support Shuffle ParseSink code in preparation for git hashing support Sep 21, 2023
@Ericson2314 Ericson2314 added the RFC Related to an accepted RFC label Sep 22, 2023
Ericson2314 and others added 4 commits September 22, 2023 09:10
Co-Authored-By: Matthew Bauer <mjbauer95@gmail.com>
Co-Authored-By: Carlo Nucera <carlo.nucera@protonmail.com>
We will soon add a new implemenation so the one for NARs in `archive.cc`
isn't the only one.

Co-Authored-By: Matthew Bauer <mjbauer95@gmail.com>
Co-Authored-By: Carlo Nucera <carlo.nucera@protonmail.com>
Co-Authored-By: Matthew Bauer <mjbauer95@gmail.com>
Co-Authored-By: Carlo Nucera <carlo.nucera@protonmail.com>
Co-Authored-By: Matthew Bauer <mjbauer95@gmail.com>
Co-Authored-By: Carlo Nucera <carlo.nucera@protonmail.com>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps this should be filesystem.cc, together with other fs utils (to be moved later), considering per-compilation-unit overhead as mentioned in the meeting today.

Copy link
Member Author

@Ericson2314 Ericson2314 Sep 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually I forgot before during the meeting, I really disagree with combining files because it is worse for incremental builds. Latency is most important during development when we are doing incremental builds.

Optimizing non-incremental building is IMO quite a smell. (And we can still have the automatic way of combining files based on number of CPUs if we like.)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is that something Meson can do?

optimized for extremely fast full and incremental builds without sacrificing correctness

Couldn't find details about how that is achieved. Maybe you know the right search term?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@roberth roberth merged commit b21c415 into NixOS:master Sep 25, 2023
8 checks passed
@Ericson2314 Ericson2314 deleted the git-objects-prep branch September 25, 2023 15:15
@Ericson2314 Ericson2314 added this to the git-hashing stabilisation milestone Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
RFC Related to an accepted RFC
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

2 participants