Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

process_inherent_data: use an in memory overlay to minimize reads and writes to storage #3644

Closed
wants to merge 50 commits into from
Closed

process_inherent_data: use an in memory overlay to minimize reads and writes to storage #3644

wants to merge 50 commits into from

Commits on Feb 26, 2024

  1. Initial draft changes

    @alindima
    alindima committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    442185e View commit details
    Browse the repository at this point in the history

  2. bugfixes 

    Signed-off-by: alindima <alin@parity.io>
    @alindima
    alindima committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    799fabe View commit details
    Browse the repository at this point in the history

  3. filter descendants of disputed candidates 

    also no need to sort by core index any more
    @alindima
    alindima committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    9f3ba62 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. some simplifications

    @alindima
    alindima committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    5b13eb7 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. assert that candidates of a para are sorted in chain dependency order… 

    …. optimise process_candidates to be O(N)
    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    ecc5088 View commit details
    Browse the repository at this point in the history

  2. deduplicate some of the logic for freeing cores

    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    0fb7b8c View commit details
    Browse the repository at this point in the history

  3. update some comments

    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    0ed6fc3 View commit details
    Browse the repository at this point in the history

  4. unify dropped candidates errors

    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    0a08fa0 View commit details
    Browse the repository at this point in the history

  5. add more logs

    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    9e51e20 View commit details
    Browse the repository at this point in the history

  6. remove some todos

    @alindima
    alindima committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    4e154e6 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. review comments

    @alindima
    alindima committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    ccef35b View commit details
    Browse the repository at this point in the history

  2. some more nits

    @alindima
    alindima committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    3f67898 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/master' into alindima/elastic-sc… 

    …aling-runtime
    @alindima
    alindima committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    c4fedd7 View commit details
    Browse the repository at this point in the history

  4. add runtime migration to inclusion storage

    @alindima
    alindima committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    58b4129 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. add migration tests

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    23a8d34 View commit details
    Browse the repository at this point in the history

  2. don't allow candidate cycles

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    e0d9dff View commit details
    Browse the repository at this point in the history

  3. fix bug

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    0198fb3 View commit details
    Browse the repository at this point in the history

  4. make tests compile and make paras_inherent tests pass

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    267fa05 View commit details
    Browse the repository at this point in the history

  5. fix inclusion tests

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    7733b25 View commit details
    Browse the repository at this point in the history

  6. fix some more tests

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    c32f925 View commit details
    Browse the repository at this point in the history

  7. clippy

    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    40e2933 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/master' into alindima/elastic-sc… 

    …aling-runtime
    @alindima
    alindima committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    e8f5d2c View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. some review comments

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    630261e View commit details
    Browse the repository at this point in the history

  2. simplify update_pending_availability_and_get_freed_cores

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    7dc5358 View commit details
    Browse the repository at this point in the history

  3. fix clippy

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    3793f20 View commit details
    Browse the repository at this point in the history

  4. add prdoc

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    6c0d062 View commit details
    Browse the repository at this point in the history

  5. fix availability_cores runtime API

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    74acc46 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/master' into alindima/elastic-sc… 

    …aling-runtime
    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    4dd28a2 View commit details
    Browse the repository at this point in the history

  7. remove some unused errors and reintroduce ValidationDataHashMismatch

    @alindima
    alindima committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    5afb901 View commit details
    Browse the repository at this point in the history

  8. storage map overlay draft 1 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e2b5262 View commit details
    Browse the repository at this point in the history

  9. fix comment 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    eb99c80 View commit details
    Browse the repository at this point in the history

  10. populate over lay on demand 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    0a3b89b View commit details
    Browse the repository at this point in the history

  11. Use an overlay instance for everything except runtime API 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e38048d View commit details
    Browse the repository at this point in the history

  12. move comment 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    9e1d61f View commit details
    Browse the repository at this point in the history

  13. fix tests 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    abb4f37 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. add more unit tests to inclusion module

    @alindima
    alindima committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    a8c10be View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Add elastic para support in benchbuilder 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0267707 View commit details
    Browse the repository at this point in the history

  2. bench experiment for huge inherent 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    9308e79 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'alindima/elastic-scaling-runtime' of github.com:parityt… 

    …ech/polkadot-sdk into sandreim/storage_map_overlay

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    326812f View commit details
    Browse the repository at this point in the history

  4. fix benchbuilder for disputes 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    1a7c490 View commit details
    Browse the repository at this point in the history

  5. use more overlay 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    d1c5642 View commit details
    Browse the repository at this point in the history

  6. Fix tests 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    f530ff8 View commit details
    Browse the repository at this point in the history

  7. fix test 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    ea49a9e View commit details
    Browse the repository at this point in the history

  8. fix clippy 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    75c89df View commit details
    Browse the repository at this point in the history

  9. add assert 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    47bcf31 View commit details
    Browse the repository at this point in the history

  10. bench only big inherent 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    2bf9605 View commit details
    Browse the repository at this point in the history

  11. add overlay get_mut 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    a3878ec View commit details
    Browse the repository at this point in the history

  12. less cloning 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    728aa29 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. add 3 code upgrades 

    Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
    @sandreim
    sandreim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    03841e1 View commit details
    Browse the repository at this point in the history

  2. ".git/.scripts/commands/bench/bench.sh" --subcommand=pallet --runtime… 

    …=westend --target_dir=polkadot --pallet=runtime_parachains::paras_inherent
    command-bot committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    186d082 View commit details
    Browse the repository at this point in the history