Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Preemption for system jobs #4794

Merged
merged 38 commits into from
Nov 2, 2018
Merged

Preemption for system jobs #4794

merged 38 commits into from
Nov 2, 2018

Commits on Oct 30, 2018

  1. structs and API changes to plan and alloc structs needed for preemption

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    5f27e00 View commit details
    Browse the repository at this point in the history

  2. REview feedback

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    8004160 View commit details
    Browse the repository at this point in the history

  3. Add number of evictions to DesiredUpdates struct to use in CLI/API

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    bf7192c View commit details
    Browse the repository at this point in the history

  4. structs and API changes to plan and alloc structs needed for preemption

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    fc266f7 View commit details
    Browse the repository at this point in the history

  5. Implement preemption for system jobs. 

    This commit implements an allocation selection algorithm for finding
allocations to preempt. It currently special cases network resource asks
from others (cpu/memory/disk/iops).
    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    715d869 View commit details
    Browse the repository at this point in the history

  6. Fix comment

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    b5cbd73 View commit details
    Browse the repository at this point in the history

  7. Fix logic bug, unit test for plan apply method in state store

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    13e314c View commit details
    Browse the repository at this point in the history

  8. Fix linting and better comments

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    fd6bff2 View commit details
    Browse the repository at this point in the history

  9. Fix linting

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    51c5bae View commit details
    Browse the repository at this point in the history

  10. Support for new scheduler config API, first use case is to disable pr… 

    …eemption
    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    784b96c View commit details
    Browse the repository at this point in the history

  11. Use scheduler config from state store to enable/disable preemption

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    2143fa2 View commit details
    Browse the repository at this point in the history

  12. Make preemption config a struct to allow for enabling based on schedu… 

    …ler type
    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    6966e3c View commit details
    Browse the repository at this point in the history

  13. Modify preemption code to use new style of resource structs

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    24b3934 View commit details
    Browse the repository at this point in the history

  14. fix end to end scheduler test to use new resource structs correctly

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    9f35923 View commit details
    Browse the repository at this point in the history

  15. comments

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    a960cce View commit details
    Browse the repository at this point in the history

  16. Preempted allocations should be removed from proposed allocations

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    655689a View commit details
    Browse the repository at this point in the history

  17. Restore/Snapshot plus unit tests for scheduler configuration

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    c4e0e66 View commit details
    Browse the repository at this point in the history

  18. Add fsm layer tests

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    c3b8e4f View commit details
    Browse the repository at this point in the history

  19. make default config a variable

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    12af2ae View commit details
    Browse the repository at this point in the history

  20. style fixes

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    c4a04eb View commit details
    Browse the repository at this point in the history

  21. More review comments

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    191b862 View commit details
    Browse the repository at this point in the history

  22. More style and readablity fixes from review

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    21432d6 View commit details
    Browse the repository at this point in the history

  23. more minor cleanup

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    4cc21fb View commit details
    Browse the repository at this point in the history

  24. refactor preemption code to use method recievers and setters for comm… 

    …on fields
    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    35635ba View commit details
    Browse the repository at this point in the history

  25. Introduce a response object for scheduler configuration

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    8800585 View commit details
    Browse the repository at this point in the history

  26. Introduce interface with multiple implementations for resource distance

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    17344a7 View commit details
    Browse the repository at this point in the history

  27. Fix return type in tests after refactor

    @preetapan
    preetapan committed Oct 30, 2018
    Configuration menu
    Copy the full SHA
    f2b0277 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2018

  1. review comments

    @preetapan
    preetapan committed Nov 1, 2018
    Configuration menu
    Copy the full SHA
    22d156f View commit details
    Browse the repository at this point in the history

  2. Cleaner way to exit early, and fixed a couple more places reading fro… 

    …m alloc.Resources
    @preetapan
    preetapan committed Nov 1, 2018
    Configuration menu
    Copy the full SHA
    993b6a2 View commit details
    Browse the repository at this point in the history

  3. More review comments

    @preetapan
    preetapan committed Nov 1, 2018
    Configuration menu
    Copy the full SHA
    3ad7b3f View commit details
    Browse the repository at this point in the history

  4. Plumb alloc resource cache in a few more places. 

    also removed now unused method
    @preetapan
    preetapan committed Nov 1, 2018
    Configuration menu
    Copy the full SHA
    06ad182 View commit details
    Browse the repository at this point in the history

  5. more minor review feedback

    @preetapan
    preetapan committed Nov 1, 2018
    Configuration menu
    Copy the full SHA
    35d31f8 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2018

  1. unit test plan apply with preemptions

    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    b3738a0 View commit details
    Browse the repository at this point in the history

  2. Handle static port preemption when there are multiple devices 

    Also added test case
    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    0015095 View commit details
    Browse the repository at this point in the history

  3. Fix static port preemption to be device aware

    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    8235919 View commit details
    Browse the repository at this point in the history

  4. dereference safely

    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    1380acb View commit details
    Browse the repository at this point in the history

  5. Fix test setup

    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    c49a3e2 View commit details
    Browse the repository at this point in the history

  6. Address more minor code review feedback

    @preetapan
    preetapan committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    97cf4e1 View commit details
    Browse the repository at this point in the history