Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

core: implement system batch scheduler #9160

Merged
merged 2 commits into from
Aug 16, 2021
Merged

core: implement system batch scheduler #9160

merged 2 commits into from
Aug 16, 2021

Commits on Aug 3, 2021

  1. core: implement system batch scheduler

    This PR implements a new "System Batch" scheduler type. Jobs can
    make use of this new scheduler by setting their type to 'sysbatch'.
    
    Like the name implies, sysbatch can be thought of as a hybrid between
    system and batch jobs - it is for running short lived jobs intended to
    run on every compatible node in the cluster.
    
    As with batch jobs, sysbatch jobs can also be periodic and/or parameterized
    dispatch jobs. A sysbatch job is considered complete when it has been run
    on all compatible nodes until reaching a terminal state (success or failed
    on retries).
    
    Feasibility and preemption are governed the same as with system jobs. In
    this PR, the update stanza is not yet supported. The update stanza is sill
    limited in functionality for the underlying system scheduler, and is
    not useful yet for sysbatch jobs. Further work in #4740 will improve
    support for the update stanza and deployments.
    
    Closes #2527
    shoenig authored and Mahmood Ali committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    61ee443 View commit details
    Browse the repository at this point in the history
  2. e2e: fix tests

    Use basic sleeps in busybox images. busybox are very light, and ping has
    permissions complications, and it may fail for network related
    issues.
    Mahmood Ali committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    141ea60 View commit details
    Browse the repository at this point in the history