Skip to content
This repository has been archived by the owner on Feb 3, 2021. It is now read-only.

Align cluster and job implementations #629

Open
3 tasks
jafreck opened this issue Jul 30, 2018 · 0 comments
Open
3 tasks

Align cluster and job implementations #629

jafreck opened this issue Jul 30, 2018 · 0 comments

Comments

@jafreck
Copy link
Member

jafreck commented Jul 30, 2018

Job and cluster implementations should be aligned to ease transition between the two modes for users. This will also decrease code complexity/duplication and facilitate support.

Currently a cluster is a: Batch pool and job.
A job is a: Batch job schedule with a job specification that has an autopool and predefined Tasks for each application.

Going forward, we should convert clusters to job specifications with autopool. So a cluster will be a job with an empty set of Batch tasks and keep_alive set to True on the autopool specification.

API Changes:

  • job configuration has a cluster configuration and a list of applications

Refactors:

  • cluster is implemented as job with keep_alive set to false and no applications defined
  • add plugin support to jobs
@jafreck jafreck changed the title Change Implementation of Jobs Align cluster and job implementations Jul 30, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant