Code

[DNM] Structural co-assignment#7076

Code

Draft

gjoseph92 wants to merge 24 commits intodask:maindask/distributed:mainfrom gjoseph92:queue-structural-coassigngjoseph92/distributed:queue-structural-coassignCopy head branch name to clipboard

+698-109

Commits

Commits on Sep 27, 2022

• Scheduler: process new recommendations immediately

  Show description for 79e8b9a
  gjoseph92

  committed
  79e8b9a

  Copy full SHA for 79e8b9a

• update_msgs helper

  gjoseph92

  committed
  5e8e003

  Copy full SHA for 5e8e003

• first hacky pass at structural co-assignment

  Show description for 06ba015
  gjoseph92

  committed
  06ba015

  Copy full SHA for 06ba015

• wip

  gjoseph92

  committed
  0fa13c4

  Copy full SHA for 0fa13c4

Commits on Sep 28, 2022

• some madness taking structuralism too far?

  gjoseph92

  committed
  c0b169f

  Copy full SHA for c0b169f

• this might, maybe, actually kinda work

  gjoseph92

  committed
  7d499a6

  Copy full SHA for 7d499a6

Commits on Sep 29, 2022

• rip some things out to just focus on root tasks

  Show description for b2157a9
  gjoseph92

  committed
  b2157a9

  Copy full SHA for b2157a9

• WIP decide_worker_from_family

  Show description for 7487e3c
  gjoseph92

  committed
  7487e3c

  Copy full SHA for 7487e3c

Commits on Sep 30, 2022

• ignore non-running candidates

  gjoseph92

  committed
  06d74dc

  Copy full SHA for 06d74dc

• controversial: set family maxsize to nthreads

  Show description for 7891b35
  gjoseph92

  committed
  7891b35

  Copy full SHA for 7891b35

• driveby: syntax ok test_queued_paused_unpaused

  Show description for e30bf01
  gjoseph92

  committed
  e30bf01

  Copy full SHA for e30bf01

• widely-shared cutoff and cluster size

  Show description for fec5fd8
  gjoseph92

  committed
  fec5fd8

  Copy full SHA for fec5fd8

• just import dask in test

  gjoseph92

  committed
  4c84d94

  Copy full SHA for 4c84d94

• test for a non-commutative family structure

  Show description for 58c0c32
  gjoseph92

  committed
  58c0c32

  Copy full SHA for 58c0c32

• simple scale down test

  gjoseph92

  committed
  b6b1611

  Copy full SHA for b6b1611

• fix deadlock on reassignment, hackily

  gjoseph92

  committed
  f285ebd

  Copy full SHA for f285ebd

• note question re skip saturated

  gjoseph92

  committed
  d22174e

  Copy full SHA for d22174e

• fix _next_in_linear_chain

  Show description for 63274fa
  gjoseph92

  committed
  63274fa

  Copy full SHA for 63274fa

Commits on Oct 3, 2022

• document & ignore heterogeneous sibling scheduling

  gjoseph92

  committed
  3e5250d

  Copy full SHA for 3e5250d

• decide_worker_from_family: ignore saturated

  gjoseph92

  committed
  172bbc4

  Copy full SHA for 172bbc4

• Revert "fix _next_in_linear_chain"

  Show description for 8011b73
  gjoseph92

  committed
  8011b73

  Copy full SHA for 8011b73

• fixup _next_in_linear_chain

  gjoseph92

  committed
  a8a196b

  Copy full SHA for a8a196b

Commits on Oct 4, 2022

• don't sort idle set

  Show description for 0922e5c
  gjoseph92

  committed
  0922e5c

  Copy full SHA for 0922e5c

Commits on Oct 5, 2022

• include maxsize in initial check

  gjoseph92

  committed
  3a0329e

  Copy full SHA for 3a0329e