Skip to content

Dec 2020 meeting notes

Jump to bottom
Tim Pillinger edited this page Nov 29, 2021 · 1 revision

cylc-7.8.7/7.9.2 release

  • 7.8.x closed
  • 7.8.x open
  • what are the critical issues; who will make the release; when (this week?)
    • DB write issues - needs review and merge
    • HO to do the release, with Slurm hetero jobs

Web UI

  • tree view mutations nearly done?
    • (BK removed the need to wrap every component, now have universal menu!)
  • other ongoing issues?
    • (Hierarchy for gscan is necessary for cylc install)
    • (gscan "landing page" - not high priority)

UIS

  • How best to add mutations for UIS services (e.g. suite start).
    • clean, install, run, from gscan
    • add to schema and have the resolver at UIS
    • (DS: parts of the schema can be imported as needed)
    • OS to post an issue

Datastore

  • event driven updates progress?
    • OS: in future the datastore should be the source of all truth (and events) Cylc 9?
    • DS: new updates in next few days, then ready for review

Scheduler

  • SoD follow-ups still TBD https://github.com/cylc/cylc-flow/labels/sod-follow-up
  • (cylc wrapper merged)
  • (slurm hetero jobs now supported)
  • (cylc-run artifact upload for functional tests)
  • Consider parsing template vars from the CLI via literal_eval to allow other types.
    • -s FOO=bar would become -s FOO="bar".
    • (from Tomek; template vars in rose-suite.conf; cylc CLI overrides but all strings)
    • (CLI opt "-s" possible to for string assumption - not needed)
    • (small change - one or two lines: OS)

Config Changes progress?

  • (TP: all done but for two minor blocked issues)

rose suite-run migration progress?

  • (cylc install well on the way for Jan/Feb)
  • rsync in the subprocess pool
    • *(MH: going fine, still in progress)
  • "rose suite.conf" proposal in Cylc (last remaining bit of the puzzle)

TODO Cylc 8.0b0 (late Jan?)

UI

  • tree view w/ integrated mutations, filtering etc.
    • (almost done!)
  • gscan with filtering and tree (tree needed for cylc install)
    • (almost done, but need delta-driven for tree, and the tool-tips are trickier)

UIS

  • n=1 fixed window sufficient for beta
    • *(but consider n>1 perhaps ghost nodes, depending on how well it works/looks)
  • starting stopped flows

FLOW

  • rose suite-run migration, including install and new run semantics (CLI and dir structure)
  • delta-driven TUI:
    • graphql subs at flow for deltas, is substantial work
    • otherwise, at least add a warning about big workflows, for beta
  • complete task state rationalization
    • (queues: leave as is and explain queues invisible to the UI at the moment)
  • restore ssh messaging (8.0?)
    • decided to reimplement the old solution, but don't delay the beta for this
  • all config changes done

DOCS

  • how much/little can we get away with for b0?
    • doc Issue for essential b0 docs (minimal) (b0 users should be advanced users)

TODO Cylc 8.0 (From OS, with a couple of additions)

Here's my list of highlighted work to do on route to Cylc 8.0.0, listing only the more essential things and assuming that we have to drop a fair bit back to 8.1.0. Also adding cylc review resurrection to the list as we are unlikely to get full offline functionality in the UI by 8.0.0 and it will ease the transition.

Flow

UIS

  • Flow start service
  • Log file serve
  • Flow install service? (8.1.0?)
  • Basic offline data (stopped workflows, log files)
  • n-distance windowing; historical tasks
  • Authorisation
  • CLI authentication
  • Automatically start UI Servers when the URL is visited (circa authorisation)
  • Multi-user functionality (mostly investigation and configuration work)

UI

Docs

  • Terminology changes
  • Tutorial changes
  • User guide changes
  • Migration guide

Next meeting mid-Jan. 11th as first cut?

Clone this wiki locally