Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gscan: metadata filtering #581

Open
oliver-sanders opened this issue Jan 25, 2021 · 2 comments
Open

gscan: metadata filtering #581

oliver-sanders opened this issue Jan 25, 2021 · 2 comments
Milestone

Comments

@oliver-sanders
Copy link
Member

Note: Follow-on from #337 (further enhancement comment)

Support filtering by user-defined metadata.

Arbitrary workflow metadata can be defined like so:

[meta]
    title = 'foo bar baz'
    system = some-system
    model = xyz

It would be useful to be able to use this for searching and filtering in GScan. E.G. display my workflows in a hierarchy with "system" as the top-level.

For running workflows this shouldn't be too bad, however, for stopped workflows the UIS would have to read in the workflow configuration file to access the metadata which isn't something we can do (potentially extremely slow and resource hungry).

For offline data we may need to consider using a system similar to the Cylc7 scan which bypaseed parsec and only worked if the metadata section was the first section defined in the suite.rc (ignoring Jinja2).

Alternatively we could support a Cylc metadata file e.g. flow-meta.cylc that is automatically prepended to the top of the flow.cylc by parsec.

Pull requests welcome!

@oliver-sanders oliver-sanders added this to the 2.0 milestone Jan 25, 2021
@hjoliver
Copy link
Member

Another idea: at install time, parse flow.cylc (for validation) and dump metadata to another file for the UIS to access.

@oliver-sanders oliver-sanders modified the milestones: 2.0.0, Pending Jun 8, 2022
@oliver-sanders oliver-sanders mentioned this issue Oct 27, 2022
8 tasks
@oliver-sanders
Copy link
Member Author

Adding a couple of incomplete points from #337, namely filter by:

  • Cylc version
  • Workflow host

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants