Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Exploratory] Starting a script for llnl-weekly suite #64

Draft
wants to merge 14 commits into
base: develop
Choose a base branch
from

Conversation

pearce8
Copy link
Collaborator

@pearce8 pearce8 commented Dec 1, 2023

Description

  • How to curate a suite
  • How to report what is in a suite

Dependencies: FIXME:Add a list of any dependencies.

Fixes issue(s): FIXME:Add list of relevant issues.

Type of Change

  • { } Adding a system, benchmark, or experiment
  • { } Modifying an existing system, benchmark, or experiment
  • { } Documentation update
  • { } Build/CI update
  • { } Benchpark core functionality

Checklist:

If adding/modifying a system:

  • { } Create a new directory for the system and a new system.py file
  • { } Add a new dry run unit test in .github/workflows
  • { } System appears in System Specifications table in docs catalogue section

If adding/modifying a benchpark:

  • { } Add a new application.py and (maybe) package.py under a new directory
    for this benchmark
  • { } Configure an experiment
  • { } Benchmark appears in Benchmarks and Experiments table in docs catalogue
    section

If adding/modifying a experiment:

  • { } Extend experiment.py under existing directory for specific benchmark
  • { } Define a single node and multi-node experiments

If adding/modifying core functionality:

  • { } Update docs
  • { } Update .github/workflows and .gitlab/ci unit tests (if needed)

@becker33
Copy link
Collaborator

becker33 commented Dec 5, 2023

Dumping thoughts here:

  1. Discussed adding a top-level directory for suites
  2. Suites would be composed of a set of experiments
  3. Ideally this would involve cool ramble composition (see the work for composable environments in Spack) but would probably start out as scripts

@pearce8 does that cover what we had discussed so far?

@pearce8 pearce8 added the feature New feature or request label Dec 19, 2023
@pearce8 pearce8 added the ideas Trying out how one might implement new features label Jun 10, 2024
@pearce8 pearce8 changed the title Starting a script for llnl-weekly suite [Exploratory] Starting a script for llnl-weekly suite Jun 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request ideas Trying out how one might implement new features
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants