Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow multi step configuration for skypilot #2166

Merged
merged 41 commits into from
Jan 12, 2024
Merged

Allow multi step configuration for skypilot #2166

merged 41 commits into from
Jan 12, 2024

Commits on Dec 19, 2023

  1. allow multi step configuration for skypilot

    @safoinme
    safoinme committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    27fc323 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. fixes

    @safoinme
    safoinme committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    6f50333 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @strickvl
    strickvl authored Dec 20, 2023
    Configuration menu
    Copy the full SHA
    f109795 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    11a18b9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/OSS-2680-multi-image-multi-vm-skypilot' of gith… 

    …ub.com:zenml-io/zenml into feature/OSS-2680-multi-image-multi-vm-skypilot
    @safoinme
    safoinme committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    db2c007 View commit details
    Browse the repository at this point in the history

  3. Auto-update of Starter template

    @actions-user
    actions-user committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    4471d48 View commit details
    Browse the repository at this point in the history

  4. update skypilot to allow running using an orchestrating VM

    @safoinme
    safoinme committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    57ed6df View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/OSS-2680-multi-image-multi-vm-skypilot' of gith… 

    …ub.com:zenml-io/zenml into feature/OSS-2680-multi-image-multi-vm-skypilot
    @safoinme
    safoinme committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    0e02dee View commit details
    Browse the repository at this point in the history

  6. add ability to create an aws config when configuring local client

    @safoinme
    safoinme committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    7452667 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2024

  1. Add advanced AWS configurations to config.yaml

    @safoinme
    safoinme committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    32de4aa View commit details
    Browse the repository at this point in the history

  2. Fix cluster name concatenation in skypilot orchestrator entrypoint

    @safoinme
    safoinme committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    0eb1f97 View commit details
    Browse the repository at this point in the history

  3. Fix AWS service connector and Skypilot orchestrator issues

    @safoinme
    safoinme committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    4270edd View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2024

  1. Add APT packages to Skypilot integrations and sanitize cluster name

    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    dfdedf9 View commit details
    Browse the repository at this point in the history

  2. Remove advanced AWS configurations from config.yaml

    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    b6c9f4c View commit details
    Browse the repository at this point in the history

  3. Update Skypilot orchestrator code

    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    301bfa6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    f9d51d8 View commit details
    Browse the repository at this point in the history

  5. Auto-update of Starter template

    @actions-user
    actions-user committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    559b710 View commit details
    Browse the repository at this point in the history

  6. Refactor cluster name sanitization in SkypilotBaseOrchestrator

    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    7476f85 View commit details
    Browse the repository at this point in the history

  7. merge changes

    @safoinme
    safoinme committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    09c368d View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2024

  1. Refactor SkypilotBaseOrchestrator and SkypilotOrchestratorEntrypoint

    @safoinme
    safoinme committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    4077eda View commit details
    Browse the repository at this point in the history

  2. Remove commented out code and update Skypilot orchestrator entrypoint

    @safoinme
    safoinme committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    5057bae View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. Fix GCP service connector support for local gcloud CLI login

    @stefannica
    stefannica committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    b20b975 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. Fix Skypilot orchestrator cluster name generation

    @safoinme
    safoinme committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    8699b5a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/OSS-2680-multi-image-multi-vm-skypilot' of gith… 

    …ub.com:zenml-io/zenml into feature/OSS-2680-multi-image-multi-vm-skypilot
    @safoinme
    safoinme committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    9898aef View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    ec7d09b View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Refactor cluster creation logic in SkypilotBaseOrchestrator

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    21af350 View commit details
    Browse the repository at this point in the history

  2. Allow custom docker run args when using the Skypilot orchestrator

    @schustmi
    schustmi committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    69b5924 View commit details
    Browse the repository at this point in the history

  3. Handle exception and log error message in SkypilotBaseOrchestrator

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    9964220 View commit details
    Browse the repository at this point in the history

  4. Refactor AWS service connector to improve file handling

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    f65e61d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/OSS-2680-multi-image-multi-vm-skypilot' of gith… 

    …ub.com:zenml-io/zenml into feature/OSS-2680-multi-image-multi-vm-skypilot
    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    b33d4bb View commit details
    Browse the repository at this point in the history

  6. Refactor Skypilot integrations for ZenML

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    daaaefc View commit details
    Browse the repository at this point in the history

  7. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    dddd6fe View commit details
    Browse the repository at this point in the history

  8. Add encoding parameter to subprocess call

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    a3271a6 View commit details
    Browse the repository at this point in the history

  9. Update Skypilot integration for AWS, GCP, and Azure

    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    794cba4 View commit details
    Browse the repository at this point in the history

  10. Add note about configuring pipeline resources for specific orchestrat… 

    …or flavors
    @safoinme
    safoinme committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    f40796f View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @strickvl
    strickvl authored Jan 11, 2024
    Configuration menu
    Copy the full SHA
    46170b6 View commit details
    Browse the repository at this point in the history

  2. Update src/zenml/integrations/gcp/service_connectors/gcp_service_conn… 

    …ector.py

Co-authored-by: Alex Strick van Linschoten <strickvl@users.noreply.github.com>
    @safoinme @strickvl
    safoinme and strickvl authored Jan 11, 2024
    Configuration menu
    Copy the full SHA
    89903b8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    44ea432 View commit details
    Browse the repository at this point in the history

  4. Add error handling for running code in a notebook and update Skypilot… 

    … orchestrator entrypoint
    @safoinme
    safoinme committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    df16014 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/OSS-2680-multi-image-multi-vm-skypilot' of gith… 

    …ub.com:zenml-io/zenml into feature/OSS-2680-multi-image-multi-vm-skypilot
    @safoinme
    safoinme committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    69a7ce4 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Merge branch 'develop' into feature/OSS-2680-multi-image-multi-vm-sky… 

    …pilot
    @safoinme
    safoinme authored Jan 12, 2024
    Configuration menu
    Copy the full SHA
    7ef6179 View commit details
    Browse the repository at this point in the history