Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.4.0 #183

Merged
merged 36 commits into from
Jul 3, 2024
Merged

v0.4.0 #183

merged 36 commits into from
Jul 3, 2024

Commits on Jun 24, 2024

  1. feat(dashboard run page): simplfy project folder creation

    project forlder name is derived from the execution title
    on folder create there is always a new folder created in the
    users workspace so that the user will be able to easily run the
    selected execution
    sabinem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b4d3fa3 View commit details
    Browse the repository at this point in the history
  2. fix(cloning of component repo): consider odtp-component-client

    clone the component repo in such a way that the submodule is taken
    from the component repo commit: this needs to first check out
    the component commit and the fetch the submodule
    sabinem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b7c82bf View commit details
    Browse the repository at this point in the history
  3. fix(cloning of component repo): consider odtp-component-client (#154)

    clone the component repo in such a way that the submodule is taken from
    the component repo commit: this needs to first check out the component
    commit and the fetch the submodule
    sabinem authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b089490 View commit details
    Browse the repository at this point in the history
  4. feat(dashboard run page): simplfy project folder creation (#153)

    project forlder name is derived from the execution title on folder
    create there is always a new folder created in the users workspace so
    that the user will be able to easily run the selected execution
    sabinem authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    804431f View commit details
    Browse the repository at this point in the history
  5. fix(compose.prod.yml): removing app volume (#151)

    * fix(compose.prod.yml): removing app volume
    
    * typo(JSON_EDITOR): Correcting typo in variables
    
    * chore(compose.yml): Proposing compose.yml to avoid change in documentation with -f.
    caviri authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b9e5174 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. fix(compose): fix env variable in compose files

    the variable had the wrong value
    sabinem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    ddb0cd7 View commit details
    Browse the repository at this point in the history
  2. Fix env variable in docker compose (#164)

    This PR fixes an env variable setting in the compose files
    sabinem authored Jun 25, 2024
    Configuration menu
    Copy the full SHA
    7f59929 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. feat(logs & output collections): Added missing collections in initial… (

    #157)
    
    feat(logs & output collections): Added missing collections in initial configuration
    caviri authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    e02feb0 View commit details
    Browse the repository at this point in the history
  2. fix(S3 Initiation): Fix for S3 initial setup (#156)

    * fix(S3 Initiation): Fix for S3 initial setup
    
    * fix(exception): Exception applied on CLI and logging.
    
    * chore(cli/s3.py): adapt method to return value change
    
    * Erasing assignation.
    
    ---------
    
    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    caviri and sabinem authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    14bacff View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. fix(dependencies): Removing pyarrow and freezing numpy to <2 to avoid… (

    #155)
    
    fix(dependencies): Removing pyarrow and freezing numpy to <2 to avoid errors and warnings
    caviri authored and sabinem committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    b33ed05 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    65acbf0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    26d8f43 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    586090c View commit details
    Browse the repository at this point in the history
  5. feat: merge main to develop (#170)

    sabinem authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    f93060c View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. feat(run.py): add log dir as volume on docker run

    that way the log will be visible right away in the file system
    if if the docker run command fails at some point
    this seems to be essential for long running container and also
    in cases of ephemeral containers when an error occurs
    sabinem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    20161f0 View commit details
    Browse the repository at this point in the history
  2. feat(cli/execution.py): add log streaming command

    simplify the output and log streaming command: both just need the
    project path
    sabinem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    c75ae0d View commit details
    Browse the repository at this point in the history
  3. feat(dashboard/run page): simplify workflow and provide log access

    simplify the workflow and disable buttons after selection or when
    proceesing is not ready
    
    submit run and then offer a button to view log files
    sabinem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    f5f4ca5 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. fix(logs in cli and gui): logs are seperated by steps

    logs can only be offered in the gui and cli per step
    sabinem committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    3eb6a23 View commit details
    Browse the repository at this point in the history
  2. fix(cli logs): adapt error handling to os.system

    os.system does not throw an error, but keyboard interruptions
    make sense here
    sabinem committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    762b914 View commit details
    Browse the repository at this point in the history
  3. feat(execution-timestamps) (#159)

    * feat(execution-timestamps)
    
    * feat(excecution & step): Added Creation/Update timestamp. Removed start/ending from creation.
    
    * feat(step timestamps logs): Added timestamps on orchestrator.
    caviri authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    9876f6a View commit details
    Browse the repository at this point in the history
  4. Feat/log dir as volume (#175)

    Change `docker run` command and add the logs directory as an extra
    volume, so that the logs will be visible right away and are also there
    for persistent component or in error runs of ephemeral compoents
    sabinem authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    ac04c0f View commit details
    Browse the repository at this point in the history
  5. Feat/improve cli and gui execution runs (#176)

    This PR
    - depends on #175 to have
    accessible logs
    
    CLI Features:
    - adds cli command `odtp logs` with argument `--project-path` to watch
    the logs
    - simplifies command `odtp output` to only have `--project-path` as an
    argument
    
    GUI Festures:
    - simplify run page: disable and enable buttons depending on state
    - submit execution and the provide access to logs
    sabinem authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    6334971 View commit details
    Browse the repository at this point in the history
  6. feat(docker): Avoid rebuilding images available (#160)

    * feat(docker): Avoid rebuilding images available
    
    * fix(attribute_name): self.container_names
    caviri authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    17b368c View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6a14788 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Configuration menu
    Copy the full SHA
    a4dc08d View commit details
    Browse the repository at this point in the history
  2. fix(variable renaming): Missed renaming of 2 variables (#179)

    Hello @sabinem, this is a hot-fix for a couple variables that I forgot
    to rename. I tested it with `dt-example` and works properly now.
    sabinem authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    943cae0 View commit details
    Browse the repository at this point in the history
  3. Logging and chores (#172)

    - delete unused functions
    - log instead of print in the cli for some commands
    caviri authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    9d412da View commit details
    Browse the repository at this point in the history
  4. fix(dashboard): changed names of timestamp fields for execution (#180)

    * fix(dashboard): changed names of timestamp fields for execution
    
    adapt to changes in the mongodb
    
    * feat(dashboard executions): show start and end timestamps
    
    in table view of executions show also start and end timestamps
    
    ---------
    
    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    sabinem and sabinem authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ad58868 View commit details
    Browse the repository at this point in the history
  5. chore(cli): cleanup execution commands that are only for the gui (#181)

    rename command for streaming logs
    remove command for showing directory folder
    
    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    sabinem and sabinem authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    9b4aeba View commit details
    Browse the repository at this point in the history
  6. feat/log commands to file (#165)

    * feat(logging): log commands to file to facilitate debugging
    
    * feat(cli execution): add both print and logs
    
    * chore(gitignore): add odtp.log to gitignore
    
    * fix(run.py): don't log secrets to file
    
    ---------
    
    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    sabinem and sabinem authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    6922b0e View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Fix/dashboard run page layout (#182)

    fix(dashboard run page): fix minor styling issue
    
    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    sabinem and sabinem authored Jul 3, 2024
    Configuration menu
    Copy the full SHA
    e7e2f6d View commit details
    Browse the repository at this point in the history
  2. Delete s3 Objects and items related to an execution (#173)

    * feat(delete): CLI method to delete execution s3 and project folder
    
    * feat(delete): CLI method to delete all MDB entries related to an execution
    
    * feat(execution delete): Keep folder
    
    * fix(project-path): Optional
    
    * fix(execution): Remove typo and non used method
    
    * fix(delete outputs): Fixed bug and added proejct_path as optional.
    
    * Using print statements.
    
    * chore(delete log): Logging only in debug
    
    * fix(DT Entry): Wrong email field was retrieved.
    caviri authored Jul 3, 2024
    Configuration menu
    Copy the full SHA
    398db44 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c4b0bfa View commit details
    Browse the repository at this point in the history
  4. chore(.env.dist files): provide extra file for dev setup (#184)

    Co-authored-by: sabinem <5292683+sabinem@users.noreply.github.com>
    sabinem and sabinem authored Jul 3, 2024
    Configuration menu
    Copy the full SHA
    b68a633 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b1748c7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    f5a49b1 View commit details
    Browse the repository at this point in the history