Skip to content

Releases: Beuth-Erdelt/Benchmark-Experiment-Host-Manager

Prototype - New Experiment Structure and Detached Mode for Parallel Execution

22 Mar 20:54
@perdelt perdelt
v0.5.0
246ba81
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Prototype - New Experiment Structure and Detached Mode for Parallel Execution 
V0.5.0 (#58)

* Prepare next release

* Masterscript: K8s sketch of generating protocol for subfolders

* Masterscript: K8s sketch of generating protocol for subfolders

* Masterscript: K8s collect log and yaml in remote result folder

* Masterscript: K8s sketch of experiment structure

* Masterscript: K8s details of experiment structure

* Git ignore result folders

* Masterscript: K8s details of experiment structure

* Masterscript: K8s details of experiment structure - run benchmarker pods

* Masterscript: K8s details of experiment structure - deep copy to make parallel clients independent

* Masterscript: K8s details of experiment structure - parallel clients configurable

* Masterscript: K8s details of experiment structure - parallel clients configurable

* Added MariaDB

* Masterscript: K8s details of experiment structure - benchmark configs using a list of numbers of clients

* Added MySQL, OmniSci and PostgreSQL

* Masterscript: K8s details of experiment structure - benchmark configs separate module

* Masterscript: K8s details of experiment structure - send start time and check DBMS before loading

* Masterscript: K8s details of experiment structure - send start time in UTC

* Masterscript: K8s details of experiment structure - check monitoring

* Masterscript: K8s details of experiment structure - auto mount monitoring

* TPC-H: 12 DBMS prepared

* Masterscript: K8s details of experiment structure - log loading

* Masterscript: K8s exception for stop portforward

* Masterscript: K8s cluster tool CLI

* Masterscript: K8s tools CLI - cluster management and tpch

* Masterscript: K8s details of experiment structure - data loading asynch

* Masterscript: K8s details of experiment structure - logging

* TPC-H: 12 DBMS prepared

* Masterscript: K8s tools CLI - cluster management and tpch

* TPC-H: Citus DBMS prepared

* TPC-H: Citus DBMS multi host prepared

* TPC-H: Citus DBMS multi host prepared - 2 workers

* DBMS: New service name

* Masterscript: K8s details of experiment structure - dialects

* Masterscript: K8s details of experiment structure - port-forward exceptions

* Masterscript: K8s details of experiment structure - also stop and label stateful sets of sut

* Masterscript: K8s tools CLI - cluster management get status

* Masterscript: K8s details of experiment structure - attach workers

* TPC-H: Citus DBMS multi host prepared - DDL does not attach workers

* TPC-H: Citus DBMS multi host prepared - difference .docker and .configuration

* TPC-H: Citus DBMS multi host prepared - default experiment

* TPC-H: Citus DBMS multi host prepared - parameter number of workers for TPC-H

* Masterscript: Linux compatible fetching of host infos

* Masterscript: Linux compatible fetching of host infos

* Masterscript: K8s tools CLI - cluster management get status as df

* TPC-H: Citus DBMS multi host prepared - mark loaded sut

* TPC-H: Citus DBMS multi host prepared - mark loaded sut

* Masterscript: K8s details of experiment structure - asynch loading

* Masterscript: K8s tools CLI - cluster management get status as df per experiment

* TPC-H: Citus DBMS multi host prepared - OmniSci dialect for profiling

* Masterscript: K8s details of experiment structure - time loading is int

* Masterscript: K8s details of experiment structure - time loading is float

* Masterscript: K8s tools CLI - verbose mode

* Masterscript: K8s details of experiment structure - test if monitoring is ready

* Masterscript: K8s details of experiment structure - loading time readable

* Masterscript: K8s tools CLI - stop monitoring

* Masterscript: K8s details of experiment structure - loading time readable

* Masterscript: K8s details of experiment structure - loading time must be float

* Masterscript: K8s details of experiment structure - monitoring test

* Masterscript: K8s details of experiment structure - monitoring test

* Masterscript: K8s details of experiment structure - metrics contain instance

* Masterscript: K8s details of experiment structure - reload data if pod is restarted

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - loading time as int

* Masterscript: Get connection info - Windows

* Masterscript: K8s details of experiment structure - check_sut

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get loading metrics

* Masterscript: Get loading metrics

* Masterscript: K8s tools CLI - cluster management readable time loading start

* Masterscript: Get loading metrics - output log

* Masterscript: Do not load data before monitoring is ready

* Masterscript: Monitoring does not use node selector

* Masterscript: Also copy error logs to results

* TPC-H: Default request 2 cpus

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Prepare release
Assets 2
Loading

Sketch of detached mode for K8s

18 Feb 09:32
@perdelt perdelt
v0.4.4
092fe73
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Sketch of detached mode for K8s 
V0.4.4 (#52)

* Prepare next release

* Masterscript: K8s allow overwriting dialect

* Masterscript: K8s change setting outside of constructor

* Masterscript: get_connection_config()

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch - replace jar folder statically

* Masterscript: K8s Driver in K8s cluster first sketch - delete job and pod after success

* Masterscript: K8s Driver in K8s cluster first sketch - fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - dynamic code and connection

* Masterscript: K8s Driver in K8s cluster first sketch - remove fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - wait for client pod to run

* Masterscript: K8s Driver in K8s cluster first sketch - print status of client pod

* Masterscript: K8s Driver in K8s cluster first sketch - dbmsbenchmarker pod shall wait 60s (str)

* Masterscript: K8s Driver in K8s cluster first sketch - wait 60s for client pod to close

* Docs: Typo

* Docs: Reference to DBMSBenchmarker and Monitoring

* Masterscript: K8s wait without tqdm

* Masterscript: K8s copy Prometheus API URL

* Masterscript: K8s port forward to service name again

* Masterscript: K8s stop port forward in detached

* Masterscript: Add more labels to K8s objects

* Masterscript: Add more labels to K8s objects - benchmarker job

* Masterscript: Add more labels to K8s objects - sut deployment

* Masterscript: Add more labels to K8s objects - sut deployment configuration

* Masterscript: Add more labels to K8s objects - service name

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - delete by labels

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Start code

* Masterscript: Start code

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: SUT deployment generated in result folder

* Masterscript: Set SUT deployment and service name

* Masterscript: Set SUT deployment and service name - lower and no _

* Masterscript: Set benchmarker job name

* Masterscript: Set SUT service name for benchmarker

* Masterscript: Delete all pods of a job

* Masterscript: K8s connection and configuration different

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs - connect to sut

* Masterscript: K8s connection and configuration different

* Masterscript: Message for no matching job

* Masterscript: K8s client for monitoring deployment - connect to sut

* Masterscript: K8s node selector should not be None

* Masterscript: K8s node selector should not be None

* Masterscript: K8s monitoring customized url

* Masterscript: K8s write pod logs

* Masterscript: K8s copy job yaml to result folder

* Masterscript: K8s sketch of configuration class

* Masterscript: K8s make result folder if not exists

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod
Assets 2
Loading

Improve inspection, TPC-H example and K8s management

14 Jan 13:44
@perdelt perdelt
v0.4.3
c52d5bd
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Improve inspection, TPC-H example and K8s management 
V0.4.3 (#40)

* Prepare next release

* Docs: Monitoring

* K8s: v1apps.list_namespaced_deployment (new K8s version in cluster)

* K8s: Resultfolder as attribute of cluster object

* Masterscript: K8s store number of requested gpus

* Masterscript: K8s run shell scripts for loading data

* Masterscript: Allow list of jars per dbms

* Requirements: Allow current versions

* TPC-H: New specifics

* Masterscript: K8s monitoring as option

* Masterscript: K8s optional UPPER parameter of db and schema

* Masterscript: K8s DEPRECATED: we must know all jars upfront

* TPC-H: DDL for MariaDB Columnstore

* TPC-H: Bigint at MonetDB

* TPC-H: SQL Server precision and DB

* TPC-H: OmniSci sharding

* TPC-H: OmniSci template
Assets 2
Loading

Improve Documentation

10 Sep 21:50
@perdelt perdelt
v0.4.2
2c4e56e
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Improve Documentation 
V0.4.2 (#36)

* Prepare next release

* K8s: Parametrize DDL scripts

* K8s: No pickled reports

* Demo: Typo

* Docs: API of set_ methods

* Docs: Deployments

* Docs: DBMS

* Docs: References
Assets 2
Loading

Improve Documentation and TPC-H Example

04 Sep 07:21
@perdelt perdelt
v0.4.1
9de59c4
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Improve Documentation and TPC-H Example 
V0.4.1 (#35)

* Prepare next release

* Docs: Improve

* self.connectionmanagement['singleConnection'] optional

* Docs: Improve API

* K8s: Stop experiment does not delete pod

* Docs: Improve API

* Docs: Improve API

* K8s: Script as metadata

* K8s: Escape DBMS password

* TPC-H: Dialect TSQL and Oracle

* TPC-H: Demo config

* TPC-H: Demo Exasol, OracleDB, SQLServer
Assets 2
Loading

TPC-H like examples

29 Aug 09:11
@perdelt perdelt
v0.4.0
a2ab975
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
TPC-H like examples 
V0.3.11 (#34)

* Prepare next release

* K8s: Some demo yml files for deployments and services

* TPC-H: Some demo queries and init scripts

* TPC-H: Some demo configs and scripts

* Docs: TPC-H example

* Prepare next release 0.4.0
Assets 2
Loading

Improved API and workflow

28 Aug 17:25
@perdelt perdelt
v0.3.10
12eb26e
Compare
Choose a tag to compare
Improved API and workflow Pre-release
Pre-release 
v0.3.10

Legal notice in source code
Assets 2
Loading

Improved workflow

31 Dec 15:37
@perdelt perdelt
v0.3.9
79521cc
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Improved workflow Pre-release
Pre-release
  • Masterscript: AWS - store log of last stop and clean
  • Masterscript: AWS - log volume key
  • Masterscript: Querymanagement
  • Masterscript: Read experiments log
  • Masterscript: Test if experiments path exists
  • Masterscript: setCode for continuing experiments
  • Masterscript: K8s more infos about host - monitoring metrics of multiple gpus
  • Masterscript: K8s - getTimediff
  • Masterscript: K8s more infos about host - debugging
  • Masterscript: K8s more infos about host - monitoring metrics
  • Masterscript: K8s more infos about host - gpu ids and node
  • Masterscript: K8s catch missing portforwarding in stop
  • Masterscript: K8s escape $ in some kubectl commands
  • Masterscript: K8s getMemory() for python 03. Jul
  • Masterscript: K8s kubectl as list, Popen, Shell
  • Masterscript: AWS - set alias
  • Masterscript: AWS - add / to config path
  • Masterscript: K8s - delay in runExperiment()
  • Docs: Alternative workflows, (un)park, experiments.config
  • Masterscript: K8s - add / to config path
  • Masterscript: Load experiment workflow
  • Masterscript: K8s - remove C: from download
  • Masterscript: AWS - log workflow
  • Masterscript: Load experiment workflow
  • Masterscript: K8s - log workflow
  • Masterscript: K8s - delay in prepare and start, log experimental steps
  • Docs: Monitoring, reporting, experiments.config
  • Masterscript: AWS - monitoring exporters in config
  • Masterscript: K8s - allow different query files for same workload
  • Masterscript: runReporting() for AWS
  • Masterscript: More details for k8s
  • Masterscript: Prevent crash at missing data
  • Masterscript: Init paths for K8s corrected
  • Docs: Minor extensions
  • Masterscript: SSH bug in k8s init
  • Masterscript: Wait 30s after unpark
  • Masterscript: Wait after unpark
  • Masterscript: UnparkExperiment removes old docker
  • Masterscript: ParkExperiment removes old parked
  • Masterscript: Default connectionname for unpark
  • Masterscript: Write connection prettily
  • Masterscript: Sketch park/unpark experiment
  • Hardware: RAM in bytes from /proc/meminfo
  • Prepare new version
  • Hardware: RAM in bytes, disk space in Kb
Assets 2
Loading

Public

16 Sep 08:06
@perdelt perdelt
v0.3.8
9f84a00
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Public 
V0.3.8 (#2)

* Initial state

* Create LICENSE
Assets 2
Loading