Code

Scenario load tests with simulator#9292

Code

Merged

yashgorana merged 100 commits intodevOpenMined/PySyft:devfrom tauquir/scenario-testsOpenMined/PySyft:tauquir/scenario-testsCopy head branch name to clipboardOct 10, 2024

+1,748-1,407

Commits

Commits on Sep 15, 2024

• Add scenario tests to the CI

  itstauq

  committed
  220114f

Commits on Sep 16, 2024

• add support to run scenario tests using mock apis

  itstauq

  committed
  f721f73

• Clean up 1

  itstauq

  committed
  5225e39

Commits on Sep 17, 2024

• Refactor

  itstauq

  committed
  22c587b

Commits on Sep 18, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  authored
  7cec793

• some early l0 activities in sim

  yashgorana

  committed
  b650495

• some more code

  yashgorana

  committed
  fdb6c87

• exit early if an exception occurs

  abyesilyurt

  committed
  ab412f2

• revert sleep duration

  abyesilyurt

  committed
  e48b05d

Commits on Sep 19, 2024

• working on low-side ds workflow

  khoaguin

  committed
  c3c1ddb

Commits on Sep 20, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  committed
  50646df

• user on low-side submits queries and waiting for approval

  khoaguin

  committed
  a9266aa

• [tox] create tox task for k8s bigquery sync scenario test

  khoaguin

  committed
  4abda81

• fix wrong import

  khoaguin

  committed
  e60ab29

• register users

  yashgorana

  committed
  ca356d7

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  committed
  b61559a

• use unsync_guard

  yashgorana

  committed
  5a43d46

Commits on Sep 23, 2024

• polish things up, separately

  yashgorana

  committed
  587ae51

• l0 till bigquery.test_query

  yashgorana

  committed
  ab685c3

• logs

  yashgorana

  committed
  63785b2

• to_thread worker pool create

  yashgorana

  committed
  da9608f

• l0 submit_query & sync

  yashgorana

  committed
  fd04063

Commits on Sep 24, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  committed
  eb72983

• fix lint

  khoaguin

  committed
  92d2cb6

• [tests/scenario] level 2 bigquery scenario test version 2

  khoaguin

  committed
  9768691

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  committed
  21de88a

• l0 admin high triage requests

  yashgorana

  committed
  0a54fd0

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  authored
  4df7fbf

Commits on Sep 25, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  authored
  459c1c8

• [[tests/scenario] admin low triggers signal when all results are available so admin high can stop triaging

  khoaguin

  committed
  ef70276

• [test/scenarios] admin low breaking from watching sync coroutine after receiving all results (synced from high)

  khoaguin

  committed
  ea9c3e9

Commits on Sep 26, 2024

• [tests/scenarios] add a coroutine for users to check results after they are available

  khoaguin

  committed
  c152819

• [tests/scenarios] logs are now saved at /scenariosv2/logs/{date_time}

  khoaguin

  committed
  8b1337d

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  committed
  a5306ea

• fix 'worker_pool_name' var name change

  yashgorana

  committed
  52a0600

• drop F841

  yashgorana

  committed
  0fff1f9

• [CI] installing just and running bigquery scenariov2 on k8s with just commands

  khoaguin

  committed
  a203de9

• [CI] fix bash commands for syft.test.scenario

  khoaguin

  committed
  7bd6573

• [CI] move testing simulation scenario tests to pr-tests-stack

  Show description for dc9c3ce
  khoaguin

  committed
  dc9c3ce

• [CI] checking python version

  khoaguin

  committed
  5f30a84

• Merge branch 'dev' into tauquir/scenario-tests

  yashgorana

  committed
  f2aab94

• drop scenarios

  yashgorana

  committed
  6c1267b

• tweaked logging

  yashgorana

  committed
  74f6694

• attempt to make things common

  yashgorana

  committed
  2ca51cf

• rename bq api user flows

  yashgorana

  committed
  1418756

• refactor bq_create_pool

  yashgorana

  committed
  2227c3a

• register users concurrently

  yashgorana

  committed
  de4b749

• admin api concurrency

  yashgorana

  committed
  4726bee

• de-nest sim_entrypoint wrapper

  yashgorana

  committed
  c4dae92

• admin sync refactor

  yashgorana

  committed
  dae5bbe

• add .logs ignore

  yashgorana

  committed
  7a98935

• fix merge conflicts

  yashgorana

  committed
  b5e3f12

• drop unsync

  yashgorana

  committed
  2f9fe3d

Commits on Sep 27, 2024

• remove unused import. upper case TODO

  khoaguin

  committed
  2abe420

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  committed
  83ac856

• [tests/scenarios] always print side-type after "Admin" in logs

  khoaguin

  committed
  bb13be4

• [tests/scenarios] adding a try catch in admin_sync

  khoaguin

  committed
  3a2a0ca

• [tox] trying to fix No interpreter found for Python 3.12 in system toolchains issue on CI

  khoaguin

  committed
  36be022

• [CI] install just to /usr/local/bin

  khoaguin

  committed
  a3d2470

• [tox] change deps for stack.test.scenario.k8s

  khoaguin

  committed
  10de6ec

• [CI] update uv, tox and uv-tox version

  khoaguin

  committed
  c063522

• [CI] update uv and tox to latest versions for all tasks

  khoaguin

  committed
  b0f7971

Commits on Sep 29, 2024

• just wait-pods

  yashgorana

  committed
  9185cf9

Commits on Sep 30, 2024

• [CI] reverted to use uv==0.4.1 tox==4.18.0 tox-uv==1.11.2

  khoaguin

  committed
  c7ee5fe

• [tox] separate simulation k8s test for L0 and L2

  Show description for 9aa6732
  khoaguin

  committed
  9aa6732

• [CI] clean up k3d for simulation k8 tests

  khoaguin

  committed
  53a4cf8

• [test/scenarios] launching python server if testing on python

  khoaguin

  committed
  5bb27ee

• [tests/scenarios] launching python nodes with producer and consumers

  Show description for ff6f168
  khoaguin

  committed
  ff6f168

• [tests/scenario] l0 and l2 bigquery tests work with python servers

  khoaguin

  committed
  40c9387

• [CI] fix the ORCHESTRA_DEPLOYMENT_TYPE env variable set to wrong value

  khoaguin

  committed
  6cdd3d6

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  authored
  99f78c2

• [CI] fix tox command for scenario k8s test

  khoaguin

  committed
  723d21b

• [CI] re-enable test-syft-scenario and add test-syft-scenario-sync task

  khoaguin

  committed
  53481ca

• [tox] add necessary pip packages for syft scenario tests

  khoaguin

  committed
  32ea796

• DeploymentType.REMOTE as default - k8s first

  yashgorana

  committed
  dce3ce4

• refactor orchestra stuff

  yashgorana

  committed
  23ac669

Commits on Oct 1, 2024

• [tests/scenario] fix small bug

  Show description for f243637
  khoaguin

  committed
  f243637

• [CI] collecting logs for tests-simulation-scenario-k8s

  khoaguin

  committed
  1f10273

• [CI] collecting logs for tests-simulation-scenario-sync-k8s

  khoaguin

  committed
  9fb8512

• [CI] collecting logs for syft-scenario and syft-scenario-sync tests

  khoaguin

  committed
  e68ae99

• fix ActionObject.get_sync_dependencies

  abyesilyurt

  committed
  454ecbf

Commits on Oct 3, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  committed
  6bfea61

Commits on Oct 4, 2024

• [tests/scenarios] increase timeout for l0

  khoaguin

  committed
  6681d8d

• test with 5 users

  abyesilyurt

  committed
  a40534a

• Merge remote-tracking branch 'origin/fix_status_l0' into tauquir/scenario-tests

  abyesilyurt

  committed
  fc9a952

Commits on Oct 6, 2024

• update code call

  abyesilyurt

  committed
  6be9ea6

• increase timeout

  abyesilyurt

  committed
  45b9f1d

• increase test timeout

  abyesilyurt

  committed
  b98382f

Commits on Oct 7, 2024

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  authored
  f2619cd

Commits on Oct 8, 2024

• Merge remote-tracking branch 'origin' into tauquir/scenario-tests

  abyesilyurt

  committed
  38ff6d4

• Merge remote-tracking branch 'origin' into tauquir/scenario-tests

  abyesilyurt

  committed
  2bd24b9

• Merge branch 'dev' into tauquir/scenario-tests

  abyesilyurt

  authored
  14682a5

Commits on Oct 9, 2024

• Merge branch 'tauquir/scenario-tests' of github.com:OpenMined/PySyft into tauquir/scenario-tests

  abyesilyurt

  committed
  705ca13

• fix

  abyesilyurt

  committed
  f1fdba3

• fix

  abyesilyurt

  committed
  78d6c06

• fix results

  abyesilyurt

  committed
  3a22442

• Merge branch 'dev' into tauquir/scenario-tests

  abyesilyurt

  authored
  99641ab

• request.code.__call__ uses the same api as code.funcname

  abyesilyurt

  committed
  3d9db2d

• Merge branch 'tauquir/scenario-tests' of github.com:OpenMined/PySyft into tauquir/scenario-tests

  abyesilyurt

  committed
  f603ccb

• Merge branch 'dev' into tauquir/scenario-tests

  khoaguin

  authored
  be685a1