fix: flaky jmeterd test #4521
Merged
fix: flaky jmeterd test #4521
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dejanzele
requested review from
exu,
nicufk,
vsukhin,
vLia and
povilasv
as code owners
✅ Deploy Preview for testkube-docs-preview canceled.
|
vsukhin
approved these changes
Oct 26, 2023
rangoo94
approved these changes
Oct 26, 2023
nicufk
approved these changes
Oct 27, 2023
vsukhin
added a commit
that referenced
this pull request
Nov 22, 2023
* fix: error logs * fix: report path * fix: change id and uri * fix: unit test * fix: unit test * fix: remove typo * feat: Initial changes for distributed jmeter (#4289) * feat: Initial changes for distributed jmeter Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added jmeter slaves script and Dockerfile Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Removed duplicate files and imported from existing jmeter executor Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins (#2) * Support for user provided plugins * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file for Jmeterd Signed-off-by: Aman Parauliya <aman@infracloud.io> * Changed base image to kubeshop/jmeter and removed tests (#5) * Changed base image to kubeshop/jmeter and removed tests Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * modify slaves script so it will not exited on error Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user.properties file (#3) * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added the support for user.properties file --------- Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Addressed review comments Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed review comments of Dejan Signed-off-by: Aman Parauliya <aman@infracloud.io> * Refactored slaves pod configuration and added validation for pod name (#8) Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file of Distributor JMeter Signed-off-by: Aman Parauliya <aman@infracloud.io> * Adding a new example in a new folder named giflow under the examples folder Signed-off-by: Aman Parauliya <aman@infracloud.io> * Remove plugins from /lib Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> * docs: Add Dashboard and CLI Tabs (#4297) * Add Dashboard and CLI Tabs To scheduling tests and test triggers pages. * conflicts resolved * Update scheduling-tests.mdx * Update test-triggers.mdx * Update scheduling-tests.mdx * Update test-triggers.mdx * docs - schedule-test-suites.png added --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * testsuites for dev/staging/demo updated (#4369) * ci: jmeterd executor and slave (#4371) * add jmeterd ci * docs: Advanced Test Orchestration, AI Insights, Add advantages to Overview … (#4370) * Advanced Test Orchestration, AI Insights, Add advantages to Overview page * docs - index.mdx - colors build issue fixed --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * fix: change jmeterd docker versions (#4372) * fix: typo in jmeterd slave image (#4373) * feat: concurrency policy model * fix: map for concurrency policy * fix: support allow and forbid options * feat: replace trigger executions * fix: unit test * fix: lint * fix: enable caching * fix: return concurrency policies * fix: dep update * fix: increase retry * update jmeterd docs * docs: fix bright mode logo (#4380) * feat: cd event log output * fix: send logs at the end of tests * fix: event condition * fix: url address * Add labels to the slave pods (#4384) Signed-off-by: Aman Parauliya <aman@infracloud.io> * feat: allow to pass multi namespace flags for testkube cloud init command (#4388) * feat: add ReadOnly flag to test (#4389) * fix: remove duplicated code executor.ExecuteSync (#4393) * fix: update execution status in watcher * fix: change log message * fix: change log parameter * fix: check for exit code * fix: replace timer by ticker * fix: change error message * fix: add events to messages * fix: filter pod events * fix: update error message * feat: test and test suite --update flag * feat: additional update flags * feat: update docs * fix: check if update flag was chaged * feat: update operator reference (#4399) * feat: jmeterd test updates * feat: Slave configuration in Executor CRD and ownerReferences changes in slaves pod (#4385) * Added slaves filed in Executor CRD to add slaves configs Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * OwnerRefs changes for slaves pod Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * removed the local path from go.mod file Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed linters issue Signed-off-by: Aman Parauliya <aman@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <aman@infracloud.io> * feat: refactor jmeterd slaves module (#4408) * feat: refactor jmeterd slaves module * fix flaky slaves unit test * ci: add arm64 (#4374) * add arm64 for jmeterd * feat: add labels to count metrics * fix: metric fields * feat: support dirs for soap, postman, curl * fix: flaky jmeterd test (#4412) * feat: allow skipping execution deletion on test deletion (#4411) * add latest tag to jmeterd slave (#4414) * docs: fix default commands format (#4415) * feat: metric uri * fix: add test and testsuite uri * fix: sort labels * fix: format labels * fix: update openapi schema (#4417) * fix: do not store output in test suite execution result (#4409) * fix: do not store output in test suite execution result * fix: clean execution result in the BatchResults as well * fix: add apis spec note and check for nil * fix: batch output clean (#4423) * Distributed JMeter and Misc Editing (#4404) * docs: add status pages (#4376) * docs: add status pages without images * docs: remove pro reference * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: more detailed description of the pages * docs: add suggestion from review * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add example curl test * docs: add screenshots * docs: apply review suggestion * docs: update images * docs: update example to use UI instead of CLI * docs: review suggestions --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add sp to sidebars (#4426) * feat: slack dashboard uri * fix: slack template * fix: slack template * feat: add dashbaord uris for executions * fix: make error verbose * Update docker-build-develop.yaml * ci: fix goreleaser build (#4429) * Turn off cache for api * Image Updates for 1.14 Part 1 (#4434) * update docs (#4436) * feat: execute post run script before scraping * fix: unit test * fix: update docs * fix: dep update * docs: add cached test result docs (#4441) * docs: add cached test result docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: update installation video with cloud (#4442) * docs: update installation video with cloud * docs: update installation video with cloud * docs: update installation video with cloud * fix: replace deprecated method * feat: add readonly flag to test-suites (#4448) * ci: fix cache (#4449) * fix cache * fix: update CRD for Dashboard tests to match mono-repository setup (#4451) * fix: test artifacts failing due to empty file placement (#4444) (#4445) * tests - expected failures extended - oomkilled, timeout (#4452) * tests - curl directory (#4454) * tests - expected failures extended - oomkilled for Cypress (#4453) * feat: evaluate environment variables in the args of gradle (#4457) * fix: error message * fix: get error message * fix: remove condition * [Docs] Getting started - Fix Step 1 link (#4463) * fix: remove secrets endpoint * fix: exit code and mongo transaction * fix: missed init * fix: missed db init * fix: remove transaction * fix: remove transaction options * fix: clean error message * docs: update images for sp (#4466) * feat: add output stream functions and mocks (#4431) * feat: add output stream functions and mocks * fix: implement size reading and improve interfaces * fix: literal to const * fix: nil context * docs: guide on how to deploy TK from private registry (#4468) add guide on how to deploy TK from private registry * add category to docs * fix jmeterd slave build * docs: fix navbar not showing on small screens (#4490) * feat: add Testkube Cloud announcement in docs (#4492) * feat: move announcement bar below the navigation bar * feat: add announcement bar for Testkube Cloud * fix: adjust the search button on mobile devices * fix: adjust sign in link to match existing [id^=sign] GTM trigger * ci: fix kubepug installation (#4495) fix kubepug installation * feat: resource regex (#4480) * feat: name regex for trigger selectors * fix: dep update * fix: regex test * doc: add example for regex * fix: select tests and test suites for name reg ex * fix: dep update * fix: enable secrets endpoint (#4469) * fix: enable secrets endpoint * fix: env mame typo * fix: visibility label for secrets * fix: dep update * fix: dep update * fix: expand env for args (#4481) * feat: run scripts in working dir (#4489) * feat: run scripts in working dir * fix: add default working dir * feat: working dir env var * use: working dir param * fix: fmt option * fix: don't check stdin piping * fix: use env param * fix: use working dir env var * fix: use env working dir * feat: Maven jdk 8 test, example (based on the one for 11) (#4501) * Maven example for jdk8 * Maven example for jdk8, tests * fix: Maven 8 test - branch fixed (#4502) * Maven example for jdk8 * Maven example for jdk8, tests * maven test - branch * Testkube OSS page and additional screenshot updates (#4493) * fix: wrong link (#4504) * feat: minor jmeterd updates (#4503) * minor updated to jmeterd * remove more redundant logic in jmeterd * fix: remove var * feat: improve performance for slowest operations / fix: loading total executions number for test suite (#4507) * fix: count total executions for single test suite, not all * feat: optimize getting latest tests/test suites queries * docs: argocd integration (#4510) update argocd docs * fix: add npm report permissions (#4511) * fix: add npm report permissions * fix: add comment * fix: merge issue * fix: merge typo * fix: merge issues * fix: merge issues * feat: Update k6s executor image (#4516) * replace image for k6 * feat: improve performance of listing tests/test suites/executions (#4518) * feat: improve performance of listing tests/test suites/executions * renamed template crd example name to job-template Signed-off-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> * feat: add env var for runner * fix: unit test * feat: speed up aggregates with projection and _id $lookups (#4524) * fix: ignore post script error * fix: return executions for all tests when requested (#4528) * fix: total number of test suite executions should ignore paging filters (#4530) * docs: add pro feature badge to pro feature pages (#4529) * docs: added pro feature badge to pro feature pages * docs: fix indent * docs: Getting Started Rework (#4523) * Getting Started Rework Add 'Open Source or Cloud' doc to the Overview section at the beginning of the documentation. * Getting Started Rework Update testkube-oss.md to refer to table in Open Source or Cloud. * docs: Fix OSS documentation link (#4538) * feat: add MongoDB migrations, run it on API start (#4534) * feat: add MongoDB migrations, run it on API start * feat: move MongoDB migrations to common directory * fix typo * feat: allow disabling MongoDB migrations with environment variable / fix: display migrations planner error * feat: extract Database wrapper from DbMigrator * feat: extract logic for getting the migrations from disk out of NewDbMigrator * chore: delete error from NewDbMigrator * fix: DbMigrator bugs * fix: add unit tests for DbMigrator * fix: order imports * fix: make the failing MongoDB migrations warning instead of error * fixup linting * feat: embed MongoDB migrations in the binary (#4540) * feat: use fs.FS for DbMigrator * chore: add unit tests for getting MongoDB migrations from FS * feat: embed MongoDB migrations in binary * fix: flaky jmeterd test (#4521) * propagate env vars to jmeterd slaves (#4541) * feat: speed up - use covered queries for tests/test suites list (#4536) * feat: speed up - use covered queries for tests/test suites list * feat: add compound index for new executions search query * feat: make optional junit * fix: print new env var * fix: remove code duplication * docs: Clean up and reorganize getting starter pages and redirects (#4551) * docs: update GH action (#4496) * update docs for GH action * fix: optional artillery junit * fix: optional ginkgo junit * fix: optional jmeter junit * fix: optional junit for jmeterd * fix: postman optional junit * fix: obfuscate args * docs: argocd image updates (#4553) * updated docs for ArgocdCD sync * docs: env vars * fix: typo * Update docs/docs/articles/running-tests.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use `aggregate: 1` for getting latest by test (#4560) * update executors with curl, openssh, sshpass * add remove cache * add sshpass to jmeterd * fix: ignore empty secret ref * feat: change executor model * feat: use data dir as working dir model * fix: dep update * fix: unit test * fix: use data dir as working dir * docs: cli * fix: dep update * feat: pass wartcher event to trigger * docs: env vars * fix: remove hint * build postman * remove testing branch * fix: aggregate(1) on test suite results (#4577) * fix: result line for websockets (#4576) * feat: download testsuite artifacts * fix: download conditions * fix: remove check * docs: cached test suites (#4580) * fix: cli disable get config for cload context (#4583) * fix: dep update * feat: download artifacts in init container * fix: field comment * fix: unittest * fix: remove namespace * fix: uri scheme * fix: dep update * docs: passed artifacts * fix: support silent mode * fix: allow download reports for failed * fix: test suite err check * fix: update to outdated cypress images (#4607) * fix: typo in test run image flag (#4608) * fix: typo in test run image flag * fix: typo in test run image flag * fix: typo in test run image flag * fix: typo in test run image flag * add enterprise docs * fix failing docs * fix api values * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update production setup * add email examples * add space * fix docs * chore: rename secret label * fix: dep update * docs: argocd cron jobs sync * feat: adding support for tracetest cloud on tracetest executor (#4613) * feat: adding support for tracetest cloud on tracetest executor * fix lint issues * adding integration tests for tracetest executor * fixing unit test * adding PR suggestions * feat: add test name to the download folder * feat: update test staus after completion * docs: added gitlab and jenkins cicd docs (#4619) * added gitlab and jenkins cicd docs * added example * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * added samples to jenkins and some refinement in gitlab --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fixed cicd review (#4634) * Update cicd-overview.md * fix: do not return empty latestExecution with Test/TestSuite (#4636) * fix: allow terminating CLI while watching test/test suite run (#4638) * docs: some fixes (#4637) * some fixes * used container image instead of default * fix: table output performance (#4640) * chore: update tablewriter to the latest version * feat: truncate the error message for test suites * feat: Executor tests - Container executor: Playwright - args (#4645) * executor tests - playwright - args * playwright testsuite updated * playwright test updated * fix scorecard failing on branches which are not default * fix: use existing file for kubepug test (#4644) * used existing file for kubepug * change the data structures and outdated examples to match newer version of kubepug * Fix editUrl for docs (#4652) "Edit this page" links on documentation pages were broken because of the change to have the `develop` branch as default. This PR fixes the editUrl in Docusaurus config. * fix: Latest image tag for testkube cli (#4653) * added the latest image tag * test: update branch name in kubepug tests (#4654) * fix: dep update --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> Co-authored-by: hiteshwani <110378441+hiteshwani@users.noreply.github.com> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: fivenp <mh@fivenp.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: PepperKick <abhishrant.m@gmail.com> Co-authored-by: jmorante-ks <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> Co-authored-by: Bogdan Hanea <bogdan.hanea@yahoo.com> Co-authored-by: Javier Morante <javier@kubeshop.io> Co-authored-by: Daniel Baptista Dias <danielbdias@users.noreply.github.com> Co-authored-by: Hamid <33328203+emamihe@users.noreply.github.com> Co-authored-by: Catalin <20538711+devcatalin@users.noreply.github.com>
vsukhin
added a commit
that referenced
this pull request
Dec 4, 2023
* fix: change log message * fix: change log parameter * fix: check for exit code * fix: replace timer by ticker * fix: change error message * fix: add events to messages * fix: filter pod events * fix: update error message * feat: test and test suite --update flag * feat: additional update flags * feat: update docs * fix: check if update flag was chaged * feat: update operator reference (#4399) * feat: jmeterd test updates * feat: Slave configuration in Executor CRD and ownerReferences changes in slaves pod (#4385) * Added slaves filed in Executor CRD to add slaves configs Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * OwnerRefs changes for slaves pod Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * removed the local path from go.mod file Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed linters issue Signed-off-by: Aman Parauliya <aman@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <aman@infracloud.io> * feat: refactor jmeterd slaves module (#4408) * feat: refactor jmeterd slaves module * fix flaky slaves unit test * ci: add arm64 (#4374) * add arm64 for jmeterd * feat: add labels to count metrics * fix: metric fields * feat: support dirs for soap, postman, curl * fix: flaky jmeterd test (#4412) * feat: allow skipping execution deletion on test deletion (#4411) * add latest tag to jmeterd slave (#4414) * docs: fix default commands format (#4415) * feat: metric uri * fix: add test and testsuite uri * fix: sort labels * fix: format labels * fix: update openapi schema (#4417) * fix: do not store output in test suite execution result (#4409) * fix: do not store output in test suite execution result * fix: clean execution result in the BatchResults as well * fix: add apis spec note and check for nil * fix: batch output clean (#4423) * Distributed JMeter and Misc Editing (#4404) * docs: add status pages (#4376) * docs: add status pages without images * docs: remove pro reference * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: more detailed description of the pages * docs: add suggestion from review * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add example curl test * docs: add screenshots * docs: apply review suggestion * docs: update images * docs: update example to use UI instead of CLI * docs: review suggestions --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add sp to sidebars (#4426) * feat: slack dashboard uri * fix: slack template * fix: slack template * feat: add dashbaord uris for executions * fix: make error verbose * Update docker-build-develop.yaml * ci: fix goreleaser build (#4429) * Turn off cache for api * Image Updates for 1.14 Part 1 (#4434) * update docs (#4436) * feat: execute post run script before scraping * fix: unit test * fix: update docs * fix: dep update * docs: add cached test result docs (#4441) * docs: add cached test result docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: update installation video with cloud (#4442) * docs: update installation video with cloud * docs: update installation video with cloud * docs: update installation video with cloud * fix: replace deprecated method * feat: add readonly flag to test-suites (#4448) * ci: fix cache (#4449) * fix cache * fix: update CRD for Dashboard tests to match mono-repository setup (#4451) * fix: test artifacts failing due to empty file placement (#4444) (#4445) * tests - expected failures extended - oomkilled, timeout (#4452) * tests - curl directory (#4454) * tests - expected failures extended - oomkilled for Cypress (#4453) * feat: evaluate environment variables in the args of gradle (#4457) * fix: error message * fix: get error message * fix: remove condition * [Docs] Getting started - Fix Step 1 link (#4463) * fix: remove secrets endpoint * fix: exit code and mongo transaction * fix: missed init * fix: missed db init * fix: remove transaction * fix: remove transaction options * fix: clean error message * docs: update images for sp (#4466) * feat: add output stream functions and mocks (#4431) * feat: add output stream functions and mocks * fix: implement size reading and improve interfaces * fix: literal to const * fix: nil context * docs: guide on how to deploy TK from private registry (#4468) add guide on how to deploy TK from private registry * add category to docs * fix jmeterd slave build * docs: fix navbar not showing on small screens (#4490) * feat: add Testkube Cloud announcement in docs (#4492) * feat: move announcement bar below the navigation bar * feat: add announcement bar for Testkube Cloud * fix: adjust the search button on mobile devices * fix: adjust sign in link to match existing [id^=sign] GTM trigger * ci: fix kubepug installation (#4495) fix kubepug installation * feat: resource regex (#4480) * feat: name regex for trigger selectors * fix: dep update * fix: regex test * doc: add example for regex * fix: select tests and test suites for name reg ex * fix: dep update * fix: enable secrets endpoint (#4469) * fix: enable secrets endpoint * fix: env mame typo * fix: visibility label for secrets * fix: dep update * fix: dep update * fix: expand env for args (#4481) * feat: run scripts in working dir (#4489) * feat: run scripts in working dir * fix: add default working dir * feat: working dir env var * use: working dir param * fix: fmt option * fix: don't check stdin piping * fix: use env param * fix: use working dir env var * fix: use env working dir * feat: Maven jdk 8 test, example (based on the one for 11) (#4501) * Maven example for jdk8 * Maven example for jdk8, tests * fix: Maven 8 test - branch fixed (#4502) * Maven example for jdk8 * Maven example for jdk8, tests * maven test - branch * Testkube OSS page and additional screenshot updates (#4493) * fix: wrong link (#4504) * feat: minor jmeterd updates (#4503) * minor updated to jmeterd * remove more redundant logic in jmeterd * fix: remove var * feat: improve performance for slowest operations / fix: loading total executions number for test suite (#4507) * fix: count total executions for single test suite, not all * feat: optimize getting latest tests/test suites queries * docs: argocd integration (#4510) update argocd docs * fix: add npm report permissions (#4511) * fix: add npm report permissions * fix: add comment * fix: merge issue * fix: merge typo * fix: merge issues * fix: merge issues * feat: Update k6s executor image (#4516) * replace image for k6 * feat: improve performance of listing tests/test suites/executions (#4518) * feat: improve performance of listing tests/test suites/executions * renamed template crd example name to job-template Signed-off-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> * feat: add env var for runner * fix: unit test * feat: speed up aggregates with projection and _id $lookups (#4524) * fix: ignore post script error * fix: return executions for all tests when requested (#4528) * fix: total number of test suite executions should ignore paging filters (#4530) * docs: add pro feature badge to pro feature pages (#4529) * docs: added pro feature badge to pro feature pages * docs: fix indent * docs: Getting Started Rework (#4523) * Getting Started Rework Add 'Open Source or Cloud' doc to the Overview section at the beginning of the documentation. * Getting Started Rework Update testkube-oss.md to refer to table in Open Source or Cloud. * docs: Fix OSS documentation link (#4538) * feat: add MongoDB migrations, run it on API start (#4534) * feat: add MongoDB migrations, run it on API start * feat: move MongoDB migrations to common directory * fix typo * feat: allow disabling MongoDB migrations with environment variable / fix: display migrations planner error * feat: extract Database wrapper from DbMigrator * feat: extract logic for getting the migrations from disk out of NewDbMigrator * chore: delete error from NewDbMigrator * fix: DbMigrator bugs * fix: add unit tests for DbMigrator * fix: order imports * fix: make the failing MongoDB migrations warning instead of error * fixup linting * feat: embed MongoDB migrations in the binary (#4540) * feat: use fs.FS for DbMigrator * chore: add unit tests for getting MongoDB migrations from FS * feat: embed MongoDB migrations in binary * fix: flaky jmeterd test (#4521) * propagate env vars to jmeterd slaves (#4541) * feat: speed up - use covered queries for tests/test suites list (#4536) * feat: speed up - use covered queries for tests/test suites list * feat: add compound index for new executions search query * feat: make optional junit * fix: print new env var * fix: remove code duplication * docs: Clean up and reorganize getting starter pages and redirects (#4551) * docs: update GH action (#4496) * update docs for GH action * fix: optional artillery junit * fix: optional ginkgo junit * fix: optional jmeter junit * fix: optional junit for jmeterd * fix: postman optional junit * fix: obfuscate args * docs: argocd image updates (#4553) * updated docs for ArgocdCD sync * docs: env vars * fix: typo * Update docs/docs/articles/running-tests.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use `aggregate: 1` for getting latest by test (#4560) * update executors with curl, openssh, sshpass * add remove cache * add sshpass to jmeterd * fix: ignore empty secret ref * feat: change executor model * feat: use data dir as working dir model * fix: dep update * fix: unit test * fix: use data dir as working dir * docs: cli * fix: dep update * feat: pass wartcher event to trigger * docs: env vars * fix: remove hint * build postman * remove testing branch * fix: aggregate(1) on test suite results (#4577) * fix: result line for websockets (#4576) * feat: download testsuite artifacts * fix: download conditions * fix: remove check * docs: cached test suites (#4580) * fix: cli disable get config for cload context (#4583) * fix: dep update * feat: download artifacts in init container * fix: field comment * fix: unittest * fix: remove namespace * fix: uri scheme * fix: dep update * docs: passed artifacts * fix: support silent mode * fix: allow download reports for failed * fix: test suite err check * fix: update to outdated cypress images (#4607) * fix: typo in test run image flag (#4608) * fix: typo in test run image flag * fix: typo in test run image flag * fix: typo in test run image flag * fix: typo in test run image flag * add enterprise docs * fix failing docs * fix api values * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/auth.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/testkube-enterprise/articles/usage-guide.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update production setup * add email examples * add space * fix docs * chore: rename secret label * fix: dep update * docs: argocd cron jobs sync * feat: adding support for tracetest cloud on tracetest executor (#4613) * feat: adding support for tracetest cloud on tracetest executor * fix lint issues * adding integration tests for tracetest executor * fixing unit test * adding PR suggestions * feat: add test name to the download folder * feat: update test staus after completion * docs: added gitlab and jenkins cicd docs (#4619) * added gitlab and jenkins cicd docs * added example * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/gitlab.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/jenkins.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * added samples to jenkins and some refinement in gitlab --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fixed cicd review (#4634) * Update cicd-overview.md * fix: do not return empty latestExecution with Test/TestSuite (#4636) * fix: allow terminating CLI while watching test/test suite run (#4638) * docs: some fixes (#4637) * some fixes * used container image instead of default * fix: table output performance (#4640) * chore: update tablewriter to the latest version * feat: truncate the error message for test suites * feat: Executor tests - Container executor: Playwright - args (#4645) * executor tests - playwright - args * playwright testsuite updated * playwright test updated * fix scorecard failing on branches which are not default * fix: use existing file for kubepug test (#4644) * used existing file for kubepug * change the data structures and outdated examples to match newer version of kubepug * Fix editUrl for docs (#4652) "Edit this page" links on documentation pages were broken because of the change to have the `develop` branch as default. This PR fixes the editUrl in Docusaurus config. * fix: Latest image tag for testkube cli (#4653) * added the latest image tag * test: update branch name in kubepug tests (#4654) * Fixed cypress image tag * Update release.yaml (#4661) * feat: add support for skip tls verify in minio (#4649) * feat: add support for skip tls verify in minio * fix failing integration tests due to bad minio config * fix: cloud mode download artifacts (#4664) * feat: cloud rename - update CLI and environment variables TKC-875 (#4663) * feat: update pro environment variables * feat: add pro commands * style: revert non-user impacting changes * fix: icons urls in docs (#4670) * some bugfixes (#4650) * docs: Docs Cloud Rename (#4669) * Docs Cloud Rename * docs: update cli docs and add redirects * docs: update URLs in docs * docs: fix redirect * docs: fix reference * docs: fix reference --------- Co-authored-by: Lilla Vass <lilla@kubeshop.io> * added the pushing latest tag to the release (#4672) * Revert "docs: Docs Cloud Rename (#4669)" (#4676) This reverts commit e17e5b3. * fix: exit code 1 for failed run * fix: avoid hashed indexes and aggregate: 1 (#4681) * fix: avoid using hashed indexes, as these are not supported in AWS DocumentDB * fix: avoid aggregate: 1 * feat: add support for TLS in NATS and MinIO clients (#4685) * add support for TLS in NATS and MinIO clients * fix envconfig tags in InitEnvs * feat: slave pod spec (#4632) * feat: pod specification api spec * fix: pod update request * feat: pod spec model * fix: update makefile * fix: change execution model * fix: mapper for pod slave config * fix: add pod type to template cli * feat: pass slave pod template * feat: slave pod template env * feat: use slave pod template * fix: pod options * fix: dep update * feat: pass slave pod options * feat: add slave pod flags * feat: add cli for slave pod params * fix: update podd template * fix: error message * fix: rename template * fix: quote template * fix: check for nil * fix: indent * fix: dep update * fix: use template func in pod template * docs: slave pod specs * feat: add offline cli docs (#4614) * feat: add offline cli docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: Docs Cloud Rename (#4669) (#4677) * docs: Docs Cloud Rename (#4669) * Docs Cloud Rename * docs: update cli docs and add redirects * docs: update URLs in docs * docs: fix redirect * docs: fix reference * docs: fix reference --------- Co-authored-by: Lilla Vass <lilla@kubeshop.io> * docs: add redirects --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: wrong switch usage * docs: update testkube pro installation video (#4696) * Executor tests - jmeter (#4701) * feat: webhook template funcs * docs: helper methods * fix: permission issue fix in .testkube directory (#4673) * permission issue fixed in .testkube directory * Update build/kubectl-testkube/Dockerfile Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * executor tests - cypress 13 project and tests (#4615) * gitlab-improvement (#4686) * gitlab-improvement * bugfix * fix: GetLatestByTest returns objet not found (#4705) * feat: insecure direct * fix: docs * feat: refactor jmeterd executor to add better testing and support for better exit status handling (#4704) * refactor jmeterd executor to add better testing and support for better exit status handling * minor updates and test fixes to jmeterd * add integration test flag for jmeterd test * lint pass at jmeterd executor * docs: make agent pro (#4709) * docs: Add references to the args and command explanations (#4693) * docs: Add references to the args and command explanations * docs: added parameter explanations * docs: code review comments * docs: add quotes around tags * docs: update flags * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: Update docs/docs/test-types/executor-jmeter.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: add simpler implementation of MongoDB queries for DocumentDB (#4710) * fix: merge * fix: performance of execution status queries (#4712) * propagate namespace when test is executed as part of a testsuite (#4716) * fix: broken links * fix: dep update --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: hiteshwani <110378441+hiteshwani@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: PepperKick <abhishrant.m@gmail.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: jmorante-ks <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Satish Kumar Kadarkarai Main <michael.satish@gmail.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: Bogdan Hanea <bogdan.hanea@yahoo.com> Co-authored-by: Javier Morante <javier@kubeshop.io> Co-authored-by: fivenp <mh@fivenp.com> Co-authored-by: Daniel Baptista Dias <danielbdias@users.noreply.github.com> Co-authored-by: Hamid <33328203+emamihe@users.noreply.github.com> Co-authored-by: Catalin <20538711+devcatalin@users.noreply.github.com> Co-authored-by: Lilla Vass <lilla@kubeshop.io>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull request description
Checklist (choose whats happened)
Breaking changes
Changes
Fixes