-
Notifications
You must be signed in to change notification settings - Fork 132
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Executor tests - edge cases - expected failures #4251
Conversation
Codecov ReportPatch and project coverage have no change.
❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more. Additional details and impacted files@@ Coverage Diff @@
## develop #4251 +/- ##
========================================
Coverage 27.83% 27.83%
========================================
Files 213 213
Lines 17943 17943
========================================
Hits 4995 4995
Misses 12467 12467
Partials 481 481
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
* test commit (#3753) * feat: cronjob template (#3739) * feat: add cronjob template to model * feat: cron job temaplte field * fix: dep update * fix: test and test suite template typo * doc: cron job template * fix: dep update * trigger ci flow (#3754) * trigger flow (#3756) * Update flow (#3766) ci changes for develop and release branches * feat: use command parameters and deprecate args (#3694) * feat: use command parameters and deprecate args * fix: go fmt * fix: command mode field * feat:command mode field * fix: agrs mode field * fix: use args mode * fix: rmove deprecated * fix: golint * fix: unit test * fix: unit test * fix: support command and args in curl * fix: args mode parameter * fix: remove log * fix: go lint * fix: remove unused const * feat: artillery command and args * fix: update model for artifcts * feat: change artifact support * fix: refresh docs * fix: scrape curl dirs * fix: unit test * feat: postman command and args * fix: unit test * feat: kubepug args and command * fix: unit test * fix: int test * fix: postman int * feat: soapui command and args * fix: unit test * feat: add gradle command and arguments * fix: unit test * fix: unit test * fix: int test * feat: maven args and command * feat: jmeter command and args * fix: unit test * fix: unit test * feat: cypress command and args * feat: command and args for ginkgo * fix: golint * fix: report file for ginkgo * fix: ginkgo vars arg * feat: k6 args and command * feat: playwright command and args * fix: ci flow * doc: executor default args and command * fix: escape <> for docs * fix: dep update * doc: explain parameters * doc: executor command and args example * add tests for develop branch (#3769) * fix: upload variables file when it is too big for the command line (#3767) * fix: increase http timeout (#3772) * add checking for release branch (#3778) * fix typo (#3779) * fix typo in ci * fix ldflags (#3790) * docs: new information architecture (#3791) Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: aabedraba <aabedraba@aabedrabas-MacBook-Pro.local> * feat: add develop branch to docs workflow! (#3793) * docs: trigger docs build * docs: add docs redirects * feat: container init data for executors (#3768) * feat: curl container init data * feat: init container data for template * feat: init container data for soapui * feat: init container data for cypress * feat: cypress init container data * feat: init container data for postman * fix: unit test * fix: logs * fix: test * fix: unit test * fix: unit test * fix: unit test * fix: unit test * fix: unit test * fix: int test * feat: init container data for kubepug * fix: unit tests * fix: unit tests * fix: unit test * fix: int test * fix: test yaml * feat: artillery init container data * feat: init container data for ginkgo * fix: gingko int test * fix: unit test * fix: int test * fix: int test * fix: int test * fix: unit test * feat: int test * fix: unit test * fix: data dir * fix: int test * fix: unit test * fix: unit test * Revert "fix: unit test" This reverts commit 901a8df. * fix: unit test * docs: add more redirects (#3798) * docs: add redirect for test variable * docs: respect system theme for docs * docs: variables file changes (#3794) * docs: variables file changes * docs: Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * comment out automatic release branch merge for now * build: update makefile (#3803) * update makefile * add cypress12 (#3812) * docs: JMeter memory consumption (#3811) * docs: JMeter memory consumption * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * exclude building docs on every commit (#3817) * trigger workflow * trigger ci * feat: detect more kubernetes distributions (#3818) * chore: do not run test pipeline on docs * Revert "chore: do not run test pipeline on docs" This reverts commit 10f03f5. * feat: add spinner to testkube init (#3788) * feat: add spinner for testkube-init Signed-off-by: Sindhu Inti <iamsindhuinti23@gmail.com> * feat:add spinner to testkube init Signed-off-by: Sindhu Inti <iamsindhuinti23@gmail.com> * fix: import time package * linting Signed-off-by: Sindhu Inti <iamsindhuinti23@gmail.com> --------- Signed-off-by: Sindhu Inti <iamsindhuinti23@gmail.com> * chore: update broken docs links and change to new docs links everywhere (#3819) * docs: enable doc search from /search page (#3824) * chore: do not run test pipeline on docs (#3825) * docs: redirects (#3826) * fix added missing version for cypress * docs: create a Testkube Dashboard category in docs (#3834) * Dashboard E2E tests - selector fixed (#3836) * feat: added cloud connect command (#3777) * fix: http timeout (#3773) * feat: added cloud connect command * add check for release branch (#3780) * fix typo * feat: added cloud connect command * added env cloud client * build: fix ldflag (#3789) * update ldflags * comment out automatic release branch merge for now * fix typo * feat: almost done * feat: statuses update * chore: moving some parts to common package * chore connect * fix: messages * fix: dashboard * feat: add CloudLogin function * fix: flags wasnt propagating * fix: cleaning * fix: added env id and org id as well have already env created * fix: env and org env variable * fix: removed unused code * fix: flags naming * fix: added cloud uris to testkube init and upgrade * fix: passing root domain * fix: tests * fix: tests * fix: golangci lint * fix: rollbacl some strange changes * fix: rollbacl some strange changes * fix: go mod tidy * fix: extract agent port to the const * fix: unused code * fix: unused code --------- Co-authored-by: Vladislav Sukhin <vladislav@kubeshop.io> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> * docs: cloud docs improvement (#3833) * feat: Test run script - branch overwrite (#3838) * Test run script - branch param * Test run script - branch param * E2E tests moved to testkube-dashboard repo, test CRD updated (#3839) * fix: do not use object that is nil on error to register an error with on update test (#3848) * feat: ZAP executor (#3821) * feat: zap executor * rename release branch (#3845) * docs: trigger ci * docs: fix link * docs: re-enable search * docs: disable search page * fix: remove dev dockerfile (#3855) * feat: add clusterid to agent (#3858) * docs: Migrate Web Images to Local Images (#3853) * Migrate Web Images to Local Images In the Testkube Cloud doc pages. * Update architecture.md * Update environment-management.md * Update installing-agent.md * Update organization-management.md * Update managing-cli-context.md * feat: cd event emiiter (#3806) * feat: cd event emiiter * fix: lintt * fix: change cd events mapping * feat: add cdevents env vars * feat: send cd event for scraper * fix: detect mime type * fix: test type * fix: unit tests * fix: error message * fix: add source field * fix: typo * fix: add error * fix: check for empty namespace * feat: map test types for cd event * feat: map test types for cd event * fixL change notifying about files * fix: double file opening * fix: remove duplicated notification * feat: unit test for event listener * feat: cd event loader test * feat: cd event integration test * fix: unit test for extractor * fix: minio integrattion test * feat: extractor integration tests * fix: int tests * fix: int test * fix: int test * fix: int test * fix: int test * fix: run tests in parallel * fix: unit tests * docs: redirects and link fix * docs: improve examples in curl executor * fix: docs redirect * docs: add timeout docs (#3863) * docs: fix timeout and add to sidebar * Cypress 12 tests - updated (#3866) * feat: Custom container executor for Playwright - artifacts (#3867) * Playwright project - lock file aligned * Playwright project - lock file aligned * playwright artifacts tests * custom container executor - playwright - artifacts * custom container executor - cypress - artifacts (#3868) * Fixing the typo (#3865) Co-authored-by: Shiva Kumar, Harsha <harsha.shivakumar@lowes.com> * docs: fix timeout page * docs: add tracetest executor (#3878) * feat: dashboard uri for cd event (#3879) * feat: dashboard uri for cd event * fix: unit tests * fix: unit test * docs: dashboard uri * fix: unit test * fix: dep * fix: dep * fix: use latest version * docs: telemetry and metrics refinements (#3885) * docs: refine telemetry docs Refine services to which telemetry are sent * docs: refine metrics doc Relates to kubeshop/helm-charts#515 (comment) * ci: add alpine image parametrization (#3891) * add alpine image parametrization * fix typo in release flow * feat: condition ttl (#3890) * feat: add ttl to model * feat: ttl condition support * fix: dep update * fix: ttl units * fix: dep update * ci: rename gh token var (#3893) * fix: http proxy * ci: fix gc token var * docs: add zap executor (#3897) * docs: add zap executor * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * ci: add docker registry description (#3898) * add GH action for uploading readme to docker registry * fix: check username and token for update (#3896) * fix: check username and token for update * fix: update secret by field * fix: dep update * fix: dep update * docs: zap references (#3902) * feat: default artifacts dir (#3905) * feat: default artifacts dir * fix: docs * fix: dynamic artifacts diiirectory * fix: golint * ci: add SBOM and cosign for all binaries and docker images (#3910) * ci: add sboms and cosign * fix: support plain secret var for postman (#3911) * ci: add workflow dispatch * ci: add permission contents for release-dev flow * Break Dashboard doc into separate pages (#3927) * fix: support multiline commands (#3937) * fix: optional working dir * fix: remove arg * fix: support multiline commands for executors * fix: ginkgo run command * fix: zap config path * fix: remove duplicated declaration * fix: log command args * fix: golint * docs: update zap examples (#3943) * fix: update examples in docs * maven executor tests - negative test name fixed (#3945) * docs: update Ingress set-up (#3947) * docs: update Ingress set-up * fix editing suggestions * fix: link of Docs at README.md (#3918) * fix: dep update (#3929) * fix: dep update * fix: dep update * fix: dep update * docs: update the s3 with IAM setup (#3954) * docs: update the s3 with IAM setup * fix: Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use executor job template for container executor (#3959) * fix: use executor job template for container executor * fix: use executor job template * fix: check for empty template * fix: use proper mapping * fix: sync telemetry for cli (#3963) * fix: sync server and cli telemetry flag * fix: add debug logs * e2e tests - crd - separate DASHBOARD_API_URL (#3966) * feat: webhook template and headers (#3978) * feat: webhook template and headers * fix: escape text * docs: cli * feat: add unit test * fix: unit test * fix: remove reset * fix: template * fix: lint * fi * docs: webhook fields description * fix: dep * Update api/v1/testkube.yaml Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * Update pkg/api/v1/testkube/model_webhook.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * Update pkg/api/v1/testkube/model_webhook_create_request.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * docs: update zap docs (#3989) * chore: back port agent changes to develop (#3995) * docs: add docs for cd events· (#3996) * docs: add operator api reference (#3997) * docs: improve slack docs (#3994) * docs: refine schema for content.type (#4004) * fix: docs pre-run script not supported in container executor (#4001) * fix: dep update (#4011) * fix: use testkube logger for telemetry * Revert "fix: dep update (#4011)" This reverts commit 7d20507. * Revert "Revert "fix: dep update (#4011)"" This reverts commit 3404bec. * Revert "fix: use testkube logger for telemetry" This reverts commit 7e3b0c3. * Dashboard E2E tests - CRD - storageClassName added (#4018) * fix: refactor get client method (#4019) * fix: refactor get client method * fix: error message * fix: use Testkube logs for telemetry (#4014) * fix: use Testkube logs for telemetry * fix: golint * docs: Add Run Tests from Github Actions Page (#4021) * Add Run Tests from Github Actions Page * Update docs/docs/articles/run-tests-with-github-actions.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update run-tests-with-github-actions.md Fix table formatting. * Update run-tests-with-github-actions.md Add dashboardUrl to Cloud and Enterprise and Own Instance tables * Update docs/docs/articles/run-tests-with-github-actions.md Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * Update run-tests-with-github-actions.md Update yaml segments and code snippet. * Update run-tests-with-github-actions.md minor editing --------- Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * feat: test trigger condition list (#4022) * feat: test trigger condition list * fix: dep update * fix: dep update * feat: add testkube cloud login (#4026) * docs: updated getting started section for cloud (#4023) Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: testkube cloud connect populate user context (#4032) * fix: Custom cypress executor CRDs - `latest` version for Cypress 8-10 (#4027) * Cypress executor definitions - updated to latest version for Cypress 8-10 * Cypress custom executor definitions updated * docs: update docs dependencies (#4037) * docs: fix broken build * feat: parallel testsuite (#3075) * feat: test suite batch step * feat: switch to testsuite v3 * fix: go lint * feat: test suite batch execution models * feat; remove batch step execution * fix: mapping for batch testsuite execution * fix: print batch results * feat: change testsuite template * fix: update batch test execution * fix: add batch step for reference * fix: change testsuite scheduling test processing * fix: concurrency level parameter * fix: go fmt * fix: type conversion * fix: dep update * fix: add nil check * fix: nil check * fix: update version for template * fix: dep update * fix: tune test suite execution * fix: tune abortion check * fix: quote messages * dep update * fix: dep update * fix: test suite examples * fix: test suite docs * fix: doc update * add a separate workflow to test parallel testsuite images * fix: check for empty steps * fix: remove debugging * fix: pass executor id for test suites * fix: add test suite v2 object * fix: test suite v2 * fix: backward compatibility * fix: make steps optional * fix:backward compatibility for api * fix: remove test workflow * fix: docs * fix: rename test suite fields * fix: update template * fix: dep update * fix: format string * fix: golint * fix: golint * fix: change test suite step object * fix: use refactored test suite step object * fix: unit test * fix: change delay type * fix: enable caching * fix: change example * fix: test suite json refresh * fix: add test suite step v2 model * fix: doc update * fix: backward compatibility * fix: dep update --------- Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> * feat: validate cloud context on root cmd (#4033) * feat: validate cloud context on root cmd * chore: organize * chore: organize * chore: organize * feat: added org-env names to context on set context * feat: added org-env names fallback * fix: golangci lint * fix: codeql alert * fix: utf character fails build * feat: add testkube cloud init (#4042) * docs: put CLI commands in tabs (#4045) * docs: docs improvements" (#4047) * docs: small fixes (#4048) * fix: removed header from completion script (#4049) * fix: removed header from completion script * fix: removed printf * fix: populate org and env (#4055) * fix: populate org and env * fix: populate org and env * feat: add testkube cloud login alias (#4061) * docs: update docs for helm charts (#4062) * docs: Testkube CLI docker (#4064) * docs: Testkube CLI docker * docs: Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: add orgid and envid to telemetry (#4065) * chore(deps): bump golang.org/x/net from 0.6.0 to 0.7.0 (#4041) Bumps [golang.org/x/net](https://github.com/golang/net) from 0.6.0 to 0.7.0. - [Commits](golang/net@v0.6.0...v0.7.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * feat: released testkube cli docker image (#3928) * feat: yaml content type (#4070) * feat: create yaml support * feat: test source yaml update * feat: update test suite yaml * feat: test trigger yaml update * docs: openapi yaml input * Revert "docs: openapi yaml input" This reverts commit 1710b0e. * Revert "Revert "docs: openapi yaml input"" This reverts commit 90f7697. * fix: update flow token * fix: lint version * fix: check linting * fix: lint version check * fix: change lint version * fix: test linter * fix: openapi linter * fix: var shadow * fix: delete test returns error only when deleting test CR fails otherwise it returns warnings (#3813) * fix: delete test returns error only when deleting test CR fails otherwise it returns warnings * fix: upgrade open api lint action * fix: open api error * fix: test * test: update install.sh script (#4071) * update install script to include beta arg * feat: post run script (#4075) * feat: post run script * docs: cli reference * fix: lint check * fix: go fmt * Revert "fix: lint check" This reverts commit ed82bd5. * fix: optional args mode * fix: dep update * cypress 12 example setup - step skipped (#4078) * fix: check for nil parent (#4079) * feat: basic reconciler (#4082) * feat: basic reconciler * fix: remove break * fix: check job pod state * fix: break loop * feat: add reconciler to api sservice * fix: add reconclier to config * fix: nil check * fix: test suite steps status * ci: remove release branch creation in helm-charts repo (#4090) * feat: cluster name for events (#4091) * feat: cluster name for events * fix: unit tests * docs: fixing indentation around testkube ingress sample (#4087) * feat: add refresh token for cloud (#4095) * feat: relogin on refresh token failure (#4104) * fix: add timeout to grpc conn (#4107) * fix: added timout to grpc conn * fix: log in valid place * fix: allow to configure timeout with env variable * fix: print timout * fix: print timout * fix: timeout as seconds * feat: add gitlab login option to cli (#4103) * feat: cloud dashboard command and fixes to cloud header (#4086) * fix: Login message is showed twice (#4115) * feat: probe conditions (#4099) * feat: test trigger probe model * fix: crd template * feat: probe spec mapping * fix: golint * fix: add delay parameter * fix: chnage prob spec model * feat: basic probe checker * fix: use testkube http client * fix: unit tests * fix: wait for ip assigment * fix: template expression * fix: dep update * feat: tracetest executor (#4117) * feat: tracetest executor * fix: invalid error message (#4122) * fix: invalid error message * fix: update messages * fix: missing errPrefix * fix: escape and unescape dots (#4119) * fix: escape and unescape dots * fix: change method return type * fix: goreleaser config (#4125) * add name template to goreleaser files * fix: wrong struct used to marshal body into (#4127) * fix: map test suite YAML to proper update structure (#4129) * chore: fix local build (#4097) * fix: check config if it is base64 before decoding it (#4088) * fix: add hashtag to shebang in example script (#4137) * feat: add test labels to jobs and pods (#4134) * docs: update example to be appliable on copy-paste (#4142) * Testsuites switched to CRDs and v3, run script updated, k6 test fixed after workingdir changes (#4143) * fix: dep update (#4145) * feat: Tests/TestSuites - namespaces removed, run script updated (#4148) * Test/TestSuite CRDs - namespaces removed, run script updated (namespace support) * run script updated * run script updated * docs: add needed permissions for the S3 IAM role (#4151) * fix: use dedicated function to test minio availability (#4149) * fix: use dedicated function to test minio availability * fix: make as bool the IsConnectionPossible func * docs: add support to executor kubent (#4008) * docs: add support to executor kubent * docs: apply suggestions from code review Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * ci: update kubepug version (#4163) * Improved webhooks.mdx and added section on how to develop and test (#4159) * fix: reconciler scraper (#4174) * fix: reconcile execution with scraper * fix: add executor client * fix: change reconciliation interval * fix: use proper Playwright version in its executor (#4171) * ci: fail job on unsuccessful push to apt (#4179) * feat: use entrypoint sh for container executor (#4162) * feat: use entrypoint sh for container executor * feat: add container shell field * feat: create dynamically entrypoint * fix: script paths * feat: add docker inspection * feat: add secret creds to skopeo * Revert "Auxiliary commit to revert individual files from b2b1282" This reverts commit e0c9f0ff94756e81de76139429a1bef665995ebe. * fix: generate mock * fix: pass registry parameter * fix: add const for script names * feat: add const for entrypoint * feat: add unit tests for skopeo secrets * dashboard-e2e-tests removed from testsuite, will be run seperately (#4186) * fix: start telemetry async (#4189) * fix: output parsing test (#4196) * fix: successful output parsing test * fix: check if executor log is already in json output * fix: ignore queued * fix: change container logs * fixL ignore scraper result * fix: add nil checks * fix: add unit tests * fix: golint * fix: change condition * fix: update execution result on failure * feat: compress artifacts feature (#4198) * feat: pytest executor (#4203) * feat: sample python test * feat: pytest sample test * feat: pytest executor crd * feat: passed and failed test samples * fix: 2 test crds * fix: test branch * feat: docs * feat: junit xml (#4202) * feat: junit xml * feat: xml jtl format support * fix: condition tuning * fix: test fake site * fix: unit tests * Revert "fix: test fake site" This reverts commit 03a3242. * Revert "Revert "fix: test fake site"" This reverts commit 2697568. * Revert "Revert "Revert "fix: test fake site""" This reverts commit 00fe235. * feat: disable analytics.testkube.io calls (#4207) * update install script (#4209) * feat: helm chart version (#4215) * feat: tostring method (#4220) * feat: add tostring to template * feat: vartypeptrtostring template method * feat: add tmp method to job ext * feat: add helper method for template * fix: spelling * fix: doc format * fix: switch to warning on telemetry error (#4222) * fix: switch to warning on telemetry error * fix: change condition * fix: golint * fix: doc * Revert "fix: doc" This reverts commit a6da7d3. * Playwright custom container executor - CI=1 (#4213) * fix: more cypress statuses (#4098) * fix: more cypress statuses * Update contrib/executor/cypress/pkg/runner/cypress.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * fix: install script (#4230) * fix: install script * fix: remove special chas for yaml (#4239) * ci: remove beta flow (#4242) * Update Step 3 of creating Tests (#4244) * Update Step 3 of creating Tests * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: make <img> tags self-closing in docs (#4246) * Docs - CI/CD overview - Testkube run action, additional examples (#4252) * Executor tests - edge cases - expected failures (#4251) * feat: test execution crd (#4206) * feat: test execution crd * fix: add basic test execution map * fix: map test execution model * feat: change execution model * feat: update test execution crd * fix: add param to api spce * feat: test suite execution model * feat: dep update * fix: dep update * fix: mapper for test suite execution * fix: mapper for test suite execution * fix: map var typo * fix: store test suite execution name * fix: add generation field * fix: save generation * fix: dep update * fixL execution crds docs * fix: dep update * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: skip empty step (#4264) * fix: add aws s3 bucket examples (#4265) * fix: pytest docs (#4267) * fix: pytest docs * fix: spelling * fix: syntax * fix: change menu (#4268) * fix: add ci=1 for all jobs (#4269) * feat: add error tracking for cloud init (#4266) * fix: streaming logs not working (#4212) * fix: streaming logs not working * fix: use only one condition wait when waiting for logs * feat: webhook patch (#4272) * feat: webhook patch method * fix: update webhook cli * fix: update doc * fix: golint * fix: use go 1.21 (#4273) * fix: debug command and cypress showing failed steps (#4276) * Revert "fix: streaming logs not working (#4212)" This reverts commit 74501d9. * fix: remove deprecated rand seed * feat: Tests - resource requests added (#4286) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * fix: Tests - missing ginkgo job template added (resource requests) (#4288) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * Tests - ginkgo - missing jobTemplate added * feat: envs vars for webhook (#4284) * feat: envs vars for webhook * doc: webhook template * doc: webhook template * fix: dep update --------- Signed-off-by: Sindhu Inti <iamsindhuinti23@gmail.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Abdallah Abedraba <aabedraba@gmail.com> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: aabedraba <aabedraba@aabedrabas-MacBook-Pro.local> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io> Co-authored-by: Sindhu Inti <89198083+Sindhuinti@users.noreply.github.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Harsha Shiva Kumar <harshaskumar05@gmail.com> Co-authored-by: Shiva Kumar, Harsha <harsha.shivakumar@lowes.com> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: Guillaume Berche <guillaume.berche@orange.com> Co-authored-by: Richard Kovacs <kovacsricsi@gmail.com> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dylan Jones <85761518+djonesz@users.noreply.github.com> Co-authored-by: Ankit Jain <ankitjaininfo@users.noreply.github.com> Co-authored-by: Édouard Lopez <edouard-lopez@users.noreply.github.com> Co-authored-by: Bruno Lopes <bruno@kubeshop.io>
* docs: fixing indentation around testkube ingress sample (#4087) * feat: add refresh token for cloud (#4095) * feat: relogin on refresh token failure (#4104) * fix: add timeout to grpc conn (#4107) * fix: added timout to grpc conn * fix: log in valid place * fix: allow to configure timeout with env variable * fix: print timout * fix: print timout * fix: timeout as seconds * feat: add gitlab login option to cli (#4103) * feat: cloud dashboard command and fixes to cloud header (#4086) * fix: Login message is showed twice (#4115) * feat: probe conditions (#4099) * feat: test trigger probe model * fix: crd template * feat: probe spec mapping * fix: golint * fix: add delay parameter * fix: chnage prob spec model * feat: basic probe checker * fix: use testkube http client * fix: unit tests * fix: wait for ip assigment * fix: template expression * fix: dep update * feat: tracetest executor (#4117) * feat: tracetest executor * fix: invalid error message (#4122) * fix: invalid error message * fix: update messages * fix: missing errPrefix * fix: escape and unescape dots (#4119) * fix: escape and unescape dots * fix: change method return type * fix: goreleaser config (#4125) * add name template to goreleaser files * fix: wrong struct used to marshal body into (#4127) * fix: map test suite YAML to proper update structure (#4129) * chore: fix local build (#4097) * fix: check config if it is base64 before decoding it (#4088) * fix: add hashtag to shebang in example script (#4137) * feat: add test labels to jobs and pods (#4134) * docs: update example to be appliable on copy-paste (#4142) * Testsuites switched to CRDs and v3, run script updated, k6 test fixed after workingdir changes (#4143) * fix: dep update (#4145) * feat: Tests/TestSuites - namespaces removed, run script updated (#4148) * Test/TestSuite CRDs - namespaces removed, run script updated (namespace support) * run script updated * run script updated * docs: add needed permissions for the S3 IAM role (#4151) * fix: use dedicated function to test minio availability (#4149) * fix: use dedicated function to test minio availability * fix: make as bool the IsConnectionPossible func * docs: add support to executor kubent (#4008) * docs: add support to executor kubent * docs: apply suggestions from code review Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * ci: update kubepug version (#4163) * Improved webhooks.mdx and added section on how to develop and test (#4159) * fix: reconciler scraper (#4174) * fix: reconcile execution with scraper * fix: add executor client * fix: change reconciliation interval * fix: use proper Playwright version in its executor (#4171) * ci: fail job on unsuccessful push to apt (#4179) * feat: use entrypoint sh for container executor (#4162) * feat: use entrypoint sh for container executor * feat: add container shell field * feat: create dynamically entrypoint * fix: script paths * feat: add docker inspection * feat: add secret creds to skopeo * Revert "Auxiliary commit to revert individual files from b2b1282" This reverts commit e0c9f0ff94756e81de76139429a1bef665995ebe. * fix: generate mock * fix: pass registry parameter * fix: add const for script names * feat: add const for entrypoint * feat: add unit tests for skopeo secrets * dashboard-e2e-tests removed from testsuite, will be run seperately (#4186) * fix: start telemetry async (#4189) * fix: output parsing test (#4196) * fix: successful output parsing test * fix: check if executor log is already in json output * fix: ignore queued * fix: change container logs * fixL ignore scraper result * fix: add nil checks * fix: add unit tests * fix: golint * fix: change condition * fix: update execution result on failure * feat: compress artifacts feature (#4198) * feat: pytest executor (#4203) * feat: sample python test * feat: pytest sample test * feat: pytest executor crd * feat: passed and failed test samples * fix: 2 test crds * fix: test branch * feat: docs * feat: junit xml (#4202) * feat: junit xml * feat: xml jtl format support * fix: condition tuning * fix: test fake site * fix: unit tests * Revert "fix: test fake site" This reverts commit 03a3242. * Revert "Revert "fix: test fake site"" This reverts commit 2697568. * Revert "Revert "Revert "fix: test fake site""" This reverts commit 00fe235. * feat: disable analytics.testkube.io calls (#4207) * update install script (#4209) * feat: helm chart version (#4215) * feat: tostring method (#4220) * feat: add tostring to template * feat: vartypeptrtostring template method * feat: add tmp method to job ext * feat: add helper method for template * fix: spelling * fix: doc format * fix: switch to warning on telemetry error (#4222) * fix: switch to warning on telemetry error * fix: change condition * fix: golint * fix: doc * Revert "fix: doc" This reverts commit a6da7d3. * Playwright custom container executor - CI=1 (#4213) * fix: more cypress statuses (#4098) * fix: more cypress statuses * Update contrib/executor/cypress/pkg/runner/cypress.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * fix: install script (#4230) * fix: install script * fix: remove special chas for yaml (#4239) * ci: remove beta flow (#4242) * Update Step 3 of creating Tests (#4244) * Update Step 3 of creating Tests * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: make <img> tags self-closing in docs (#4246) * Docs - CI/CD overview - Testkube run action, additional examples (#4252) * Executor tests - edge cases - expected failures (#4251) * feat: test execution crd (#4206) * feat: test execution crd * fix: add basic test execution map * fix: map test execution model * feat: change execution model * feat: update test execution crd * fix: add param to api spce * feat: test suite execution model * feat: dep update * fix: dep update * fix: mapper for test suite execution * fix: mapper for test suite execution * fix: map var typo * fix: store test suite execution name * fix: add generation field * fix: save generation * fix: dep update * fixL execution crds docs * fix: dep update * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: skip empty step (#4264) * fix: add aws s3 bucket examples (#4265) * fix: pytest docs (#4267) * fix: pytest docs * fix: spelling * fix: syntax * fix: change menu (#4268) * fix: add ci=1 for all jobs (#4269) * feat: add error tracking for cloud init (#4266) * fix: streaming logs not working (#4212) * fix: streaming logs not working * fix: use only one condition wait when waiting for logs * feat: webhook patch (#4272) * feat: webhook patch method * fix: update webhook cli * fix: update doc * fix: golint * fix: use go 1.21 (#4273) * fix: debug command and cypress showing failed steps (#4276) * Revert "fix: streaming logs not working (#4212)" This reverts commit 74501d9. * fix: remove deprecated rand seed * feat: Tests - resource requests added (#4286) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * fix: Tests - missing ginkgo job template added (resource requests) (#4288) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * Tests - ginkgo - missing jobTemplate added * feat: envs vars for webhook (#4284) * feat: envs vars for webhook * doc: webhook template * doc: webhook template * test run script - cron triggers for yaml testsuites (#4291) * Add UI Images (#4263) For Test Triggers and Scheduling Tests * feat: artifact bucket (#4277) * feat: artifact bucket model * fix: ignore empty folder * fix: rename folder per execution * fix: replace runner bucket * fix: use custom storage for bucket * fix: rename template field * fix: filename calculation * fix: fmt * fix: check for storage class * fix: listing files for custom bucket * fix: scaping params docs * fix: spelling * fix: typo * fix: dep update * fix: remove waiting on tailing log (#4290) * feat: test description field (#4293) * feat: test description field * fix: dep update * Test timeouts added (#4300) * feat: add pprof server (#4304) * docs: fix default commands format (#4307) * docs: Webhook docs extended (#4310) * Webhook docs extended * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Updated after CR --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use regexp for checks testing (#4314) * fix: Test timeouts increased (#4317) * Test timeouts increased * Test timeouts increased * Test timeouts increased * feat: Cypress test - multi files case (#4321) * Cypress tests - multi files * Cypress tests - multi files - without envs * feat: add orgid and env to agent context (#4320) * feat: template api model * feat: template references * feat: api methods for templates * feat: quote fields * feat: using template reference * feat: using template reference * feat: template cli * fix: get executor template by reference * fix: rename alias * fixL list templates * fix: refactor quoting * fix: refactor field quoting * fix: refactor field merging * fix: merge pvc template * fix: refactor file reading * fix: refacto run command * fix: refactor common module * fix: sync docs * fix: webhook payload template reference * fix: var name typo * fix: add warning for template type * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_update_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: templates doc * fix: dep update * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: list secrets and keys * fix: list all secrets * fix: doc syntax * feat: add jmeter docker image build which will be used by the jmeter executors (#4308) * add jmeter docker image build which will be used by the jmeter executors * update jmeter with latest requirements * update readme for jmeter docker * feat: suuport golang temolate for webhook uri * fix: golang template for headers * fix: golint * chore: remove refs to deprecated io/ioutil Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> * fix: improve abortion check to use nats events (#4345) * fix: improve abortion check to use nats events * fix: remove global bus var * fix: use interfaces instead of bus object * fix: synchronize using channels instead of atomic and move logic from event handler * fix: show cli context * fix: doc typo * docs: Webhooks - docs extended with supported event, testexecution and test… (#4338) * Webhooks - docs extended with supported event, testexecution and testsuiteexecution variables, example for microsoft teams added * docs - templates.mdx links fixed * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Create scorecard.yml * test: add config.Get() * refactor(template): extract parseJobTemplate to test it chore: cleanup * feat: add Sprig to templates for additional templating capabilities Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> * cleanup: config and makefile (#4355) * fix: use multiple junit reports for cypress * fix: error logs * fix: report path * fix: change id and uri * fix: unit test * fix: unit test * fix: remove typo * feat: Initial changes for distributed jmeter (#4289) * feat: Initial changes for distributed jmeter Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added jmeter slaves script and Dockerfile Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Removed duplicate files and imported from existing jmeter executor Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins (#2) * Support for user provided plugins * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file for Jmeterd Signed-off-by: Aman Parauliya <aman@infracloud.io> * Changed base image to kubeshop/jmeter and removed tests (#5) * Changed base image to kubeshop/jmeter and removed tests Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * modify slaves script so it will not exited on error Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user.properties file (#3) * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added the support for user.properties file --------- Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Addressed review comments Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed review comments of Dejan Signed-off-by: Aman Parauliya <aman@infracloud.io> * Refactored slaves pod configuration and added validation for pod name (#8) Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file of Distributor JMeter Signed-off-by: Aman Parauliya <aman@infracloud.io> * Adding a new example in a new folder named giflow under the examples folder Signed-off-by: Aman Parauliya <aman@infracloud.io> * Remove plugins from /lib Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> * docs: Add Dashboard and CLI Tabs (#4297) * Add Dashboard and CLI Tabs To scheduling tests and test triggers pages. * conflicts resolved * Update scheduling-tests.mdx * Update test-triggers.mdx * Update scheduling-tests.mdx * Update test-triggers.mdx * docs - schedule-test-suites.png added --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * testsuites for dev/staging/demo updated (#4369) * ci: jmeterd executor and slave (#4371) * add jmeterd ci * docs: Advanced Test Orchestration, AI Insights, Add advantages to Overview … (#4370) * Advanced Test Orchestration, AI Insights, Add advantages to Overview page * docs - index.mdx - colors build issue fixed --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * fix: change jmeterd docker versions (#4372) * fix: typo in jmeterd slave image (#4373) * feat: concurrency policy model * fix: map for concurrency policy * fix: support allow and forbid options * feat: replace trigger executions * fix: unit test * fix: lint * fix: enable caching * fix: return concurrency policies * fix: dep update * fix: increase retry * update jmeterd docs * docs: fix bright mode logo (#4380) * feat: cd event log output * fix: send logs at the end of tests * fix: event condition * fix: url address * Add labels to the slave pods (#4384) Signed-off-by: Aman Parauliya <aman@infracloud.io> * feat: allow to pass multi namespace flags for testkube cloud init command (#4388) * feat: add ReadOnly flag to test (#4389) * fix: remove duplicated code executor.ExecuteSync (#4393) * fix: update execution status in watcher * fix: change log message * fix: change log parameter * fix: check for exit code * fix: replace timer by ticker * fix: change error message * fix: add events to messages * fix: filter pod events * fix: update error message * feat: test and test suite --update flag * feat: additional update flags * feat: update docs * fix: check if update flag was chaged * feat: update operator reference (#4399) * feat: jmeterd test updates * feat: Slave configuration in Executor CRD and ownerReferences changes in slaves pod (#4385) * Added slaves filed in Executor CRD to add slaves configs Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * OwnerRefs changes for slaves pod Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * removed the local path from go.mod file Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed linters issue Signed-off-by: Aman Parauliya <aman@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <aman@infracloud.io> * feat: refactor jmeterd slaves module (#4408) * feat: refactor jmeterd slaves module * fix flaky slaves unit test * ci: add arm64 (#4374) * add arm64 for jmeterd * feat: add labels to count metrics * fix: metric fields * feat: support dirs for soap, postman, curl * fix: flaky jmeterd test (#4412) * feat: allow skipping execution deletion on test deletion (#4411) * add latest tag to jmeterd slave (#4414) * docs: fix default commands format (#4415) * feat: metric uri * fix: add test and testsuite uri * fix: sort labels * fix: format labels * fix: update openapi schema (#4417) * fix: do not store output in test suite execution result (#4409) * fix: do not store output in test suite execution result * fix: clean execution result in the BatchResults as well * fix: add apis spec note and check for nil * fix: batch output clean (#4423) * Distributed JMeter and Misc Editing (#4404) * docs: add status pages (#4376) * docs: add status pages without images * docs: remove pro reference * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: more detailed description of the pages * docs: add suggestion from review * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add example curl test * docs: add screenshots * docs: apply review suggestion * docs: update images * docs: update example to use UI instead of CLI * docs: review suggestions --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add sp to sidebars (#4426) * feat: slack dashboard uri * fix: slack template * fix: slack template * feat: add dashbaord uris for executions * fix: make error verbose * Update docker-build-develop.yaml * ci: fix goreleaser build (#4429) * Turn off cache for api * Image Updates for 1.14 Part 1 (#4434) * update docs (#4436) * feat: execute post run script before scraping * fix: unit test * fix: update docs * fix: dep update * docs: add cached test result docs (#4441) * docs: add cached test result docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: update installation video with cloud (#4442) * docs: update installation video with cloud * docs: update installation video with cloud * docs: update installation video with cloud * fix: disable cache * fix: replace deprecated method * feat: add readonly flag to test-suites (#4448) * ci: fix cache (#4449) * fix cache * fix: update CRD for Dashboard tests to match mono-repository setup (#4451) * fix: test artifacts failing due to empty file placement (#4444) (#4445) * ci: fix cache (#4449) * fix cache * tests - expected failures extended - oomkilled, timeout (#4452) * tests - curl directory (#4454) * tests - expected failures extended - oomkilled for Cypress (#4453) * feat: evaluate environment variables in the args of gradle (#4457) * fix: error message * fix: get error message * fix: remove condition * [Docs] Getting started - Fix Step 1 link (#4463) * fix: remove secrets endpoint * fix: exit code and mongo transaction * fix: missed init * fix: missed db init * fix: remove transaction * fix: remove transaction options * fix: clean error message * fix: dep update --------- Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Dylan Jones <85761518+djonesz@users.noreply.github.com> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: Abdallah Abedraba <aabedraba@gmail.com> Co-authored-by: Ankit Jain <ankitjaininfo@users.noreply.github.com> Co-authored-by: Édouard Lopez <edouard-lopez@users.noreply.github.com> Co-authored-by: Bruno Lopes <bruno@kubeshop.io> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: guoguangwu <guoguangwu@magic-shield.com> Co-authored-by: Édouard Lopez <edouard.lopez@manomano.com> Co-authored-by: Adrien Fillon <adrien.fillon@manomano.com> Co-authored-by: hiteshwani <110378441+hiteshwani@users.noreply.github.com> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> Co-authored-by: fivenp <mh@fivenp.com> Co-authored-by: PepperKick <abhishrant.m@gmail.com> Co-authored-by: jmorante-ks <142315352+jmorante-ks@users.noreply.github.com>
* fix: wrong struct used to marshal body into (#4127) * fix: map test suite YAML to proper update structure (#4129) * chore: fix local build (#4097) * fix: check config if it is base64 before decoding it (#4088) * fix: add hashtag to shebang in example script (#4137) * feat: add test labels to jobs and pods (#4134) * docs: update example to be appliable on copy-paste (#4142) * Testsuites switched to CRDs and v3, run script updated, k6 test fixed after workingdir changes (#4143) * fix: dep update (#4145) * feat: Tests/TestSuites - namespaces removed, run script updated (#4148) * Test/TestSuite CRDs - namespaces removed, run script updated (namespace support) * run script updated * run script updated * docs: add needed permissions for the S3 IAM role (#4151) * fix: use dedicated function to test minio availability (#4149) * fix: use dedicated function to test minio availability * fix: make as bool the IsConnectionPossible func * docs: add support to executor kubent (#4008) * docs: add support to executor kubent * docs: apply suggestions from code review Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * ci: update kubepug version (#4163) * Improved webhooks.mdx and added section on how to develop and test (#4159) * fix: reconciler scraper (#4174) * fix: reconcile execution with scraper * fix: add executor client * fix: change reconciliation interval * fix: use proper Playwright version in its executor (#4171) * ci: fail job on unsuccessful push to apt (#4179) * feat: use entrypoint sh for container executor (#4162) * feat: use entrypoint sh for container executor * feat: add container shell field * feat: create dynamically entrypoint * fix: script paths * feat: add docker inspection * feat: add secret creds to skopeo * Revert "Auxiliary commit to revert individual files from b2b1282" This reverts commit e0c9f0ff94756e81de76139429a1bef665995ebe. * fix: generate mock * fix: pass registry parameter * fix: add const for script names * feat: add const for entrypoint * feat: add unit tests for skopeo secrets * dashboard-e2e-tests removed from testsuite, will be run seperately (#4186) * fix: start telemetry async (#4189) * fix: output parsing test (#4196) * fix: successful output parsing test * fix: check if executor log is already in json output * fix: ignore queued * fix: change container logs * fixL ignore scraper result * fix: add nil checks * fix: add unit tests * fix: golint * fix: change condition * fix: update execution result on failure * feat: compress artifacts feature (#4198) * feat: pytest executor (#4203) * feat: sample python test * feat: pytest sample test * feat: pytest executor crd * feat: passed and failed test samples * fix: 2 test crds * fix: test branch * feat: docs * feat: junit xml (#4202) * feat: junit xml * feat: xml jtl format support * fix: condition tuning * fix: test fake site * fix: unit tests * Revert "fix: test fake site" This reverts commit 03a3242. * Revert "Revert "fix: test fake site"" This reverts commit 2697568. * Revert "Revert "Revert "fix: test fake site""" This reverts commit 00fe235. * feat: disable analytics.testkube.io calls (#4207) * update install script (#4209) * feat: helm chart version (#4215) * feat: tostring method (#4220) * feat: add tostring to template * feat: vartypeptrtostring template method * feat: add tmp method to job ext * feat: add helper method for template * fix: spelling * fix: doc format * fix: switch to warning on telemetry error (#4222) * fix: switch to warning on telemetry error * fix: change condition * fix: golint * fix: doc * Revert "fix: doc" This reverts commit a6da7d3. * Playwright custom container executor - CI=1 (#4213) * fix: more cypress statuses (#4098) * fix: more cypress statuses * Update contrib/executor/cypress/pkg/runner/cypress.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * fix: install script (#4230) * fix: install script * fix: remove special chas for yaml (#4239) * ci: remove beta flow (#4242) * Update Step 3 of creating Tests (#4244) * Update Step 3 of creating Tests * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: make <img> tags self-closing in docs (#4246) * Docs - CI/CD overview - Testkube run action, additional examples (#4252) * Executor tests - edge cases - expected failures (#4251) * feat: test execution crd (#4206) * feat: test execution crd * fix: add basic test execution map * fix: map test execution model * feat: change execution model * feat: update test execution crd * fix: add param to api spce * feat: test suite execution model * feat: dep update * fix: dep update * fix: mapper for test suite execution * fix: mapper for test suite execution * fix: map var typo * fix: store test suite execution name * fix: add generation field * fix: save generation * fix: dep update * fixL execution crds docs * fix: dep update * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: skip empty step (#4264) * fix: add aws s3 bucket examples (#4265) * fix: pytest docs (#4267) * fix: pytest docs * fix: spelling * fix: syntax * fix: change menu (#4268) * fix: add ci=1 for all jobs (#4269) * feat: add error tracking for cloud init (#4266) * fix: streaming logs not working (#4212) * fix: streaming logs not working * fix: use only one condition wait when waiting for logs * feat: webhook patch (#4272) * feat: webhook patch method * fix: update webhook cli * fix: update doc * fix: golint * fix: use go 1.21 (#4273) * fix: debug command and cypress showing failed steps (#4276) * Revert "fix: streaming logs not working (#4212)" This reverts commit 74501d9. * fix: remove deprecated rand seed * feat: Tests - resource requests added (#4286) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * fix: Tests - missing ginkgo job template added (resource requests) (#4288) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * Tests - ginkgo - missing jobTemplate added * feat: envs vars for webhook (#4284) * feat: envs vars for webhook * doc: webhook template * doc: webhook template * test run script - cron triggers for yaml testsuites (#4291) * Add UI Images (#4263) For Test Triggers and Scheduling Tests * feat: artifact bucket (#4277) * feat: artifact bucket model * fix: ignore empty folder * fix: rename folder per execution * fix: replace runner bucket * fix: use custom storage for bucket * fix: rename template field * fix: filename calculation * fix: fmt * fix: check for storage class * fix: listing files for custom bucket * fix: scaping params docs * fix: spelling * fix: typo * fix: dep update * fix: remove waiting on tailing log (#4290) * feat: test description field (#4293) * feat: test description field * fix: dep update * Test timeouts added (#4300) * feat: add pprof server (#4304) * docs: fix default commands format (#4307) * docs: Webhook docs extended (#4310) * Webhook docs extended * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Updated after CR --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use regexp for checks testing (#4314) * fix: Test timeouts increased (#4317) * Test timeouts increased * Test timeouts increased * Test timeouts increased * feat: Cypress test - multi files case (#4321) * Cypress tests - multi files * Cypress tests - multi files - without envs * feat: add orgid and env to agent context (#4320) * feat: template api model * feat: template references * feat: api methods for templates * feat: quote fields * feat: using template reference * feat: using template reference * feat: template cli * fix: get executor template by reference * fix: rename alias * fixL list templates * fix: refactor quoting * fix: refactor field quoting * fix: refactor field merging * fix: merge pvc template * fix: refactor file reading * fix: refacto run command * fix: refactor common module * fix: sync docs * fix: webhook payload template reference * fix: var name typo * fix: add warning for template type * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_update_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: templates doc * fix: dep update * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: list secrets and keys * fix: list all secrets * fix: doc syntax * feat: add jmeter docker image build which will be used by the jmeter executors (#4308) * add jmeter docker image build which will be used by the jmeter executors * update jmeter with latest requirements * update readme for jmeter docker * feat: suuport golang temolate for webhook uri * fix: golang template for headers * fix: golint * chore: remove refs to deprecated io/ioutil Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> * fix: improve abortion check to use nats events (#4345) * fix: improve abortion check to use nats events * fix: remove global bus var * fix: use interfaces instead of bus object * fix: synchronize using channels instead of atomic and move logic from event handler * fix: show cli context * fix: doc typo * docs: Webhooks - docs extended with supported event, testexecution and test… (#4338) * Webhooks - docs extended with supported event, testexecution and testsuiteexecution variables, example for microsoft teams added * docs - templates.mdx links fixed * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Create scorecard.yml * test: add config.Get() * refactor(template): extract parseJobTemplate to test it chore: cleanup * feat: add Sprig to templates for additional templating capabilities Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> * cleanup: config and makefile (#4355) * fix: use multiple junit reports for cypress * fix: error logs * fix: report path * fix: change id and uri * fix: unit test * fix: unit test * fix: remove typo * feat: Initial changes for distributed jmeter (#4289) * feat: Initial changes for distributed jmeter Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added jmeter slaves script and Dockerfile Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Removed duplicate files and imported from existing jmeter executor Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins (#2) * Support for user provided plugins * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file for Jmeterd Signed-off-by: Aman Parauliya <aman@infracloud.io> * Changed base image to kubeshop/jmeter and removed tests (#5) * Changed base image to kubeshop/jmeter and removed tests Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * modify slaves script so it will not exited on error Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user.properties file (#3) * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added the support for user.properties file --------- Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Addressed review comments Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed review comments of Dejan Signed-off-by: Aman Parauliya <aman@infracloud.io> * Refactored slaves pod configuration and added validation for pod name (#8) Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file of Distributor JMeter Signed-off-by: Aman Parauliya <aman@infracloud.io> * Adding a new example in a new folder named giflow under the examples folder Signed-off-by: Aman Parauliya <aman@infracloud.io> * Remove plugins from /lib Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> * docs: Add Dashboard and CLI Tabs (#4297) * Add Dashboard and CLI Tabs To scheduling tests and test triggers pages. * conflicts resolved * Update scheduling-tests.mdx * Update test-triggers.mdx * Update scheduling-tests.mdx * Update test-triggers.mdx * docs - schedule-test-suites.png added --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * testsuites for dev/staging/demo updated (#4369) * ci: jmeterd executor and slave (#4371) * add jmeterd ci * docs: Advanced Test Orchestration, AI Insights, Add advantages to Overview … (#4370) * Advanced Test Orchestration, AI Insights, Add advantages to Overview page * docs - index.mdx - colors build issue fixed --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * fix: change jmeterd docker versions (#4372) * fix: typo in jmeterd slave image (#4373) * feat: concurrency policy model * fix: map for concurrency policy * fix: support allow and forbid options * feat: replace trigger executions * fix: unit test * fix: lint * fix: enable caching * fix: return concurrency policies * fix: dep update * fix: increase retry * update jmeterd docs * docs: fix bright mode logo (#4380) * feat: cd event log output * fix: send logs at the end of tests * fix: event condition * fix: url address * Add labels to the slave pods (#4384) Signed-off-by: Aman Parauliya <aman@infracloud.io> * feat: allow to pass multi namespace flags for testkube cloud init command (#4388) * feat: add ReadOnly flag to test (#4389) * fix: remove duplicated code executor.ExecuteSync (#4393) * fix: update execution status in watcher * fix: change log message * fix: change log parameter * fix: check for exit code * fix: replace timer by ticker * fix: change error message * fix: add events to messages * fix: filter pod events * fix: update error message * feat: test and test suite --update flag * feat: additional update flags * feat: update docs * fix: check if update flag was chaged * feat: update operator reference (#4399) * feat: jmeterd test updates * feat: Slave configuration in Executor CRD and ownerReferences changes in slaves pod (#4385) * Added slaves filed in Executor CRD to add slaves configs Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * OwnerRefs changes for slaves pod Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * removed the local path from go.mod file Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed linters issue Signed-off-by: Aman Parauliya <aman@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <aman@infracloud.io> * feat: refactor jmeterd slaves module (#4408) * feat: refactor jmeterd slaves module * fix flaky slaves unit test * ci: add arm64 (#4374) * add arm64 for jmeterd * feat: add labels to count metrics * fix: metric fields * feat: support dirs for soap, postman, curl * fix: flaky jmeterd test (#4412) * feat: allow skipping execution deletion on test deletion (#4411) * add latest tag to jmeterd slave (#4414) * docs: fix default commands format (#4415) * feat: metric uri * fix: add test and testsuite uri * fix: sort labels * fix: format labels * fix: update openapi schema (#4417) * fix: do not store output in test suite execution result (#4409) * fix: do not store output in test suite execution result * fix: clean execution result in the BatchResults as well * fix: add apis spec note and check for nil * fix: batch output clean (#4423) * Distributed JMeter and Misc Editing (#4404) * docs: add status pages (#4376) * docs: add status pages without images * docs: remove pro reference * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: more detailed description of the pages * docs: add suggestion from review * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add example curl test * docs: add screenshots * docs: apply review suggestion * docs: update images * docs: update example to use UI instead of CLI * docs: review suggestions --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add sp to sidebars (#4426) * feat: slack dashboard uri * fix: slack template * fix: slack template * feat: add dashbaord uris for executions * fix: make error verbose * Update docker-build-develop.yaml * ci: fix goreleaser build (#4429) * Turn off cache for api * Image Updates for 1.14 Part 1 (#4434) * update docs (#4436) * feat: execute post run script before scraping * fix: unit test * fix: update docs * fix: dep update * docs: add cached test result docs (#4441) * docs: add cached test result docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: update installation video with cloud (#4442) * docs: update installation video with cloud * docs: update installation video with cloud * docs: update installation video with cloud * fix: replace deprecated method * feat: add readonly flag to test-suites (#4448) * ci: fix cache (#4449) * fix cache * fix: update CRD for Dashboard tests to match mono-repository setup (#4451) * fix: test artifacts failing due to empty file placement (#4444) (#4445) * tests - expected failures extended - oomkilled, timeout (#4452) * tests - curl directory (#4454) * tests - expected failures extended - oomkilled for Cypress (#4453) * feat: evaluate environment variables in the args of gradle (#4457) * fix: error message * fix: get error message * fix: remove condition * [Docs] Getting started - Fix Step 1 link (#4463) * fix: remove secrets endpoint * fix: exit code and mongo transaction * fix: missed init * fix: missed db init * fix: remove transaction * fix: remove transaction options * fix: clean error message * docs: update images for sp (#4466) * feat: add output stream functions and mocks (#4431) * feat: add output stream functions and mocks * fix: implement size reading and improve interfaces * fix: literal to const * fix: nil context * docs: guide on how to deploy TK from private registry (#4468) add guide on how to deploy TK from private registry * add category to docs * fix jmeterd slave build * docs: fix navbar not showing on small screens (#4490) * feat: add Testkube Cloud announcement in docs (#4492) * feat: move announcement bar below the navigation bar * feat: add announcement bar for Testkube Cloud * fix: adjust the search button on mobile devices * fix: adjust sign in link to match existing [id^=sign] GTM trigger * ci: fix kubepug installation (#4495) fix kubepug installation * feat: resource regex (#4480) * feat: name regex for trigger selectors * fix: dep update * fix: regex test * doc: add example for regex * fix: select tests and test suites for name reg ex * fix: dep update * fix: enable secrets endpoint (#4469) * fix: enable secrets endpoint * fix: env mame typo * fix: visibility label for secrets * fix: dep update * fix: dep update * fix: expand env for args (#4481) * feat: run scripts in working dir (#4489) * feat: run scripts in working dir * fix: add default working dir * feat: working dir env var * use: working dir param * fix: fmt option * fix: don't check stdin piping * fix: use env param * fix: use working dir env var * fix: use env working dir * feat: Maven jdk 8 test, example (based on the one for 11) (#4501) * Maven example for jdk8 * Maven example for jdk8, tests * fix: Maven 8 test - branch fixed (#4502) * Maven example for jdk8 * Maven example for jdk8, tests * maven test - branch * Testkube OSS page and additional screenshot updates (#4493) * fix: wrong link (#4504) * feat: minor jmeterd updates (#4503) * minor updated to jmeterd * remove more redundant logic in jmeterd * fix: merge confflict * fix: merge * fix: remove var * fix: dep update --------- Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: Abdallah Abedraba <aabedraba@gmail.com> Co-authored-by: Ankit Jain <ankitjaininfo@users.noreply.github.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Édouard Lopez <edouard-lopez@users.noreply.github.com> Co-authored-by: Bruno Lopes <bruno@kubeshop.io> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: guoguangwu <guoguangwu@magic-shield.com> Co-authored-by: Édouard Lopez <edouard.lopez@manomano.com> Co-authored-by: Adrien Fillon <adrien.fillon@manomano.com> Co-authored-by: hiteshwani <110378441+hiteshwani@users.noreply.github.com> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> Co-authored-by: fivenp <mh@fivenp.com> Co-authored-by: PepperKick <abhishrant.m@gmail.com> Co-authored-by: jmorante-ks <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io>
* fix: add hashtag to shebang in example script (#4137) * feat: add test labels to jobs and pods (#4134) * docs: update example to be appliable on copy-paste (#4142) * Testsuites switched to CRDs and v3, run script updated, k6 test fixed after workingdir changes (#4143) * fix: dep update (#4145) * feat: Tests/TestSuites - namespaces removed, run script updated (#4148) * Test/TestSuite CRDs - namespaces removed, run script updated (namespace support) * run script updated * run script updated * docs: add needed permissions for the S3 IAM role (#4151) * fix: use dedicated function to test minio availability (#4149) * fix: use dedicated function to test minio availability * fix: make as bool the IsConnectionPossible func * docs: add support to executor kubent (#4008) * docs: add support to executor kubent * docs: apply suggestions from code review Co-authored-by: Dawid Rusnak <dawid@drcode.pl> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> * ci: update kubepug version (#4163) * Improved webhooks.mdx and added section on how to develop and test (#4159) * fix: reconciler scraper (#4174) * fix: reconcile execution with scraper * fix: add executor client * fix: change reconciliation interval * fix: use proper Playwright version in its executor (#4171) * ci: fail job on unsuccessful push to apt (#4179) * feat: use entrypoint sh for container executor (#4162) * feat: use entrypoint sh for container executor * feat: add container shell field * feat: create dynamically entrypoint * fix: script paths * feat: add docker inspection * feat: add secret creds to skopeo * Revert "Auxiliary commit to revert individual files from b2b1282" This reverts commit e0c9f0ff94756e81de76139429a1bef665995ebe. * fix: generate mock * fix: pass registry parameter * fix: add const for script names * feat: add const for entrypoint * feat: add unit tests for skopeo secrets * dashboard-e2e-tests removed from testsuite, will be run seperately (#4186) * fix: start telemetry async (#4189) * fix: output parsing test (#4196) * fix: successful output parsing test * fix: check if executor log is already in json output * fix: ignore queued * fix: change container logs * fixL ignore scraper result * fix: add nil checks * fix: add unit tests * fix: golint * fix: change condition * fix: update execution result on failure * feat: compress artifacts feature (#4198) * feat: pytest executor (#4203) * feat: sample python test * feat: pytest sample test * feat: pytest executor crd * feat: passed and failed test samples * fix: 2 test crds * fix: test branch * feat: docs * feat: junit xml (#4202) * feat: junit xml * feat: xml jtl format support * fix: condition tuning * fix: test fake site * fix: unit tests * Revert "fix: test fake site" This reverts commit 03a3242. * Revert "Revert "fix: test fake site"" This reverts commit 2697568. * Revert "Revert "Revert "fix: test fake site""" This reverts commit 00fe235. * feat: disable analytics.testkube.io calls (#4207) * update install script (#4209) * feat: helm chart version (#4215) * feat: tostring method (#4220) * feat: add tostring to template * feat: vartypeptrtostring template method * feat: add tmp method to job ext * feat: add helper method for template * fix: spelling * fix: doc format * fix: switch to warning on telemetry error (#4222) * fix: switch to warning on telemetry error * fix: change condition * fix: golint * fix: doc * Revert "fix: doc" This reverts commit a6da7d3. * Playwright custom container executor - CI=1 (#4213) * fix: more cypress statuses (#4098) * fix: more cypress statuses * Update contrib/executor/cypress/pkg/runner/cypress.go Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> --------- Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> * fix: install script (#4230) * fix: install script * fix: remove special chas for yaml (#4239) * ci: remove beta flow (#4242) * Update Step 3 of creating Tests (#4244) * Update Step 3 of creating Tests * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/step3-creating-first-test.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: make <img> tags self-closing in docs (#4246) * Docs - CI/CD overview - Testkube run action, additional examples (#4252) * Executor tests - edge cases - expected failures (#4251) * feat: test execution crd (#4206) * feat: test execution crd * fix: add basic test execution map * fix: map test execution model * feat: change execution model * feat: update test execution crd * fix: add param to api spce * feat: test suite execution model * feat: dep update * fix: dep update * fix: mapper for test suite execution * fix: mapper for test suite execution * fix: map var typo * fix: store test suite execution name * fix: add generation field * fix: save generation * fix: dep update * fixL execution crds docs * fix: dep update * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/test-executions.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: skip empty step (#4264) * fix: add aws s3 bucket examples (#4265) * fix: pytest docs (#4267) * fix: pytest docs * fix: spelling * fix: syntax * fix: change menu (#4268) * fix: add ci=1 for all jobs (#4269) * feat: add error tracking for cloud init (#4266) * fix: streaming logs not working (#4212) * fix: streaming logs not working * fix: use only one condition wait when waiting for logs * feat: webhook patch (#4272) * feat: webhook patch method * fix: update webhook cli * fix: update doc * fix: golint * fix: use go 1.21 (#4273) * fix: debug command and cypress showing failed steps (#4276) * Revert "fix: streaming logs not working (#4212)" This reverts commit 74501d9. * fix: remove deprecated rand seed * feat: Tests - resource requests added (#4286) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * fix: Tests - missing ginkgo job template added (resource requests) (#4288) * Tests - resource requests added * Tests - cypress, playwright, gradle, maven, postman - resource requests added * Tests - ginkgo - missing jobTemplate added * feat: envs vars for webhook (#4284) * feat: envs vars for webhook * doc: webhook template * doc: webhook template * test run script - cron triggers for yaml testsuites (#4291) * Add UI Images (#4263) For Test Triggers and Scheduling Tests * feat: artifact bucket (#4277) * feat: artifact bucket model * fix: ignore empty folder * fix: rename folder per execution * fix: replace runner bucket * fix: use custom storage for bucket * fix: rename template field * fix: filename calculation * fix: fmt * fix: check for storage class * fix: listing files for custom bucket * fix: scaping params docs * fix: spelling * fix: typo * fix: dep update * fix: remove waiting on tailing log (#4290) * feat: test description field (#4293) * feat: test description field * fix: dep update * Test timeouts added (#4300) * feat: add pprof server (#4304) * docs: fix default commands format (#4307) * docs: Webhook docs extended (#4310) * Webhook docs extended * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Updated after CR --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: use regexp for checks testing (#4314) * fix: Test timeouts increased (#4317) * Test timeouts increased * Test timeouts increased * Test timeouts increased * feat: Cypress test - multi files case (#4321) * Cypress tests - multi files * Cypress tests - multi files - without envs * feat: add orgid and env to agent context (#4320) * feat: template api model * feat: template references * feat: api methods for templates * feat: quote fields * feat: using template reference * feat: using template reference * feat: template cli * fix: get executor template by reference * fix: rename alias * fixL list templates * fix: refactor quoting * fix: refactor field quoting * fix: refactor field merging * fix: merge pvc template * fix: refactor file reading * fix: refacto run command * fix: refactor common module * fix: sync docs * fix: webhook payload template reference * fix: var name typo * fix: add warning for template type * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_create_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_delete_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_get_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/cli/testkube_update_template.md Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * fix: templates doc * fix: dep update * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/templates.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * feat: list secrets and keys * fix: list all secrets * fix: doc syntax * feat: add jmeter docker image build which will be used by the jmeter executors (#4308) * add jmeter docker image build which will be used by the jmeter executors * update jmeter with latest requirements * update readme for jmeter docker * feat: suuport golang temolate for webhook uri * fix: golang template for headers * fix: golint * chore: remove refs to deprecated io/ioutil Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> * fix: improve abortion check to use nats events (#4345) * fix: improve abortion check to use nats events * fix: remove global bus var * fix: use interfaces instead of bus object * fix: synchronize using channels instead of atomic and move logic from event handler * fix: show cli context * fix: doc typo * docs: Webhooks - docs extended with supported event, testexecution and test… (#4338) * Webhooks - docs extended with supported event, testexecution and testsuiteexecution variables, example for microsoft teams added * docs - templates.mdx links fixed * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Update docs/docs/articles/webhooks.mdx Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * Create scorecard.yml * test: add config.Get() * refactor(template): extract parseJobTemplate to test it chore: cleanup * feat: add Sprig to templates for additional templating capabilities Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> * cleanup: config and makefile (#4355) * fix: use multiple junit reports for cypress * fix: error logs * fix: report path * fix: change id and uri * fix: unit test * fix: unit test * fix: remove typo * feat: Initial changes for distributed jmeter (#4289) * feat: Initial changes for distributed jmeter Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added jmeter slaves script and Dockerfile Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Removed duplicate files and imported from existing jmeter executor Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins (#2) * Support for user provided plugins * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file for Jmeterd Signed-off-by: Aman Parauliya <aman@infracloud.io> * Changed base image to kubeshop/jmeter and removed tests (#5) * Changed base image to kubeshop/jmeter and removed tests Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * modify slaves script so it will not exited on error Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Support for user.properties file (#3) * Support for user provided plugins Signed-off-by: Aman Parauliya <aman@infracloud.io> * Add secret refs for git username and token for slave pods Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Modified logic for adding JMETER_USER_PLUGINS_FOLDER env var Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Added the support for user.properties file --------- Signed-off-by: Aman Parauliya <aman@infracloud.io> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Co-authored-by: hiteshwani <hitesh.wani@infracloud.io> * Addressed review comments Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed review comments of Dejan Signed-off-by: Aman Parauliya <aman@infracloud.io> * Refactored slaves pod configuration and added validation for pod name (#8) Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * Update README file of Distributor JMeter Signed-off-by: Aman Parauliya <aman@infracloud.io> * Adding a new example in a new folder named giflow under the examples folder Signed-off-by: Aman Parauliya <aman@infracloud.io> * Remove plugins from /lib Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> * docs: Add Dashboard and CLI Tabs (#4297) * Add Dashboard and CLI Tabs To scheduling tests and test triggers pages. * conflicts resolved * Update scheduling-tests.mdx * Update test-triggers.mdx * Update scheduling-tests.mdx * Update test-triggers.mdx * docs - schedule-test-suites.png added --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * testsuites for dev/staging/demo updated (#4369) * ci: jmeterd executor and slave (#4371) * add jmeterd ci * docs: Advanced Test Orchestration, AI Insights, Add advantages to Overview … (#4370) * Advanced Test Orchestration, AI Insights, Add advantages to Overview page * docs - index.mdx - colors build issue fixed --------- Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> * fix: change jmeterd docker versions (#4372) * fix: typo in jmeterd slave image (#4373) * feat: concurrency policy model * fix: map for concurrency policy * fix: support allow and forbid options * feat: replace trigger executions * fix: unit test * fix: lint * fix: enable caching * fix: return concurrency policies * fix: dep update * fix: increase retry * update jmeterd docs * docs: fix bright mode logo (#4380) * feat: cd event log output * fix: send logs at the end of tests * fix: event condition * fix: url address * Add labels to the slave pods (#4384) Signed-off-by: Aman Parauliya <aman@infracloud.io> * feat: allow to pass multi namespace flags for testkube cloud init command (#4388) * feat: add ReadOnly flag to test (#4389) * fix: remove duplicated code executor.ExecuteSync (#4393) * fix: update execution status in watcher * fix: change log message * fix: change log parameter * fix: check for exit code * fix: replace timer by ticker * fix: change error message * fix: add events to messages * fix: filter pod events * fix: update error message * feat: test and test suite --update flag * feat: additional update flags * feat: update docs * fix: check if update flag was chaged * feat: update operator reference (#4399) * feat: jmeterd test updates * feat: Slave configuration in Executor CRD and ownerReferences changes in slaves pod (#4385) * Added slaves filed in Executor CRD to add slaves configs Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * OwnerRefs changes for slaves pod Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> * removed the local path from go.mod file Signed-off-by: Aman Parauliya <aman@infracloud.io> * Fixed linters issue Signed-off-by: Aman Parauliya <aman@infracloud.io> --------- Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Aman Parauliya <aman@infracloud.io> * feat: refactor jmeterd slaves module (#4408) * feat: refactor jmeterd slaves module * fix flaky slaves unit test * ci: add arm64 (#4374) * add arm64 for jmeterd * feat: add labels to count metrics * fix: metric fields * feat: support dirs for soap, postman, curl * fix: flaky jmeterd test (#4412) * feat: allow skipping execution deletion on test deletion (#4411) * add latest tag to jmeterd slave (#4414) * docs: fix default commands format (#4415) * feat: metric uri * fix: add test and testsuite uri * fix: sort labels * fix: format labels * fix: update openapi schema (#4417) * fix: do not store output in test suite execution result (#4409) * fix: do not store output in test suite execution result * fix: clean execution result in the BatchResults as well * fix: add apis spec note and check for nil * fix: batch output clean (#4423) * Distributed JMeter and Misc Editing (#4404) * docs: add status pages (#4376) * docs: add status pages without images * docs: remove pro reference * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: more detailed description of the pages * docs: add suggestion from review * docs: apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add example curl test * docs: add screenshots * docs: apply review suggestion * docs: update images * docs: update example to use UI instead of CLI * docs: review suggestions --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: add sp to sidebars (#4426) * feat: slack dashboard uri * fix: slack template * fix: slack template * feat: add dashbaord uris for executions * fix: make error verbose * Update docker-build-develop.yaml * ci: fix goreleaser build (#4429) * Turn off cache for api * Image Updates for 1.14 Part 1 (#4434) * update docs (#4436) * feat: execute post run script before scraping * fix: unit test * fix: update docs * fix: dep update * docs: add cached test result docs (#4441) * docs: add cached test result docs * Apply suggestions from code review Co-authored-by: Julianne Fermi <julianne@kubeshop.io> --------- Co-authored-by: Julianne Fermi <julianne@kubeshop.io> * docs: update installation video with cloud (#4442) * docs: update installation video with cloud * docs: update installation video with cloud * docs: update installation video with cloud * fix: replace deprecated method * feat: add readonly flag to test-suites (#4448) * ci: fix cache (#4449) * fix cache * fix: update CRD for Dashboard tests to match mono-repository setup (#4451) * fix: test artifacts failing due to empty file placement (#4444) (#4445) * tests - expected failures extended - oomkilled, timeout (#4452) * tests - curl directory (#4454) * tests - expected failures extended - oomkilled for Cypress (#4453) * feat: evaluate environment variables in the args of gradle (#4457) * fix: error message * fix: get error message * fix: remove condition * [Docs] Getting started - Fix Step 1 link (#4463) * fix: remove secrets endpoint * fix: exit code and mongo transaction * fix: missed init * fix: missed db init * fix: remove transaction * fix: remove transaction options * fix: clean error message * docs: update images for sp (#4466) * feat: add output stream functions and mocks (#4431) * feat: add output stream functions and mocks * fix: implement size reading and improve interfaces * fix: literal to const * fix: nil context * docs: guide on how to deploy TK from private registry (#4468) add guide on how to deploy TK from private registry * add category to docs * fix jmeterd slave build * docs: fix navbar not showing on small screens (#4490) * feat: add Testkube Cloud announcement in docs (#4492) * feat: move announcement bar below the navigation bar * feat: add announcement bar for Testkube Cloud * fix: adjust the search button on mobile devices * fix: adjust sign in link to match existing [id^=sign] GTM trigger * ci: fix kubepug installation (#4495) fix kubepug installation * feat: resource regex (#4480) * feat: name regex for trigger selectors * fix: dep update * fix: regex test * doc: add example for regex * fix: select tests and test suites for name reg ex * fix: dep update * fix: enable secrets endpoint (#4469) * fix: enable secrets endpoint * fix: env mame typo * fix: visibility label for secrets * fix: dep update * fix: dep update * fix: expand env for args (#4481) * feat: run scripts in working dir (#4489) * feat: run scripts in working dir * fix: add default working dir * feat: working dir env var * use: working dir param * fix: fmt option * fix: don't check stdin piping * fix: use env param * fix: use working dir env var * fix: use env working dir * feat: Maven jdk 8 test, example (based on the one for 11) (#4501) * Maven example for jdk8 * Maven example for jdk8, tests * fix: Maven 8 test - branch fixed (#4502) * Maven example for jdk8 * Maven example for jdk8, tests * maven test - branch * Testkube OSS page and additional screenshot updates (#4493) * fix: wrong link (#4504) * feat: minor jmeterd updates (#4503) * minor updated to jmeterd * remove more redundant logic in jmeterd * fix: remove var * feat: improve performance for slowest operations / fix: loading total executions number for test suite (#4507) * fix: count total executions for single test suite, not all * feat: optimize getting latest tests/test suites queries * docs: argocd integration (#4510) update argocd docs * fix: add npm report permissions (#4511) * fix: add npm report permissions * fix: add comment * fix: merge issue * fix: merge typo * fix: merge issues * fix: merge issues * fix: dep update --------- Signed-off-by: guoguangwu <guoguangwu@magic-shield.com> Signed-off-by: Adrien Fillon <adrien.fillon@manomano.com> Signed-off-by: hiteshwani <hitesh.wani@infracloud.io> Signed-off-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Lilla Vass <vLia@users.noreply.github.com> Co-authored-by: Tomasz Konieczny <tomasz.konieczny@kubeshop.io> Co-authored-by: nicufk <89570185+nicufk@users.noreply.github.com> Co-authored-by: Abdallah Abedraba <aabedraba@gmail.com> Co-authored-by: Dawid Rusnak <dawid@drcode.pl> Co-authored-by: Ankit Jain <ankitjaininfo@users.noreply.github.com> Co-authored-by: Jacek Wysocki <jacek.wysocki@gmail.com> Co-authored-by: ypoplavs <45286051+ypoplavs@users.noreply.github.com> Co-authored-by: Édouard Lopez <edouard-lopez@users.noreply.github.com> Co-authored-by: Bruno Lopes <bruno@kubeshop.io> Co-authored-by: Julianne Fermi <julianne@kubeshop.io> Co-authored-by: Povilas Versockas <p.versockas@gmail.com> Co-authored-by: Ale <93217218+alelthomas@users.noreply.github.com> Co-authored-by: Dejan Zele Pejchev <pejcev.dejan@gmail.com> Co-authored-by: guoguangwu <guoguangwu@magic-shield.com> Co-authored-by: Édouard Lopez <edouard.lopez@manomano.com> Co-authored-by: Adrien Fillon <adrien.fillon@manomano.com> Co-authored-by: hiteshwani <110378441+hiteshwani@users.noreply.github.com> Co-authored-by: Aman Parauliya <30143812+parauliya@users.noreply.github.com> Co-authored-by: Aman Parauliya <aman@infracloud.io> Co-authored-by: Tomasz Konieczny <tkonieczny91@gmail.com> Co-authored-by: fivenp <mh@fivenp.com> Co-authored-by: PepperKick <abhishrant.m@gmail.com> Co-authored-by: jmorante-ks <142315352+jmorante-ks@users.noreply.github.com> Co-authored-by: ypoplavs <yulia.poplavska@kubeshop.io>
No description provided.