Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/xmlreport test id #688

Merged
merged 10 commits into from
Jul 28, 2023
Merged

Conversation

ivan-velasco
Copy link
Contributor

  • For reporting back to a test case matrix, each test case should contain a test case id
    Plan to use the generated .xml and parse the id's to update test case management solution after each CI run
name: TestSuite 

testcases:
  - name: without_id
    steps:
    - type: user_executor
      vars:
        foo:
          from: result.foo

  - name: with_test_id
    id: C1999
    steps:
    - type: user_executor
      foo: "{{.without_id.foo}}"

Report output:

<?xml version="1.0" encoding="utf-8"?>
<testsuites>
  <testsuite name="TestSuite" package="test.yml" tests="2" time="20">
    <testcase classname="test.yml" name="without_id" time="0.1">
      <system-out><![CDATA[
]]></system-out>
      <system-err><![CDATA[
]]></system-err>
    </testcase>
    <testcase classname="test.yml" name="with_test_id" time="22" id="C1999">
      <system-out><![CDATA[

]]></system-out>
      <system-err><![CDATA[

]]></system-err>
    </testcase>
  </testsuite>
</testsuites>

kilianpaquier and others added 7 commits June 21, 2023 17:17
…ng and info from non verbose runs (ovh#670)

* feat: remove tc computedInfo, fix info not showing right variable value in teststep and show info before errors
* feat: removed ranged stdout on non-verbose runs
* fix: update failing tests following breaking change
* chore: review README according to latest change

Signed-off-by: kpaquier <kilian.paquier.ext@ovhcloud.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
Signed-off-by: Fokion Sotiropoulos <fokion.s@gmail.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
* venom: improve verbose flag behavior

Signed-off-by: Yvonnick Esnault <yvonnick.esnault@corp.ovh.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
Signed-off-by: Quentin MOUTY <quentin.mouty@corp.ovh.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
Signed-off-by: Yvonnick Esnault <yvonnick.esnault@corp.ovh.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
Signed-off-by: Nicolas Lacroux <nicolas.lacroux@ovhcloud.com>
Co-authored-by: Nicolas Lacroux <nicolas.lacroux@ovhcloud.com>
Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
… reporting purposes

Signed-off-by: Ivan Velasco <ivan.velasco@socotra.com>
@ovh-cds
Copy link
Collaborator

ovh-cds commented Jul 25, 2023

CDS Report build-venom-a#74.0 ✘

  • Build
    • Build ✔
    • Unit Tests ✔
  • Tests
    • Acceptance Tests ✘

@ovh-cds
Copy link
Collaborator

ovh-cds commented Jul 26, 2023

CDS Report build-venom-a#74.1 ✘

  • Build
    • Build ✔
    • Unit Tests ✔
  • Tests
    • Acceptance Tests ✘

types.go Outdated Show resolved Hide resolved
types.go Outdated Show resolved Hide resolved
venom_output.go Outdated Show resolved Hide resolved
@yesnault yesnault merged commit 7f81891 into ovh:master Jul 28, 2023
@ivan-velasco ivan-velasco deleted the feature/xmlreport-test-id branch August 1, 2023 19:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants