Skip to content

Commit

Permalink
added reporting steps
Browse files Browse the repository at this point in the history
added reporting steps

added beam_PostCommit_Java_ValidatesRunner jobs to GitHub Actions
  • Loading branch information
andreydevyatkin committed Sep 14, 2023
1 parent 5773bb9 commit de148b3
Show file tree
Hide file tree
Showing 16 changed files with 175 additions and 100 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -191,12 +191,12 @@ Please note that jobs with matrix need to have matrix element in the comment. Ex
| [ PostCommit Java Jpms Flink Java11 ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Flink_Java11.yml) | N/A |`Run Jpms Flink Java 11 PostCommit`| [![.github/workflows/beam_PostCommit_Java_Jpms_Flink_Java11](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Flink_Java11.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Flink_Java11.yml) |
| [ PostCommit Java Jpms Spark Java11 ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Spark_Java11.yml) | N/A |`Run Jpms Spark Java 11 PostCommit`| [![.github/workflows/beam_PostCommit_Java_Jpms_Spark_Java11](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Spark_Java11.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Jpms_Spark_Java11.yml) |
| [ PostCommit Java Sickbay ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Sickbay.yml) | N/A |`Run Java Sickbay`| [![PostCommit Java Sickbay](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Sickbay.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Sickbay.yml) |
| [ PostCommit Java ValidatesRunner Dataflow Java ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml) | ['11','17'] |`Run Dataflow ValidatesRunner Java (matrix_element)`| [![PostCommit Java ValidatesRunner Dataflow Java](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml) |
| [ PostCommit Java ValidatesRunner Dataflow JavaVersions ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml) | ['11','17'] |`Run Dataflow ValidatesRunner Java (matrix_element)`| [![PostCommit Java ValidatesRunner Dataflow JavaVersions](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java.yml) |
| [ PostCommit Java ValidatesRunner Dataflow Streaming ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming.yml) | N/A |`Run Dataflow Streaming ValidatesRunner`| [![PostCommit Java ValidatesRunner Dataflow Streaming](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming.yml) |
| [ PostCommit Java ValidatesRunner Dataflow V2 Streaming ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2_Streaming.yml) | N/A |`Run Java Dataflow V2 ValidatesRunner Streaming`| [![PostCommit Java ValidatesRunner Dataflow V2 Streaming](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2_Streaming.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2_Streaming.yml) |
| [ PostCommit Java ValidatesRunner Dataflow V2 ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2.yml) | N/A |`Run Java Dataflow V2 ValidatesRunner`| [![PostCommit Java ValidatesRunner Dataflow V2](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2.yml) |
| [ PostCommit Java ValidatesRunner Dataflow ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow.yml) | N/A |`Run Dataflow ValidatesRunner`| [![PostCommit Java ValidatesRunner Dataflow](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow.yml) |
| [ PostCommit Java ValidatesRunner Direct Java ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml) | ['11','17'] |`Run Direct ValidatesRunner Java (matrix_element)`| [![PostCommit Java ValidatesRunner Direct Java](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml) |
| [ PostCommit Java ValidatesRunner Direct JavaVersions ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml) | ['11','17'] |`Run Direct ValidatesRunner Java (matrix_element)`| [![PostCommit Java ValidatesRunner Direct JavaVersions](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct_Java.yml) |
| [ PostCommit Java ValidatesRunner Direct ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct.yml) | N/A |`Run Direct ValidatesRunner`| [![PostCommit Java ValidatesRunner Direct](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Direct.yml) |
| [ PostCommit Java ValidatesRunner Flink Java11 ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink_Java11.yml) | N/A |`Run Flink ValidatesRunner Java 11`| [![PostCommit Java ValidatesRunner Flink Java11](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink_Java11.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink_Java11.yml) |
| [ PostCommit Java ValidatesRunner Flink ](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink.yml) | N/A |`Run Flink ValidatesRunner`| [![PostCommit Java ValidatesRunner Flink](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink.yml/badge.svg?event=schedule)](https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Flink.yml) |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -81,9 +81,14 @@ jobs:
with:
gradle-command: :runners:google-cloud-dataflow-java:validatesRunner
max-workers: 12
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
# specific language governing permissions and limitations
# under the License.

name: PostCommit Java ValidatesRunner Dataflow Java
name: PostCommit Java ValidatesRunner Dataflow JavaVersions

on:
issue_comment:
Expand All @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand All @@ -51,14 +51,14 @@ env:
GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}

jobs:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Java:
beam_PostCommit_Java_ValidatesRunner_Dataflow_JavaVersions:
name: ${{matrix.job_name}} (${{matrix.job_phrase}} ${{matrix.java_version}})
runs-on: [self-hosted, ubuntu-20.04, main]
timeout-minutes: 480
strategy:
fail-fast: false
matrix:
job_name: [beam_PostCommit_Java_ValidatesRunner_Dataflow_Java]
job_name: [beam_PostCommit_Java_ValidatesRunner_Dataflow_JavaVersions]
job_phrase: [Run Dataflow ValidatesRunner Java]
java_version: ['11','17']
if: |
Expand Down Expand Up @@ -101,9 +101,14 @@ jobs:
-x testClasses \
-Dorg.gradle.java.home=$JAVA_HOME_${{ matrix.java_version }}_X64 \
max-workers: 12
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Original file line number Diff line number Diff line change
Expand Up @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -81,9 +81,14 @@ jobs:
with:
gradle-command: :runners:google-cloud-dataflow-java:validatesRunnerStreaming
max-workers: 12
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ on:
issue_comment:
types: [created]
schedule:
- cron: '0 */6 * * *'
- cron: '0 */8 * * *'
workflow_dispatch:

# This allows a subsequently queued workflow run to interrupt previous runs
Expand All @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -81,9 +81,14 @@ jobs:
with:
gradle-command: :runners:google-cloud-dataflow-java:validatesRunnerV2
max-workers: 12
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ on:
issue_comment:
types: [created]
schedule:
- cron: '0 */6 * * *'
- cron: '0 */8 * * *'
workflow_dispatch:

# This allows a subsequently queued workflow run to interrupt previous runs
Expand All @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -81,9 +81,14 @@ jobs:
with:
gradle-command: :runners:google-cloud-dataflow-java:validatesRunnerV2Streaming
max-workers: 12
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
17 changes: 11 additions & 6 deletions .github/workflows/beam_PostCommit_Java_ValidatesRunner_Direct.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -80,9 +80,14 @@ jobs:
uses: ./.github/actions/gradle-command-self-hosted-action
with:
gradle-command: :runners:direct-java:validatesRunner
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
# specific language governing permissions and limitations
# under the License.

name: PostCommit Java ValidatesRunner Direct Java
name: PostCommit Java ValidatesRunner Direct JavaVersions

on:
issue_comment:
Expand All @@ -32,12 +32,12 @@ concurrency:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand All @@ -51,14 +51,14 @@ env:
GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}

jobs:
beam_PostCommit_Java_ValidatesRunner_Direct_Java:
beam_PostCommit_Java_ValidatesRunner_Direct_JavaVersions:
name: ${{matrix.job_name}} (${{matrix.job_phrase}} ${{matrix.java_version}})
runs-on: [self-hosted, ubuntu-20.04, main]
timeout-minutes: 480
strategy:
fail-fast: false
matrix:
job_name: [beam_PostCommit_Java_ValidatesRunner_Direct_Java]
job_name: [beam_PostCommit_Java_ValidatesRunner_Direct_JavaVersions]
job_phrase: [Run Direct ValidatesRunner Java]
java_version: ['11','17']
if: |
Expand Down Expand Up @@ -96,9 +96,14 @@ jobs:
-x compileJava \
-x compileTestJava \
-Dorg.gradle.java.home=$JAVA_HOME_${{ matrix.java_version }}_X64 \
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
17 changes: 11 additions & 6 deletions .github/workflows/beam_PostCommit_Java_ValidatesRunner_Flink.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,12 +25,12 @@ on:
#Setting explicit permissions for the action to avoid the default permissions which are `write-all` in case of pull_request_target event
permissions:
actions: write
pull-requests: read
checks: read
pull-requests: write
checks: write
contents: read
deployments: read
id-token: none
issues: read
issues: write
discussions: read
packages: read
pages: read
Expand Down Expand Up @@ -86,9 +86,14 @@ jobs:
uses: ./.github/actions/gradle-command-self-hosted-action
with:
gradle-command: :runners:flink:1.15:validatesRunner
- name: Upload test report
- name: Archive JUnit Test Results
uses: actions/upload-artifact@v3
if: failure()
with:
name: JUnit Test Results
path: "**/build/reports/tests/"
- name: Publish JUnit Test Results
uses: EnricoMi/publish-unit-test-result-action@v2
if: always()
with:
name: java-code-coverage-report
path: "**/build/test-results/**/*.xml"
files: '**/build/test-results/**/*.xml'
Loading

0 comments on commit de148b3

Please sign in to comment.