Skip to content

Commit

Permalink
chore: skip tests in webkit due to form-action flakiness
Browse files Browse the repository at this point in the history
  • Loading branch information
@AtofStryker @pgoforth
AtofStryker authored and pgoforth committed Jun 5, 2023
1 parent 361a9eb commit bfd150d
Show file tree
Hide file tree
Showing 2 changed files with 59 additions and 55 deletions.
108 changes: 54 additions & 54 deletions system-tests/__snapshots__/experimental_csp_allow_list_spec.ts.js
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / strips out [\'script-src-elem\', \'script-src\', \'default-src\'] directives'] = `
exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / always strips known problematic directives and is passive with known working directives'] = `
====================================================================================================
Expand All @@ -7,24 +7,23 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / str
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Cypress: 1.2.3 │
│ Browser: FooBrowser 88 │
│ Specs: 1 found (with_allow_list_true.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_true.cy.ts │
│ Specs: 1 found (with_allow_list_custom_or_true.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_custom_or_true.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
────────────────────────────────────────────────────────────────────────────────────────────────────
Running: with_allow_list_true.cy.ts (1 of 1)
Running: with_allow_list_custom_or_true.cy.ts (1 of 1)
experimentalCspAllowList=true
✓ passes on inline form action
content-security-policy directive script-src-elem should be stripped and
✓ regardless of nonces/hashes
content-security-policy directive script-src should be stripped and
✓ regardless of nonces/hashes
content-security-policy directive default-src should be stripped and
✓ regardless of nonces/hashes
experimentalCspAllowList is custom or true
disallowed
✓ frame-ancestors are always stripped
✓ trusted-types & require-trusted-types-for are always stripped
allowed
✓ sample: style-src is not stripped
✓ sample: upgrade-insecure-requests is not stripped
4 passing
Expand All @@ -41,7 +40,7 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / str
│ Screenshots: 0 │
│ Video: true │
│ Duration: X seconds │
│ Spec Ran: with_allow_list_true.cy.ts │
│ Spec Ran: with_allow_list_custom_or_true.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
Expand All @@ -52,14 +51,15 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / str
Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✔ with_allow_list_true.cy.ts XX:XX 4 4 - - - │
│ ✔ with_allow_list_custom_or_true.cy.t XX:XX 4 4 - - - │
│ s │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✔ All specs passed! XX:XX 4 4 - - -
`

exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / always strips known problematic directives and is passive with known working directives'] = `
exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] / always strips known problematic directives and is passive with known working directives'] = `
====================================================================================================
Expand Down Expand Up @@ -120,7 +120,7 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / alw
`

exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] / works with [\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] directives'] = `
exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=true / strips out [\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] directives'] = `
====================================================================================================
Expand All @@ -129,44 +129,41 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Cypress: 1.2.3 │
│ Browser: FooBrowser 88 │
│ Specs: 1 found (with_allow_list_custom.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_custom.cy.ts │
│ Specs: 1 found (with_allow_list_true.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_true.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
────────────────────────────────────────────────────────────────────────────────────────────────────
Running: with_allow_list_custom.cy.ts (1 of 1)
Running: with_allow_list_true.cy.ts (1 of 1)
experimentalCspAllowList=['script-src-elem', 'script-src', 'default-src']
✓ fails on inline form action
content-security-policy directive script-src-elem should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
content-security-policy directive script-src should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
content-security-policy directive default-src should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
experimentalCspAllowList=true
✓ passes on inline form action
content-security-policy directive script-src-elem should be stripped and
✓ regardless of nonces/hashes
content-security-policy directive script-src should be stripped and
✓ regardless of nonces/hashes
content-security-policy directive default-src should be stripped and
✓ regardless of nonces/hashes
7 passing
4 passing
(Results)
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 7 │
│ Passing: 7 │
│ Tests: 4 │
│ Passing: 4 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 0 │
│ Video: true │
│ Duration: X seconds │
│ Spec Ran: with_allow_list_custom.cy.ts │
│ Spec Ran: with_allow_list_true.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
Expand All @@ -177,14 +174,14 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-
Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✔ with_allow_list_custom.cy.ts XX:XX 7 7 - - - │
│ ✔ with_allow_list_true.cy.ts XX:XX 4 4 - - - │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✔ All specs passed! XX:XX 7 7 - - -
✔ All specs passed! XX:XX 4 4 - - -
`

exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] / always strips known problematic directives and is passive with known working directives'] = `
exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] / works with [\'script-src-elem\', \'script-src\', \'default-src\', \'form-action\'] directives'] = `
====================================================================================================
Expand All @@ -193,40 +190,44 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Cypress: 1.2.3 │
│ Browser: FooBrowser 88 │
│ Specs: 1 found (with_allow_list_custom_or_true.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_custom_or_true.cy.ts │
│ Specs: 1 found (with_allow_list_custom.cy.ts) │
│ Searched: cypress/e2e/experimental_csp_allow_list_spec/with_allow_list_custom.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
────────────────────────────────────────────────────────────────────────────────────────────────────
Running: with_allow_list_custom_or_true.cy.ts (1 of 1)
Running: with_allow_list_custom.cy.ts (1 of 1)
experimentalCspAllowList is custom or true
disallowed
✓ frame-ancestors are always stripped
✓ trusted-types & require-trusted-types-for are always stripped
allowed
✓ sample: style-src is not stripped
✓ sample: upgrade-insecure-requests is not stripped
experimentalCspAllowList=['script-src-elem', 'script-src', 'default-src']
✓ fails on inline form action
content-security-policy directive script-src-elem should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
content-security-policy directive script-src should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
content-security-policy directive default-src should not be stripped and
✓ allows Cypress to run, including configured inline nonces/hashes
✓ allows Cypress to run, but doesn't allow none configured inline scripts
4 passing
7 passing
(Results)
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 4 │
│ Passing: 4 │
│ Tests: 7 │
│ Passing: 7 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 0 │
│ Video: true │
│ Duration: X seconds │
│ Spec Ran: with_allow_list_custom_or_true.cy.ts │
│ Spec Ran: with_allow_list_custom.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
Expand All @@ -237,10 +238,9 @@ exports['e2e experimentalCspAllowList=true / experimentalCspAllowList=[\'script-
Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✔ with_allow_list_custom_or_true.cy.t XX:XX 4 4 - - - │
│ s │
│ ✔ with_allow_list_custom.cy.ts XX:XX 7 7 - - - │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✔ All specs passed! XX:XX 4 4 - - -
✔ All specs passed! XX:XX 7 7 - - -
`
Loading

0 comments on commit bfd150d

Please sign in to comment.