E2E Tests - All #24230
e2e-test.yml
on: workflow_dispatch
Generate the matrix for subscriptions-tests dynamically
0s
Matrix: wp-nightly-tests
Matrix: wcpay-subscriptions-tests
Annotations
4 errors, 53 warnings, and 16 notices
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card:
tests/e2e-pw/utils/helpers.ts#L99
1) [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card
Error: Timed out 20000ms waiting for expect(locator).toBeVisible()
Locator: locator('.woocommerce-MyAccount-navigation-link--customer-logout')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 20000ms
- waiting for locator('.woocommerce-MyAccount-navigation-link--customer-logout')
at ../utils/helpers.ts:99
97 | '.woocommerce-MyAccount-navigation-link--customer-logout'
98 | )
> 99 | ).toBeVisible();
| ^
100 | await expect(
101 | shopperPage.locator(
102 | 'div.woocommerce-MyAccount-content > p >> nth=0'
at getShopper (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/helpers.ts:99:5)
at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:37:7
|
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card:
tests/e2e-pw/utils/helpers.ts#L104
1) [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card
Error: Timed out 20000ms waiting for expect(locator).toContainText(expected)
Locator: locator('div.woocommerce-MyAccount-content > p').first()
Expected string: "Hello"
Received string: ""
Call log:
- expect.toContainText with timeout 20000ms
- waiting for locator('div.woocommerce-MyAccount-content > p').first()
at ../utils/helpers.ts:104
102 | 'div.woocommerce-MyAccount-content > p >> nth=0'
103 | )
> 104 | ).toContainText( 'Hello' );
| ^
105 | await shopperPage
106 | .context()
107 | .storageState( { path: customerStorageFile } );
at getShopper (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/helpers.ts:104:5)
at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:37:7
|
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card:
tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L72
1) [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card
Error: Timed out 20000ms waiting for expect(locator).toHaveText(expected)
Locator: getByRole('alert')
Expected string: "Your card number is invalid."
Received string: ""
Call log:
- expect.toHaveText with timeout 20000ms
- waiting for getByRole('alert')
70 |
71 | // Verify that we get the expected error message.
> 72 | await expect( shopperPage.getByRole( 'alert' ) ).toHaveText(
| ^
73 | errorText
74 | );
75 |
at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:72:54
|
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card:
tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L72
1) [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card
Error: Timed out 20000ms waiting for expect(locator).toHaveText(expected)
Locator: getByRole('alert')
Expected string: "Your card number is invalid."
Received string: ""
Call log:
- expect.toHaveText with timeout 20000ms
- waiting for getByRole('alert')
70 |
71 | // Verify that we get the expected error message.
> 72 | await expect( shopperPage.getByRole( 'alert' ) ).toHaveText(
| ^
73 | errorText
74 | );
75 |
at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:72:54
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 40.5s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 19.7s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 19.6s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 39.1s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 20.9s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 20.7s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 38.3s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 21.1s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 19.5s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 42.0s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 22.3s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 20.1s
|
Slow Test:
[chromium] › subscriptions/shopper/shopper-subscriptions-manage-payments.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-manage-payments.spec.ts took 15.4s
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.7m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.4m
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 26.0s
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-full-refund.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-full-refund.spec.ts took 23.6s
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.5m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 56.2s
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 27.5s
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 27.2s
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.6m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 28.2s
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 27.0s
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.6m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
|
Slow Test:
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 28.8s
|
Slow Test:
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 28.5s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts took 55.0s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 54.8s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts took 54.3s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.9m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts took 1.0m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 58.9s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 54.9s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts took 53.8s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.4m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
|
Slow Test:
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 56.1s
|
Slow Test:
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts took 55.8s
|
🎭 Playwright Run Summary
8 passed (55.4s)
|
🎭 Playwright Run Summary
8 passed (57.2s)
|
🎭 Playwright Run Summary
8 passed (59.3s)
|
🎭 Playwright Run Summary
8 passed (58.8s)
|
🎭 Playwright Run Summary
14 passed (2.8m)
|
🎭 Playwright Run Summary
14 passed (2.9m)
|
🎭 Playwright Run Summary
14 passed (2.9m)
|
🎭 Playwright Run Summary
14 passed (3.0m)
|
🎭 Playwright Run Summary
66 passed (13.4m)
|
🎭 Playwright Run Summary
66 passed (13.2m)
|
🎭 Playwright Run Summary
66 passed (13.6m)
|
🎭 Playwright Run Summary
66 passed (14.0m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card
14 skipped
75 passed (16.0m)
|
🎭 Playwright Run Summary
14 skipped
76 passed (15.8m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card
14 skipped
75 passed (16.1m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card
89 passed (18.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
wp(latest)-wc(7.7.0)-subscriptions-merchant
|
33.4 KB |
|
wp(latest)-wc(7.7.0)-subscriptions-shopper
|
33.9 KB |
|
wp(latest)-wc(7.7.0)-wcpay-merchant
|
41.1 KB |
|
wp(latest)-wc(7.7.0)-wcpay-shopper
|
41.3 KB |
|
wp(latest)-wc(beta)-subscriptions-merchant
|
2.69 KB |
|
wp(latest)-wc(beta)-subscriptions-shopper
|
3.24 KB |
|
wp(latest)-wc(beta)-wcpay-merchant
|
9.34 KB |
|
wp(latest)-wc(beta)-wcpay-shopper
|
25.7 MB |
|
wp(latest)-wc(latest)-subscriptions-merchant
|
2.69 KB |
|
wp(latest)-wc(latest)-subscriptions-shopper
|
3.22 KB |
|
wp(latest)-wc(latest)-wcpay-merchant
|
9.8 KB |
|
wp(latest)-wc(latest)-wcpay-shopper
|
16.7 MB |
|
wp(nightly)-wc(latest)-subscriptions-merchant
|
5.05 KB |
|
wp(nightly)-wc(latest)-subscriptions-shopper
|
8.49 KB |
|
wp(nightly)-wc(latest)-wcpay-merchant
|
39 KB |
|
wp(nightly)-wc(latest)-wcpay-shopper
|
30 MB |
|