Skip to content

E2E Tests - All

E2E Tests - All #24230

Manually triggered February 3, 2025 20:05
Status Success
Total duration 22m 31s
Artifacts 16

e2e-test.yml

on: workflow_dispatch
Generate the matrix for subscriptions-tests dynamically
0s
Generate the matrix for subscriptions-tests dynamically
Matrix: wp-nightly-tests
Matrix: wcpay-subscriptions-tests
Fit to window
Zoom out
Zoom in

Annotations

4 errors, 53 warnings, and 16 notices
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card: tests/e2e-pw/utils/helpers.ts#L99
1) [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card Error: Timed out 20000ms waiting for expect(locator).toBeVisible() Locator: locator('.woocommerce-MyAccount-navigation-link--customer-logout') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 20000ms - waiting for locator('.woocommerce-MyAccount-navigation-link--customer-logout') at ../utils/helpers.ts:99 97 | '.woocommerce-MyAccount-navigation-link--customer-logout' 98 | ) > 99 | ).toBeVisible(); | ^ 100 | await expect( 101 | shopperPage.locator( 102 | 'div.woocommerce-MyAccount-content > p >> nth=0' at getShopper (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/helpers.ts:99:5) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:37:7
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card: tests/e2e-pw/utils/helpers.ts#L104
1) [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card Error: Timed out 20000ms waiting for expect(locator).toContainText(expected) Locator: locator('div.woocommerce-MyAccount-content > p').first() Expected string: "Hello" Received string: "" Call log: - expect.toContainText with timeout 20000ms - waiting for locator('div.woocommerce-MyAccount-content > p').first() at ../utils/helpers.ts:104 102 | 'div.woocommerce-MyAccount-content > p >> nth=0' 103 | ) > 104 | ).toContainText( 'Hello' ); | ^ 105 | await shopperPage 106 | .context() 107 | .storageState( { path: customerStorageFile } ); at getShopper (/home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/utils/helpers.ts:104:5) at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:37:7
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card: tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L72
1) [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card Error: Timed out 20000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('alert') Expected string: "Your card number is invalid." Received string: "" Call log: - expect.toHaveText with timeout 20000ms - waiting for getByRole('alert') 70 | 71 | // Verify that we get the expected error message. > 72 | await expect( shopperPage.getByRole( 'alert' ) ).toHaveText( | ^ 73 | errorText 74 | ); 75 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:72:54
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card: tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L72
1) [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card Error: Timed out 20000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('alert') Expected string: "Your card number is invalid." Received string: "" Call log: - expect.toHaveText with timeout 20000ms - waiting for getByRole('alert') 70 | 71 | // Verify that we get the expected error message. > 72 | await expect( shopperPage.getByRole( 'alert' ) ).toHaveText( | ^ 73 | errorText 74 | ); 75 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:72:54
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 40.5s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 19.7s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 19.6s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 39.1s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 20.9s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 20.7s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 38.3s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 21.1s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 19.5s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-no-signup-fee.spec.ts took 42.0s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-sign-up-fee.spec.ts took 22.3s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-purchase-free-trial.spec.ts took 20.1s
Slow Test: [chromium] › subscriptions/shopper/shopper-subscriptions-manage-payments.spec.ts#L1
[chromium] › subscriptions/shopper/shopper-subscriptions-manage-payments.spec.ts took 15.4s
Slow Test: [chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.7m
Slow Test: [chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.4m
Slow Test: [chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
Slow Test: [chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 26.0s
Slow Test: [chromium] › wcpay/merchant/merchant-orders-full-refund.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-full-refund.spec.ts took 23.6s
Slow Test: [chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.5m
Slow Test: [chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
Slow Test: [chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 56.2s
Slow Test: [chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 27.5s
Slow Test: [chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 27.2s
Slow Test: [chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.6m
Slow Test: [chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
Slow Test: [chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
Slow Test: [chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 28.2s
Slow Test: [chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 27.0s
Slow Test: [chromium] › wcpay/merchant/multi-currency-setup.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-setup.spec.ts took 1.6m
Slow Test: [chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts#L1
[chromium] › wcpay/merchant/merchant-disputes-respond.spec.ts took 1.5m
Slow Test: [chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts#L1
[chromium] › wcpay/merchant/multi-currency-on-boarding.spec.ts took 1.0m
Slow Test: [chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-status-change.spec.ts took 28.8s
Slow Test: [chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts#L1
[chromium] › wcpay/merchant/merchant-orders-refund-failures.spec.ts took 28.5s
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts took 55.0s
Slow Test: [chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 54.8s
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts took 54.3s
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.9m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts took 1.0m
Slow Test: [chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 58.9s
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.3m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
Slow Test: [chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 54.9s
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase-site-editor.spec.ts took 53.8s
Slow Test: [chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts#L1
[chromium] › wcpay/shopper/shopper-myaccount-saved-cards.spec.ts took 2.8m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-failures.spec.ts took 1.4m
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts took 1.2m
Slow Test: [chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts#L1
[chromium] › wcpay/shopper/shopper-bnpls-checkout.spec.ts took 56.1s
Slow Test: [chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts#L1
[chromium] › wcpay/shopper/shopper-checkout-purchase.spec.ts took 55.8s
🎭 Playwright Run Summary
8 passed (55.4s)
🎭 Playwright Run Summary
8 passed (57.2s)
🎭 Playwright Run Summary
8 passed (59.3s)
🎭 Playwright Run Summary
8 passed (58.8s)
🎭 Playwright Run Summary
14 passed (2.8m)
🎭 Playwright Run Summary
14 passed (2.9m)
🎭 Playwright Run Summary
14 passed (2.9m)
🎭 Playwright Run Summary
14 passed (3.0m)
🎭 Playwright Run Summary
66 passed (13.4m)
🎭 Playwright Run Summary
66 passed (13.2m)
🎭 Playwright Run Summary
66 passed (13.6m)
🎭 Playwright Run Summary
66 passed (14.0m)
🎭 Playwright Run Summary
1 flaky [chromium] › wcpay/shopper/shopper-checkout-save-card-and-purchase.spec.ts:40:9 › Saved cards › When using a 3ds card added on checkout › should save the card 14 skipped 75 passed (16.0m)
🎭 Playwright Run Summary
14 skipped 76 passed (15.8m)
🎭 Playwright Run Summary
1 flaky [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card 14 skipped 75 passed (16.1m)
🎭 Playwright Run Summary
1 flaky [chromium] › wcpay/shopper/shopper-myaccount-payment-methods-add-fail.spec.ts:61:8 › Payment Methods › when attempting to add a declined-incorrect card › it should not add the card 89 passed (18.2m)

Artifacts

Produced during runtime
Name Size
wp(latest)-wc(7.7.0)-subscriptions-merchant
33.4 KB
wp(latest)-wc(7.7.0)-subscriptions-shopper
33.9 KB
wp(latest)-wc(7.7.0)-wcpay-merchant
41.1 KB
wp(latest)-wc(7.7.0)-wcpay-shopper
41.3 KB
wp(latest)-wc(beta)-subscriptions-merchant
2.69 KB
wp(latest)-wc(beta)-subscriptions-shopper
3.24 KB
wp(latest)-wc(beta)-wcpay-merchant
9.34 KB
wp(latest)-wc(beta)-wcpay-shopper
25.7 MB
wp(latest)-wc(latest)-subscriptions-merchant
2.69 KB
wp(latest)-wc(latest)-subscriptions-shopper
3.22 KB
wp(latest)-wc(latest)-wcpay-merchant
9.8 KB
wp(latest)-wc(latest)-wcpay-shopper
16.7 MB
wp(nightly)-wc(latest)-subscriptions-merchant
5.05 KB
wp(nightly)-wc(latest)-subscriptions-shopper
8.49 KB
wp(nightly)-wc(latest)-wcpay-merchant
39 KB
wp(nightly)-wc(latest)-wcpay-shopper
30 MB