Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cypress tests are broken #171

Closed
7 tasks done
Tracked by #163
anders-schneider opened this issue Jul 12, 2021 · 11 comments
Closed
7 tasks done
Tracked by #163

Cypress tests are broken #171

anders-schneider opened this issue Jul 12, 2021 · 11 comments
Assignees
Labels
bug Something isn't working epic: dev velocity Misc tickets for improving dev velocity
Milestone

Comments

@anders-schneider
Copy link

anders-schneider commented Jul 12, 2021

Noting a bunch of issues I ran into with Cypress tests:

  • yarn test:apps pops up a window of the Cypress desktop app, where I can click "run all tests" (or something like that). Clicking that, a Chrome window is opened. But then there is no further indication that anything is happening. This may be an issue with my local Cypress setup?
  • What needs to be run before we can do yarn test:app:partners? I tried running yarn dev:backend or yarn dev:all (in a separate terminal), but got errors in both cases.

Completion criteria:

  • yarn test:apps sounds like it runs tests for both the public and partners sites; it doesn't (it only runs public tests
  • get e2e tests working in bloom-housing/bloom
  • create instructions for running Cypress tests
  • There's no yarn command to run the tests in "headless" mode
  • When I was able to get the public Cypress tests running (in headless mode), 48 of 94 tests failed (across 20 different test specs, of 23 total)
  • A compilation error is blocking even being able to run the partners Cypress tests.
  • Add tests to presubmit
@anders-schneider anders-schneider added bug Something isn't working epic: dev velocity Misc tickets for improving dev velocity size: 3 About a day of work labels Jul 12, 2021
@github-actions github-actions bot added the M7 label Jul 12, 2021
@willrlin willrlin added this to the M7 milestone Jul 12, 2021
@willrlin willrlin mentioned this issue Jul 12, 2021
7 tasks
@willrlin willrlin removed the M7 label Jul 15, 2021
@willrlin willrlin modified the milestones: M7, M8 Jul 15, 2021
@github-actions github-actions bot added the M8 label Jul 15, 2021
@avaleske
Copy link

@anders-schneider noted that these are broken upstream as well. Deprioritizing for now.

@github-actions github-actions bot removed the M8 label Jul 20, 2021
@avaleske avaleske added P3 Low priority M8 labels Jul 20, 2021
@willrlin willrlin removed this from the M8 milestone Jul 26, 2021
@willrlin willrlin removed the M8 label Jul 26, 2021
@willrlin
Copy link

Sean said that these tests are passing on their dev and master branches, so it must be something about our set up that is causing them to fail.

@willrlin willrlin removed the P3 Low priority label Jul 28, 2021
@willrlin willrlin removed the size: 3 About a day of work label Jul 28, 2021
@willrlin willrlin added this to the M9 milestone Jul 28, 2021
@github-actions github-actions bot added the M9 label Jul 28, 2021
@willrlin willrlin self-assigned this Jul 28, 2021
@willrlin
Copy link

I was able to get the tests to run and pass in Bloom's codebase and then fail in ours. I started a wiki page with some instructions: https://github.com/CityOfDetroit/bloom/wiki/Cypress-tests

@willrlin
Copy link

Most of the failing sites/public tests have to do with applications. I wonder if we should attempt to fix or just disable them.

@willrlin
Copy link

It looks like there's only 1 test in sites/partners, which is broken in bloom-housing/bloom. This is also probably why yarn test:apps only runs sites/public.

@willrlin
Copy link

The .circleci config also only runs sites/public cypress tests.

@willrlin
Copy link

willrlin commented Aug 2, 2021

I was able to get interactive mode working. @anders-schneider did you do cypress open from your sites/public directory? It automatically showed up with a list of all the tests available to run for me.

@willrlin
Copy link

willrlin commented Aug 2, 2021

Debugging in interactive mode showed that the response from the server was now a PaginatedListing instead of just a Listing[], so we need to select the items.

@willrlin
Copy link

willrlin commented Aug 2, 2021

@avaleske you may be interested in the fix if the cypress tests are failing when you add pagination upstream.

@willrlin
Copy link

willrlin commented Aug 2, 2021

Status: all the tests are passing but I can't seem to get the Travis config just right. I'm trying to parallelize it and using this example but it's hard to understand and I can't find good .travis.yml documentation anywhere about these options. I'm also putting some notes in the wiki.

@willrlin willrlin changed the title Cypress tests appear to be quite broken Cypress tests are broken Aug 3, 2021
@willrlin
Copy link

willrlin commented Aug 5, 2021

I disabled the portion of member.spec.ts that was flaky and merged the rest of the tests. I don't know that it's worth it to re-enable if we aren't going to have applications.

@willrlin willrlin closed this as completed Aug 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working epic: dev velocity Misc tickets for improving dev velocity
Projects
None yet
Development

No branches or pull requests

3 participants