Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to deflake a sytest #816

Merged
merged 1 commit into from
Feb 21, 2020
Merged

Attempt to deflake a sytest #816

merged 1 commit into from
Feb 21, 2020

Conversation

richvdh
Copy link
Member

@richvdh richvdh commented Feb 20, 2020

This test was a bit flaky. The trouble was that there were three things that could trigger a device update notification:

  • Joining the room
  • Updating the device keys
  • Changing display name

... but we only checked for two update notifications, and didn't sanity-check that they were matching up. By adding another poll for update notifications, we can avoid getting out of sync.

I also don't think we need the display_name update here.

We can also tighten up the final check by making sure that the departed user doesn't appear in any syncs between the departure and the undeparted user's update arriving.

This test was a bit flaky. The trouble was that there were three things that
could triger a deice update notification:
 * Joining the room
 * Updating the device keys
 * Changing display name

... but we only checked for two update notifications, and didn't sanity-check
that they were matching up. By adding another poll for update notifications, we
can avoid getting out of sync.

I also don't think we need the display_name update here.

We can also tighten up the final check by making sure that the departed user
doesn't appear in *any* syncs between the departure and the undeparted user's
update arriving.
@richvdh richvdh merged commit feef3e1 into develop Feb 21, 2020
@richvdh richvdh deleted the rav/deflake_keys_test branch February 21, 2020 13:52
anoadragon453 added a commit that referenced this pull request Mar 24, 2020
…ease-v1.12.x

* origin/release-v1.12.0:
  Missing bits
  Use r0 instead of 'unstable' for joined_members|rooms
  Add test to optionally keep other sessions when modifying a user's password. (#832)
  Remove tests that call query_auth endpoint. (#827)
  Add tests for validating alt_aliases of a canonical alias event. (#824)
  Update the haproxy config to route fallback auth and register to the same worker. (#828)
  Add tests for a user with sufficient power level removing an alias. (#818)
  Add a test for an event with an invalid signature (#821)
  Fix race in self signing key tests. (#822)
  Use retry_until_success instead of repeat_until_true.
  Attempt to deflake a test.
  Fix frontend proxy worker binding to wrong port. (#823)
  Stop checking for aliases in the public room list.
  Attempt to deflake a sytest (#816)
  Fix formatting from review.
  Support running Dendrite in more than 1 sqlite db file
  Add tests for moving alt_aliases to an upgraded room.
  Support running dendrite in sqlite
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants