Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Include a sample worker config for a Big deployment #8557

Open
ara4n opened this issue Oct 15, 2020 · 3 comments
Open

Include a sample worker config for a Big deployment #8557

ara4n opened this issue Oct 15, 2020 · 3 comments
Labels
A-Docs things relating to the documentation T-Task Refactoring, removal, replacement, enabling or disabling functionality, other engineering tasks.

Comments

@ara4n
Copy link
Member

ara4n commented Oct 15, 2020

e.g. Matrix.org or Mozilla or KDE, so that folks can crib off how to set up redis & workers & haproxy with real data rather than having to guess it from workers.md. See https://twitter.com/uumas8/status/1316469781932003333 for more context.

@anoadragon453 anoadragon453 added the A-Docs things relating to the documentation label Oct 16, 2020
@callahad
Copy link
Contributor

We think it could be useful to base this on matrix.org as a maximal example, as we split out everything we can there.

@behrmann
Copy link
Contributor

behrmann commented May 7, 2021

I recently hacked together a proof of concept for the mapping of users to the always same backend worker, which is currently left as an exercise to the reader.

The rest of the config is guess work from how I read the load balancing section in the worker docs and I haven't tested the federation part, since I only run non-federated instance, but I'd be happy to know if this is how it's supposed to work. If that were the case I could polish this up as a PR.

@behrmann
Copy link
Contributor

The new token format will make load balancing a lot easier in the long term, since the local part of the mxid is a easier to extract (it would have been even easier, if the base64 part would have been padded), but is there a way to age out old tokens? Currently one would need to handle both old and new style tokens.

@erikjohnston erikjohnston added the T-Task Refactoring, removal, replacement, enabling or disabling functionality, other engineering tasks. label May 20, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A-Docs things relating to the documentation T-Task Refactoring, removal, replacement, enabling or disabling functionality, other engineering tasks.
Projects
None yet
Development

No branches or pull requests

5 participants