303 Commits (7791c5194ef87132d9c708bf4c8d2991547721fc)

Author	SHA1	Message	Date
Erik Johnston	face0c5b3c	Prefill client IPs cache on workers	6 years ago
Brendan Abolivier	a4c3a361b7	Add rate-limiting on registration (#4735) ... * Rate-limiting for registration * Add unit test for registration rate limiting * Add config parameters for rate limiting on auth endpoints * Doc * Fix doc of rate limiting function Co-Authored-By: babolivier <contact@brendanabolivier.com> * Incorporate review * Fix config parsing * Fix linting errors * Set default config for auth rate limiting * Fix tests * Add changelog * Advance reactor instead of mocked clock * Move parameters to registration specific config and give them more sensible default values * Remove unused config options * Don't mock the rate limiter un MAU tests * Rename _register_with_store into register_with_store * Make CI happy * Remove unused import * Update sample config * Fix ratelimiting test for py2 * Add non-guest test	6 years ago
Andrew Morgan	b9f6163092	Simplify token replication logic	6 years ago
Erik Johnston	a84b8d56c2	Fixup slave stores	6 years ago
Andrew Morgan	fe7bd23a85	Clean up logic and add comments	6 years ago
Andrew Morgan	9f7cdf3da1	Clearer branching, fix missing list clear	6 years ago
Andrew Morgan	5f0c449dd5	Prevent replication wedging	6 years ago
Erik Johnston	1e315017d3	When presence is enabled don't send over replication	6 years ago
Erik Johnston	6bb1c028f1	Limit cache invalidation replication line length (#4748)	6 years ago
Erik Johnston	6870fc496f	Move connecting logic into ClientReplicationStreamProtocol	6 years ago
Erik Johnston	25814921f1	Increase the max delay between retry attempts ... Otherwise if you have many workers they can easily take out master with their connection attempts	6 years ago
Erik Johnston	313987187e	Fix tightloop over connecting to replication server ... If the client failed to process incoming commands during the initial set up of the replication connection it would immediately disconnect and reconnect, resulting in a tightloop. This can happen, for example, when subscribing to a stream that has a row that is too long in the backlog. The fix here is to not consider the connection successfully set up until the client has succesfully subscribed and caught up with the streams. This ensures that the retry logic timers aren't reset until then, meaning that if an error does happen during start up the client will continue backing off before retrying again.	6 years ago
Erik Johnston	80467bbac3	Fix state cache invalidation on workers	6 years ago
Erik Johnston	dbdc565dfd	Fix registration on workers (#4682) ... * Move RegistrationHandler init to HomeServer * Move post registration actions to RegistrationHandler * Add post regisration replication endpoint * Newsfile	6 years ago
Erik Johnston	a9b5ea6fc1	Batch cache invalidation over replication ... Currently whenever the current state changes in a room invalidate a lot of caches, which cause *a lot* of traffic over replication. Instead, lets batch up all those invalidations and send a single poke down the replication streams. Hopefully this will reduce load on the master process by substantially reducing traffic.	6 years ago
Erik Johnston	af691e415c	Move register_device into handler	6 years ago
Erik Johnston	eb2b8523ae	Split out registration to worker ... This allows registration to be handled by a worker, though the actual write to the database still happens on master. Note: due to the in-memory session map all registration requests must be handled by the same worker.	6 years ago
Erik Johnston	a4f52a33fe	Fix replication for room v3 (#4523) ... * Fix replication for room v3 We were not correctly quoting the path fragments over http replication, which meant that it exploded when the event IDs had a slash in them * Newsfile	6 years ago
Erik Johnston	b6b73a0bcf	Fix receiving events from federation via a worker ... This bug was introduced in PR #4470, commit 678a92cb56	6 years ago
Erik Johnston	678a92cb56	Replace missed usages of FrozenEvent	6 years ago
Erik Johnston	be6a7e47fa	Revert "Require event format version to parse or create events"	6 years ago
Erik Johnston	e8c9f15397	Replace missed usages of FrozenEvent	6 years ago
Erik Johnston	a163b748a5	Don't truncate command name in metrics	6 years ago
Amber Brown	c4b3698a80	Make the replication logger quieter (#4108)	6 years ago
Amber Brown	381d2cfdf0	Make workers work on Py3 (#4027)	6 years ago
Travis Ralston	f1a7264663	Fix minor typo in exception	6 years ago
Amber Brown	7c27c4d51c	merge (#3576)	6 years ago
Erik Johnston	3e242dc149	Remove conn_id	6 years ago
Erik Johnston	b13836da7f	Remove conn_id from repl prometheus metrics ... `conn_id` gets set to a random string, and so we end up filling up prometheus with tonnes of data series, which is bad.	6 years ago
Erik Johnston	91cdb6de08	Call UserDirectoryHandler methods directly ... Turns out that the user directory handling is fairly racey as a bunch of stuff assumes that the processing happens on master, which it doesn't when there is a synapse.app.user_dir worker. So lets just call the function directly until we actually get round to fixing it, since it doesn't make the situation any worse.	6 years ago
Erik Johnston	3b2dcfff78	Fix logging bug in EDU handling over replication	6 years ago
Richard van der Hoff	0e8d78f6aa	Logcontexts for replication command handlers ... Run the handlers for replication commands as background processes. This should improve the visibility in our metrics, and reduce the number of "running db transaction from sentinel context" warnings. Ideally it means converting the things that fire off deferreds into the night into things that actually return a Deferred when they are done. I've made a bit of a stab at this, but it will probably be leaky.	6 years ago
Erik Johnston	488ffe6fdb	Use federation handler function rather than duplicate ... This involves renaming _persist_events to be a public function.	6 years ago
Erik Johnston	773db62a22	Rename slave TransactionStore to SlaveTransactionStore	6 years ago
Erik Johnston	a6c813761a	Docstrings	6 years ago
Erik Johnston	b179537f2a	Move clean_room_for_join to master	6 years ago
Erik Johnston	72d1902bbe	Fixup doc comments	6 years ago
Erik Johnston	62564797f5	Fixup wording and remove dead code	6 years ago
Erik Johnston	bebe325e6c	Rename POST param to METHOD	6 years ago
Erik Johnston	5011417632	Fixup logging and docstrings	6 years ago
Erik Johnston	495cb100d1	Allow profile changes to happen on workers	6 years ago
Erik Johnston	1e2bed9656	Import all functions from TransactionStore	6 years ago
Erik Johnston	a3f5bf79a0	Add EDU/query handling over replication	6 years ago
Erik Johnston	e26dbd82ef	Add replication APIs for persisting federation events	6 years ago
Erik Johnston	051a99c400	Fix isort	6 years ago
Richard van der Hoff	0ca459ea33	Basic support for room versioning ... This is the first tranche of support for room versioning. It includes: * setting the default room version in the config file * new room_version param on the createRoom API * storing the version of newly-created rooms in the m.room.create event * fishing the version of existing rooms out of the m.room.create event	6 years ago
Richard van der Hoff	01e93f48ed	Kill off MatrixCodeMessageException ... This code brings the SimpleHttpClient into line with the MatrixFederationHttpClient by having it raise HttpResponseExceptions when a request fails (rather than trying to parse for matrix errors and maybe raising MatrixCodeMessageException). Then, whenever we were checking for MatrixCodeMessageException and turning them into SynapseErrors, we now need to check for HttpResponseExceptions and call to_synapse_error.	6 years ago
Erik Johnston	443da003bc	Use new helper base class for membership requests	6 years ago
Erik Johnston	729b672823	Use new helper base class for ReplicationSendEventRestServlet	6 years ago
Erik Johnston	d81602b75a	Add helper base class for generating new replication endpoints ... This will hopefully reduce the boiler plate required to implement new internal HTTP requests.	6 years ago