45 Commits (7dcf984075cbc36e0c9bbd199bf4e4de99523224)

Author	SHA1	Message	Date
Richard van der Hoff	a5798de067	Move replication.tcp.streams into a package	6 years ago
Richard van der Hoff	fdcad8eabd	Move client receipt processing to federation sender worker. ... This is mostly a prerequisite for #4730, but also fits with the general theme of "move everything off the master that we possibly can".	6 years ago
Amber Brown	9cd33d2f4b	Deduplicate some code in synapse.app (#4567)	6 years ago
Amber Brown	5d976c0c7c	Fix worker TLS (#4492) ... * load cert * changelog * fix	6 years ago
Schnuffle	dc5db01ff2	Replaced all occurences of e.message with str(e) ... Signed-off-by: Schnuffle <schnuffle@github.com>	6 years ago
Erik Johnston	8601c24287	Fix some instances of ExpiringCache not expiring cache items ... ExpiringCache required that `start()` be called before it would actually start expiring entries. A number of places didn't do that. This PR removes `start` from ExpiringCache, and automatically starts backround reaping process on creation instead.	6 years ago
Richard van der Hoff	0b07f02e19	Make sure that we close db connections opened during init ... We should explicitly close any db connections we open, because failing to do so can block other transactions as per https://github.com/matrix-org/synapse/issues/3682. Let's also try to factor out some of the boilerplate by having server classes define their datastore class rather than duplicating the whole of `setup`.	6 years ago
Richard van der Hoff	0e8d78f6aa	Logcontexts for replication command handlers ... Run the handlers for replication commands as background processes. This should improve the visibility in our metrics, and reduce the number of "running db transaction from sentinel context" warnings. Ideally it means converting the things that fire off deferreds into the night into things that actually return a Deferred when they are done. I've made a bit of a stab at this, but it will probably be leaky.	6 years ago
Erik Johnston	773db62a22	Rename slave TransactionStore to SlaveTransactionStore	6 years ago
Amber Brown	b37c472419	Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Jeroen	3d605853c8	send SNI for federation requests	7 years ago
Travis Ralston	12285a1a76	The flag is named enable_metrics, not collect_metrics ... Signed-off-by: Travis Ralston <travpc@gmail.com>	7 years ago
Amber Brown	febe0ec8fd	Run Prometheus on a different port, optionally. (#3274)	7 years ago
Richard van der Hoff	318711e139	Set Server header in SynapseRequest ... (instead of everywhere that writes a response. Or rather, the subset of places which write responses where we haven't forgotten it). This also means that we don't have to have the mysterious version_string attribute in anything with a request handler. Unfortunately it does mean that we have to pass the version string wherever we instantiate a SynapseSite, which has been c&ped 150 times, but that is code that ought to be cleaned up anyway really.	7 years ago
Richard van der Hoff	2a13af23bc	Use run_in_background in preference to preserve_fn ... While I was going through uses of preserve_fn for other PRs, I converted places which only use the wrapped function once to use run_in_background, to avoid creating the function object.	7 years ago
Richard van der Hoff	9255a6cb17	Improve exception handling for background processes ... There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.	7 years ago
Matthew Hodgson	8cbbfaefc1	404 correctly on missing paths via NoResource ... fixes https://github.com/matrix-org/synapse/issues/2043 and https://github.com/matrix-org/synapse/issues/2029	7 years ago
Richard van der Hoff	25adde9a04	Factor out get_db_conn to HomeServer base class ... This function is identical to all subclasses, so we may as well push it up to the base class to reduce duplication (and make use of it in the tests)	7 years ago
Silke	df0f602796	Implement listen_tcp method in remaining workers ... Signed-off-by: Silke <silke@slxh.eu>	7 years ago
Richard van der Hoff	543c794a76	Factor out common application start ... We have 10 copies of this code, and I don't really want to update each one separately.	7 years ago
Erik Johnston	6aa5bc8635	Initial worker impl	8 years ago
Erik Johnston	9c712a366f	Move get_presence_list_* to SlaveStore	8 years ago
Erik Johnston	29574fd5b3	Reduce federation presence replication traffic ... This is mainly done by moving the calculation of where to send presence updates from the presence handler to the transaction queue, so we only need to send the presence event (and not the destinations) across the replication connection. Before we were duplicating by sending the full state across once per destination.	8 years ago
Erik Johnston	449d1297ca	Fix up federation SendQueue and document types	8 years ago
Erik Johnston	f10ce8944b	Don't double json encode federation replication data	8 years ago
Erik Johnston	d1d5362267	Add comment	8 years ago
Erik Johnston	ac66e11f2b	Add the appropriate amount of preserve_fn	8 years ago
Erik Johnston	6ce6bbedcb	Move where we ack federation	8 years ago
Erik Johnston	36c28bc467	Update all the workers and master to use TCP replication	8 years ago
Richard van der Hoff	067b00d49d	Run the reactor with the sentinel logcontext ... This fixes a class of 'Unexpected logcontext' messages, which were happening because the logcontext was somewhat arbitrarily swapping between the sentinel and the `run` logcontext.	8 years ago
Richard van der Hoff	d84bd51e95	Refactor logger config for workers ... - to make it easier to add more config options.	8 years ago
Erik Johnston	252b503fc8	Hook device list updates to replication	8 years ago
Erik Johnston	edd6cdfc9a	Restore default bind address	8 years ago
Johannes Löthberg	702c020e58	Fix check for bind_address ... The empty string is a valid setting for the bind_address option, so explicitly check for None here instead. Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>	8 years ago
Johannes Löthberg	7dfd70fc83	Add support for specifying multiple bind addresses ... Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>	8 years ago
Erik Johnston	4d9b5c60f9	Comment	8 years ago
Erik Johnston	4c79a63fd7	Explicit federation ack	8 years ago
Erik Johnston	50934ce460	Comments	8 years ago
Erik Johnston	7c9cdb2245	Store federation stream positions in the database	8 years ago
Erik Johnston	f8ee66250a	Handle sending events and device messages over federation	8 years ago
Erik Johnston	ed787cf09e	Hook up the send queue and create a federation sender worker	8 years ago
Erik Johnston	24772ba56e	Respect use_frozen_dicts option in workers	8 years ago
Erik Johnston	4be85281f9	Enable state caches on workers	8 years ago
Erik Johnston	bcbd74dc5b	Remove log lines	8 years ago
Erik Johnston	07229bbdae	Add appservice worker	8 years ago
Erik Johnston	24f36469bc	Add federation /version API	8 years ago
Erik Johnston	ec8b217722	Add destination retry to slave store	8 years ago
Erik Johnston	76b89d0edb	Add slace storage functions for public room list	8 years ago
Erik Johnston	aede7248ab	Split out a FederationReader process	8 years ago