79 Commits (98fd558382226b347d78e5f6e6782c6e74c25e69)

Author	SHA1	Message	Date
reivilibre	5b645ae2ad	Refactor entry points so that they all have a `main` function. (#13052)	2 years ago
V02460	b7f7ca24b1	Remove shebang line from module files (#10415) ... Signed-off-by: Kai A. Hiller <V02460@gmail.com>	3 years ago
Jonathan de Jong	4b965c862d	Remove redundant "coding: utf-8" lines (#9786) ... Part of #9744 Removes all redundant `# -*- coding: utf-8 -*-` lines from files, as python 3 automatically reads source code as utf-8 now. `Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>`	4 years ago
Erik Johnston	bbf8886a05	Merge worker apps into one. (#6964)	5 years ago
Patrick Cloke	509e381afa	Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957) ... Ensure good comprehension hygiene using flake8-comprehensions.	5 years ago
Erik Johnston	48c3a96886	Port synapse.replication.tcp to async/await (#6666) ... * Port synapse.replication.tcp to async/await * Newsfile * Correctly document type of on_<FOO> functions as async * Don't be overenthusiastic with the asyncing....	5 years ago
Erik Johnston	bc5cb8bfe8	Remove database config parsing from apps.	5 years ago
Brendan Abolivier	2ac78438d8	Make the PusherSlaveStore inherit from the slave RoomStore ... So that it has access to the get_retention_policy_for_room function which is required by filter_events_for_client.	5 years ago
Andrew Morgan	54fef094b3	Remove usage of deprecated logger.warn method from codebase (#6271) ... Replace every instance of `logger.warn` with `logger.warning` as the former is deprecated.	5 years ago
Amber Brown	7dc398586c	Implement a structured logging output system. (#5680)	5 years ago
Erik Johnston	80cfad233e	Call startup commands as system triggers. ... This helps ensures that we only consider ourselves "up" once all the startup functions have completed.	5 years ago
Amber Brown	7ad1d76356	Support Prometheus_client 0.4.0+ (#5636)	5 years ago
Amber Brown	463b072b12	Move logging utilities out of the side drawer of util/ and into logging/ (#5606)	5 years ago
Amber Brown	32e7c9e7f2	Run Black. (#5482)	6 years ago
Amber Brown	9cd33d2f4b	Deduplicate some code in synapse.app (#4567)	6 years ago
Richard van der Hoff	e7a16c6210	Remove redundant run_as_background_process() from pusherpool ... `on_new_notifications` and `on_new_receipts` in `HttpPusher` and `EmailPusher` now always return synchronously, so we can remove the `defer.gatherResults` on their results, and the `run_as_background_process` wrappers can be removed too because the PusherPool methods will now complete quickly enough.	6 years ago
Richard van der Hoff	3e8b02c939	Rename _refresh_pusher ... This is public (or at least, called from outside the class), so ought to have a better name.	6 years ago
Amber Brown	381d2cfdf0	Make workers work on Py3 (#4027)	6 years ago
Schnuffle	dc5db01ff2	Replaced all occurences of e.message with str(e) ... Signed-off-by: Schnuffle <schnuffle@github.com>	6 years ago
Erik Johnston	8601c24287	Fix some instances of ExpiringCache not expiring cache items ... ExpiringCache required that `start()` be called before it would actually start expiring entries. A number of places didn't do that. This PR removes `start` from ExpiringCache, and automatically starts backround reaping process on creation instead.	6 years ago
Richard van der Hoff	0b07f02e19	Make sure that we close db connections opened during init ... We should explicitly close any db connections we open, because failing to do so can block other transactions as per https://github.com/matrix-org/synapse/issues/3682. Let's also try to factor out some of the boilerplate by having server classes define their datastore class rather than duplicating the whole of `setup`.	6 years ago
Richard van der Hoff	0e8d78f6aa	Logcontexts for replication command handlers ... Run the handlers for replication commands as background processes. This should improve the visibility in our metrics, and reduce the number of "running db transaction from sentinel context" warnings. Ideally it means converting the things that fire off deferreds into the night into things that actually return a Deferred when they are done. I've made a bit of a stab at this, but it will probably be leaky.	6 years ago
Richard van der Hoff	66f7dc8c87	Fix logcontexts for running pushers ... First of all, avoid resetting the logcontext before running the pushers, to fix the "Starting db txn 'get_all_updated_receipts' from sentinel context" warning. Instead, give them their own "background process" logcontexts.	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Travis Ralston	12285a1a76	The flag is named enable_metrics, not collect_metrics ... Signed-off-by: Travis Ralston <travpc@gmail.com>	7 years ago
Amber Brown	febe0ec8fd	Run Prometheus on a different port, optionally. (#3274)	7 years ago
Richard van der Hoff	318711e139	Set Server header in SynapseRequest ... (instead of everywhere that writes a response. Or rather, the subset of places which write responses where we haven't forgotten it). This also means that we don't have to have the mysterious version_string attribute in anything with a request handler. Unfortunately it does mean that we have to pass the version string wherever we instantiate a SynapseSite, which has been c&ped 150 times, but that is code that ought to be cleaned up anyway really.	7 years ago
Richard van der Hoff	2a13af23bc	Use run_in_background in preference to preserve_fn ... While I was going through uses of preserve_fn for other PRs, I converted places which only use the wrapped function once to use run_in_background, to avoid creating the function object.	7 years ago
Richard van der Hoff	9255a6cb17	Improve exception handling for background processes ... There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.	7 years ago
Matthew Hodgson	8cbbfaefc1	404 correctly on missing paths via NoResource ... fixes https://github.com/matrix-org/synapse/issues/2043 and https://github.com/matrix-org/synapse/issues/2029	7 years ago
Erik Johnston	493e25d554	Move storage functions for push calculations ... This will allow push actions for an event to be calculated on workers.	7 years ago
Richard van der Hoff	25adde9a04	Factor out get_db_conn to HomeServer base class ... This function is identical to all subclasses, so we may as well push it up to the base class to reduce duplication (and make use of it in the tests)	7 years ago
Silke	df0f602796	Implement listen_tcp method in remaining workers ... Signed-off-by: Silke <silke@slxh.eu>	7 years ago
Richard van der Hoff	543c794a76	Factor out common application start ... We have 10 copies of this code, and I don't really want to update each one separately.	7 years ago
Erik Johnston	ac66e11f2b	Add the appropriate amount of preserve_fn	8 years ago
Erik Johnston	36c28bc467	Update all the workers and master to use TCP replication	8 years ago
Richard van der Hoff	067b00d49d	Run the reactor with the sentinel logcontext ... This fixes a class of 'Unexpected logcontext' messages, which were happening because the logcontext was somewhat arbitrarily swapping between the sentinel and the `run` logcontext.	8 years ago
Richard van der Hoff	d84bd51e95	Refactor logger config for workers ... - to make it easier to add more config options.	8 years ago
Erik Johnston	edd6cdfc9a	Restore default bind address	8 years ago
Erik Johnston	8a0fddfd73	Remove spurious for..else..	8 years ago
Johannes Löthberg	702c020e58	Fix check for bind_address ... The empty string is a valid setting for the bind_address option, so explicitly check for None here instead. Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>	8 years ago
Johannes Löthberg	7dfd70fc83	Add support for specifying multiple bind addresses ... Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>	8 years ago
Erik Johnston	24772ba56e	Respect use_frozen_dicts option in workers	8 years ago
Erik Johnston	748d8fdc7b	Reduce DB hits for replication ... Some streams will occaisonally advance their positions without actually having any new rows to send over federation. Currently this means that the token will not advance on the workers, leading to them repeatedly sending a slightly out of date token. This in turns requires the master to hit the DB to check if there are any new rows, rather than hitting the no op logic where we check if the given token matches the current token. This commit changes the API to always return an entry if the position for a stream has changed, allowing workers to advance their tokens correctly.	8 years ago
Erik Johnston	4be85281f9	Enable state caches on workers	8 years ago
Erik Johnston	784a2d4f2c	Remove broken cache stuff	8 years ago
Erik Johnston	24f36469bc	Add federation /version API	8 years ago
Mark Haines	8c75040c25	Fix setting gc thresholds in the workers	9 years ago
Mark Haines	a352b68acf	Use worker_ prefixes for worker config, use existing support for multiple config files	9 years ago
Mark Haines	364d616792	Access the event_cache_size directly from the server object. ... This means that the workers can override the event_cache_size directly without clobbering the value in the main synapse config.	9 years ago