141 Commits (59e2d2694deec13aaa0062e04b5460f978967dc1)

Author	SHA1	Message	Date
Richard van der Hoff	c7325776a7	Remove redundant PreserveLoggingContext ... Both (!) things that register as replication listeners do the right thing wrt logcontexts, so this is redundant.	7 years ago
Richard van der Hoff	daa10e3e66	Remove unused `wait_for_replication` method ... I guess this was used once? It's not now, anyway.	7 years ago
Amber Brown	b69216f768	Make the metrics less racy (#4061)	7 years ago
Richard van der Hoff	a87d419a85	Run notify_app_services as a bg process ... This ensures that its resource usage metrics get recorded somewhere rather than getting lost. (It also fixes an error when called from a nested logging context which completes before the bg process)	7 years ago
Erik Johnston	80d2d50f47	Fixup	7 years ago
Erik Johnston	9407bcf37a	Replace custom DeferredTimeoutError with defer.TimeoutError	7 years ago
Erik Johnston	a334e1cace	Update to use new timeout function everywhere. ... The existing deferred timeout helper function (and the one into twisted) suffer from a bug when a deferred's canceller throws an exception, #3842. The new helper function doesn't suffer from this problem.	7 years ago
Amber Brown	b37c472419	Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)	8 years ago
Matthew Hodgson	5797f5542b	WIP to announce deleted devices over federation ... Previously we queued up the poke correctly when the device was deleted, but then the actual EDU wouldn't get sent, as the device was no longer known. Instead, we now send EDUs for deleted devices too if there's a poke for them.	8 years ago
Amber Brown	49af402019	run isort	8 years ago
Amber Brown	77ac14b960	Pass around the reactor explicitly (#3385)	8 years ago
Amber Brown	071206304d	cleanup pep8 errors	8 years ago
Amber Brown	85ba83eb51	fixes	8 years ago
Amber Brown	df9f72d9e5	replacing portions	8 years ago
Richard van der Hoff	9d2c1b8429	Backport deferred.addTimeout ... Twisted 16.0 doesn't have addTimeout, so let's backport it.	8 years ago
Richard van der Hoff	9255a6cb17	Improve exception handling for background processes ... There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.	8 years ago
Richard van der Hoff	1ea904b9f0	Use deferred.addTimeout instead of time_bound_deferred ... This doesn't feel like a wheel we need to reinvent.	8 years ago
Adrian Tschira	f63ff73c7f	add __bool__ alias to __nonzero__ methods ... Signed-off-by: Adrian Tschira <nota@notafile.com>	8 years ago
Richard van der Hoff	d4fb4f7c52	Clear logcontext before starting fed txn queue runner ... These processes take a long time compared to the request, so there is lots of "Entering|Restoring dead context" in the logs. Let's try to shut it up a bit.	8 years ago
Richard van der Hoff	eaaabc6c4f	replace 'except:' with 'except Exception:' ... what could possibly go wrong	8 years ago
Erik Johnston	ecdd2a3658	Don't start user_directory handling on workers	9 years ago
Erik Johnston	eeb2f9e546	Add user_directory to database	9 years ago
Richard van der Hoff	65e1683680	Remove spurious PreserveLoggingContext ... In `on_new_room_event`, remove `PreserveLoggingContext` - we can call its subroutines with the logcontext set.	9 years ago
Richard van der Hoff	feb496056e	preserve_fn some deferred-returning things ... In `Notifier._on_new_room_event`, `preserve_fn` around its subroutines which return deferreds, so that it is safe to call it with an active logcontext.	9 years ago
Richard van der Hoff	773e1c6d68	Remove spurious @preserve_fn decorators ... Remove `@preserve_fn` decorators on `on_new_room_event`, `_notify_pending_new_room_events`, `_on_new_room_event`, `on_new_event`, and `on_new_replication_data` - none of these functions return a deferred, and the decorator does nothing unless the wrapped function returns a deferred, so the decorator was a no-op.	9 years ago
Erik Johnston	1df7c28661	Use callbacks to notify tcp replication rather than deferreds	9 years ago
Erik Johnston	7984708a55	Add a simple hook to wait for replication traffic	9 years ago
Erik Johnston	6957bfdca6	Don't recreate so many sets	9 years ago
Erik Johnston	6c82de5100	Format presence events on the edges instead of reformatting them multiple times	9 years ago
Erik Johnston	872e75a3d5	Add some metrics on notifier	9 years ago
Erik Johnston	fd2eef49c8	Reduce spurious calls to generate sync	9 years ago
Erik Johnston	54a79c1d37	Make presence.get_new_events a bit faster ... We do this by caching the set of users a user shares rooms with.	9 years ago
Erik Johnston	fbaf868f62	Correctly handle timeout errors	9 years ago
Erik Johnston	be14c24cea	Fix rare notifier bug where listeners dont timeout ... There was a race condition that caused the notifier to 'miss' the timeout notification, since there were no other checks for the timeout this caused listeners to get stuck in a loop until something happened.	9 years ago
Erik Johnston	26072df6af	Ensure only main or federation_sender process can send federation traffic	9 years ago
Erik Johnston	f8ee66250a	Handle sending events and device messages over federation	9 years ago
Erik Johnston	c0238ecbed	Explicitly specify state_key for history_visibility fetching	9 years ago
Erik Johnston	9219139351	Preserve some logcontexts	10 years ago
Erik Johnston	afbf6b33fc	defer.returnValue must not be called within Measure	10 years ago
Erik Johnston	39242090e3	Add measure blocks to notifier	10 years ago
Erik Johnston	9da84a9a1e	Make AppserviceHandler stream events from database ... This is for two reasons: 1. Suppresses duplicates correctly, as the notifier doesn't do any duplicate suppression. 2. Makes it easier to connect the AppserviceHandler to the replication stream.	10 years ago
Erik Johnston	b9abf3e4e3	Remove dead appservice code	10 years ago
Mark Haines	88625db05f	Notify users for events in rooms they join. ... Change how the notifier updates the map from room_id to user streams on receiving a join event. Make it update the map when it notifies for the join event, rather than using the "user_joined_room" distributor signal	10 years ago
Mark Haines	c626fc576a	Move the AS handler out of the Handlers object. ... Access it directly from the homeserver itself. It already wasn't inheriting from BaseHandler storing it on the Handlers object was already somewhat dubious.	10 years ago
Mark Haines	7e23476814	move filter_events_for_client out of base handler	10 years ago
David Baker	424a7f48f8	Run filter_events_for_client ... so we don't accidentally mail out events people shouldn't see	10 years ago
Mark Haines	2a37467fa1	Use google style doc strings. ... pycharm supports them so there is no need to use the other format. Might as well convert the existing strings to reduce the risk of people accidentally cargo culting the wrong doc string format.	10 years ago
Mark Haines	12904932c4	Hook up adding a pusher to the notifier for replication.	10 years ago
Mark Haines	ddf9e7b302	Hook up the push rules to the notifier	10 years ago
Mark Haines	60a0f81c7a	Add a /replication API for extracting the updates that happened on ... synapse This is necessary for replicating the data in synapse to be visible to a separate service because presence and typing notifications aren't stored in a database so won't be visible to another process. This API can be used to either get the raw data by requesting the tables themselves or to just receive notifications for updates by following the streams meta-stream. Returns updates for each table requested a JSON array of arrays with a row for each row in the table. Each table is prefixed by a header row with the: name of the table, current stream_id position for the table, number of rows, number of columns and the names of the columns. This is followed by the rows that have been added to the server since the requester last asked. The API has a timeout and is hooked up to the notifier so that a slave can long poll for updates.	10 years ago