2902 Commits (b18cd25e42711d99c62a098203f59f4e12f3fca7)

Author	SHA1	Message	Date
Richard van der Hoff	bd4b25f4d0	Remove some redundant joins on event_edges.room_id ... We've long passed the point where it's possible to have the same event_id in different tables, so these join conditions are redundant: we can just join on event_id. event_edges is of non-trivial size, and the room_id column is wasteful, so let's stop reading from it. In future, we can stop writing to it, and then drop it.	6 years ago
Richard van der Hoff	1b4d73fa52	comment on event_edges	6 years ago
Richard van der Hoff	21e878ebb6	Make EventStore inherit from EventFederationStore ... (since it uses methods therein) Turns out that we had a bunch of things which were incorrectly importing EventWorkerStore from events.py rather than events_worker.py, which broke once I removed the import into events.py.	6 years ago
Richard van der Hoff	03751a6420	Fix some looping_call calls which were broken in #3604 ... It turns out that looping_call does check the deferred returned by its callback, and (at least in the case of client_ips), we were relying on this, and I broke it in #3604. Update run_as_background_process to return the deferred, and make sure we return it to clock.looping_call.	6 years ago
Matthew Hodgson	bc7944e6d2	switch missing_types to be a bool	6 years ago
Matthew Hodgson	7d9fb88617	incorporate more review.	6 years ago
Erik Johnston	78a691d005	Split out DB writes in federation handler ... This will allow us to easily add an internal replication API to proxy these reqeusts to master, so that we can move federation APIs to workers.	6 years ago
Erik Johnston	7780a7b47c	Actually fix it by adding continue	6 years ago
Richard van der Hoff	1be94440d3	Fix occasional 'tuple index out of range' error ... This fixes a bug in _delete_existing_rows_txn which was introduced in #3435 (though it's been on matrix-org-hotfixes for *years*). This code is only called when there is some sort of conflict the first time we try to persist an event, so it only happens rarely. Still, the exceptions are annoying.	6 years ago
Richard van der Hoff	07defd5fe6	Fix another logcontext leak in _persist_events ... We need to run the errback in the sentinel context to avoid losing our own context. Also: add logging to runInteraction to help identify where "Starting db connection from sentinel context" warnings are coming from	6 years ago
Erik Johnston	a297ff2b16	Fix typo in conditional	6 years ago
Richard van der Hoff	371da42ae4	Wrap a number of things that run in the background ... This will reduce the number of "Starting db connection from sentinel context" warnings, and will help with our metrics.	6 years ago
Erik Johnston	ec56121b0d	Correctly handle outliers during persist events ... We incorrectly asserted that all contexts must have a non None state group without consider outliers. This would usually be fine as the assertion would never be hit, as there is a shortcut during persistence if the forward extremities don't change. However, if the outlier is being persisted with non-outlier events, the function would be called and the assertion would be hit. Fixes #3601	6 years ago
Matthew Hodgson	cb5c37a57c	handle the edge case for _get_some_state_from_cache where types is []	6 years ago
Erik Johnston	3188973857	Pull out did_forget to worker store	6 years ago
Erik Johnston	709c309b0e	Expand on docstring comment about return value	6 years ago
Erik Johnston	8f65ab98d2	Remove unnecessary iteritems	6 years ago
Erik Johnston	ed0dd68731	Fixup comment (and indent)	6 years ago
Erik Johnston	811ac73a42	Don't fetch state from the database unless needed	6 years ago
Erik Johnston	a79410e7b8	Have _get_new_state_after_events return delta ... If we have a delta from the existing to new current state, then we can reuse that rather than manually working it out by fetching both lots of state.	6 years ago
Erik Johnston	223341205e	Don't require to_delete to have event_ids	6 years ago
Matthew Hodgson	e22700c3dd	consider non-filter_type types as wildcards, thus missing from the state-group-cache	6 years ago
Matthew Hodgson	cd241d6bda	incorporate more review	6 years ago
Erik Johnston	0fa73e4a63	Remove unnecessary if	6 years ago
Erik Johnston	ff5426f6b8	Speed up _calculate_state_delta	6 years ago
Richard van der Hoff	8dff6e0322	Logcontext fixes ... Fix some random logcontext leaks.	6 years ago
Richard van der Hoff	69fb5dbdab	fix idiocy	6 years ago
Richard van der Hoff	1938cffaea	Add some measure blocks to persist_events ... ... to help us figure out where 40% of CPU is going	6 years ago
Matthew Hodgson	efcdacad7d	handle case where types is [] on postgres correctly	6 years ago
Matthew Hodgson	254fb430d1	incorporate review	6 years ago
Erik Johnston	8b9f164fff	Comments	6 years ago
Erik Johnston	50c60e5fad	Only get cached state from context in persist_event ... We don't want to bother pulling out the current state from the DB since until we know we have to. Checking the context for state is just an optimisation.	6 years ago
Richard van der Hoff	dae6dc1e77	Remove redundant checks on room forgottenness ... Fixes #3550	6 years ago
Erik Johnston	e42510ba63	Use new getters	6 years ago
Matthew Hodgson	c1bf2b587e	add trailing comma	6 years ago
Matthew Hodgson	2f558300cc	fix thinkos; unbreak tests	6 years ago
Matthew Hodgson	bcaec2915a	incorporate review	6 years ago
Matthew Hodgson	924eb34d94	add a filtered_types param to limit filtering to specific types	6 years ago
Matthew Hodgson	9e40834f74	yes, we do need to invalidate the device_id_exists_cache when deleting a remote device	6 years ago
Richard van der Hoff	f1a15ea206	revert 00bc979 ... ... we've fixed the things that caused the warnings, so we should reinstate the warning.	6 years ago
Matthew Hodgson	c0685f67c0	spell out that include_deleted_devices requires include_all_devices	6 years ago
Richard van der Hoff	00bc979137	Disable logcontext warning ... Temporary workaround to #3518 while we release 0.33.0.	6 years ago
Richard van der Hoff	667fba68f3	Run things as background processes ... This fixes #3518, and ensures that we get useful logs and metrics for lots of things that happen in the background. (There are certainly more things that happen in the background; these are just the common ones I've found running a single-process synapse locally).	6 years ago
Krombel	78a9ddcf9a	rerun isort with latest version	6 years ago
Krombel	4a27000548	check isort by travis	6 years ago
Matthew Hodgson	12ec58301f	shift to using an explicit deleted flag on m.device_list_update EDUs ... and generally make it work.	6 years ago
Erik Johnston	aff1dfdf3d	Update return value docstring	6 years ago
Matthew Hodgson	5797f5542b	WIP to announce deleted devices over federation ... Previously we queued up the poke correctly when the device was deleted, but then the actual EDU wouldn't get sent, as the device was no longer known. Instead, we now send EDUs for deleted devices too if there's a poke for them.	6 years ago
Erik Johnston	6ccefef07a	Use 'is not None' and add comments	6 years ago
Matthew Hodgson	ea752bdd99	s/becuase/because/g	6 years ago