260 Commits (28c21cd578587a1890ebf739fde94b2375cb4429)

Author	SHA1	Message	Date
Erik Johnston	be6a7e47fa	Revert "Require event format version to parse or create events"	6 years ago
Erik Johnston	f431ff3fb8	Require event format version to parse or create events	6 years ago
Richard van der Hoff	9b827c40ca	Log some bits about event creation (#4121) ... I found these helpful in debugging my room upgrade tests.	6 years ago
Erik Johnston	cb53ce9d64	Refactor state group lookup to reduce DB hits (#4011) ... Currently when fetching state groups from the data store we make two hits two the database: once for members and once for non-members (unless request is filtered to one or the other). This adds needless load to the datbase, so this PR refactors the lookup to make only a single database hit.	6 years ago
Richard van der Hoff	e7a16c6210	Remove redundant run_as_background_process() from pusherpool ... `on_new_notifications` and `on_new_receipts` in `HttpPusher` and `EmailPusher` now always return synchronously, so we can remove the `defer.gatherResults` on their results, and the `run_as_background_process` wrappers can be removed too because the PusherPool methods will now complete quickly enough.	6 years ago
Richard van der Hoff	8174c6725b	Avoid reraise, to improve stacktraces	6 years ago
Richard van der Hoff	66f7dc8c87	Fix logcontexts for running pushers ... First of all, avoid resetting the logcontext before running the pushers, to fix the "Starting db txn 'get_all_updated_receipts' from sentinel context" warning. Instead, give them their own "background process" logcontexts.	6 years ago
Neil Johnson	372bf073c1	block event creation and room creation on hitting resource limits	6 years ago
Matthew Hodgson	2f78f432c4	speed up /members and add at= and membership params (#3568)	6 years ago
Amber Brown	b37c472419	Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)	6 years ago
Erik Johnston	729b672823	Use new helper base class for ReplicationSendEventRestServlet	6 years ago
Erik Johnston	0faa3223cd	Fix missing attributes on workers. ... This was missed during the transition from attribute to getter for getting state from context.	6 years ago
Erik Johnston	e42510ba63	Use new getters	6 years ago
Erik Johnston	5c88bb722f	Move PaginationHandler to its own file	6 years ago
Erik Johnston	0ecf68aedc	Move check_in_room_or_world_readable to Auth	6 years ago
Richard van der Hoff	7c712f95bb	Combine Limiter and Linearizer ... Linearizer was effectively a Limiter with max_count=1, so rather than maintaining two sets of code, let's combine them.	6 years ago
Richard van der Hoff	8462c26485	Improvements to the Limiter ... * give them names, to improve logging * use a deque rather than a list for efficiency	6 years ago
Erik Johnston	8cb8df55e9	Split MessageHandler into read only and writers ... This will let us call the read only parts from workers, and so be able to move some APIs off of master, e.g. the `/state` API.	6 years ago
Matthew Hodgson	ea752bdd99	s/becuase/because/g	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Amber Brown	6350bf925e	Attempt to be more performant on PyPy (#3462)	7 years ago
Matthew Hodgson	0269367f18	allow non-consented users to still part rooms (to let us autopart them)	7 years ago
Amber Brown	07cad26d65	Remove all global reactor imports & pass it around explicitly (#3424)	7 years ago
Amber Brown	77ac14b960	Pass around the reactor explicitly (#3385)	7 years ago
Amber Brown	a61738b316	Remove run_on_reactor (#3395)	7 years ago
Richard van der Hoff	4a9cbdbc15	Exempt AS-registered users from doing gdpr	7 years ago
Adrian Tschira	17a70cf6e9	Misc. py3 fixes ... Signed-off-by: Adrian Tschira <nota@notafile.com>	7 years ago
Richard van der Hoff	3ff6f50eac	Use the localpart in the consent uri ... ... because it's shorter.	7 years ago
Richard van der Hoff	82191b08f6	Support for putting %(consent_uri)s in messages ... Make it possible to put the URI in the error message and the server notice that get sent by the server	7 years ago
Richard van der Hoff	a5e2941aad	Reject attempts to send event before privacy consent is given ... Returns an M_CONSENT_NOT_GIVEN error (cf https://github.com/matrix-org/matrix-doc/issues/1252) if consent is not yet given.	7 years ago
Erik Johnston	5f27ed75ad	Make purge_history operate on tokens ... As we're soon going to change how topological_ordering works	7 years ago
Richard van der Hoff	33f469ba19	Apply some limits to depth to counter abuse ... * When creating a new event, cap its depth to 2^63 - 1 * When receiving events, reject any without a sensible depth As per https://docs.google.com/document/d/1I3fi2S-XnpO45qrpCsowZv8P8dHcNZ4fsBsbOW7KABI	7 years ago
Richard van der Hoff	453adf00b6	pep8; remove spurious import	7 years ago
Richard van der Hoff	2a13af23bc	Use run_in_background in preference to preserve_fn ... While I was going through uses of preserve_fn for other PRs, I converted places which only use the wrapped function once to use run_in_background, to avoid creating the function object.	7 years ago
Richard van der Hoff	6493b22b42	reraise exceptions more carefully ... We need to be careful (under python 2, at least) that when we reraise an exception after doing some error handling, we actually reraise the original exception rather than anything that might have been raised (and handled) during the error handling.	7 years ago
Richard van der Hoff	9255a6cb17	Improve exception handling for background processes ... There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.	7 years ago
Richard van der Hoff	639480e14a	Avoid creating events with huge numbers of prev_events ... In most cases, we limit the number of prev_events for a given event to 10 events. This fixes a particular code path which created events with huge numbers of prev_events.	7 years ago
Erik Johnston	f8e8ec013b	Note why we're limiting concurrent event sends	7 years ago
Erik Johnston	e5082494eb	Limit concurrent event sends for a room	7 years ago
Richard van der Hoff	05630758f2	Use static JSONEncoders ... using json.dumps with custom options requires us to create a new JSONEncoder on each call. It's more efficient to create one upfront and reuse it.	7 years ago
Erik Johnston	926ba76e23	Replace ujson with simplejson	7 years ago
Erik Johnston	d0fcc48f9d	extra_users is actually a list of UserIDs	7 years ago
Richard van der Hoff	e48c7aac4d	Add transactional API to history purge ... Make the purge request return quickly, and allow scripts to poll for updates.	7 years ago
Richard van der Hoff	1708412f56	Return an error when doing two purges on a room ... Queuing up purges doesn't sound like a good thing.	7 years ago
Richard van der Hoff	f8bfcd7e0d	Provide a means to pass a timestamp to purge_history	7 years ago
Erik Johnston	f381d63813	Check event auth on the worker	7 years ago
Erik Johnston	6b8604239f	Correctly send ratelimit and extra_users params	7 years ago
Erik Johnston	f756f961ea	Fixup comments	7 years ago
Erik Johnston	28e973ac11	Calculate push actions on worker	7 years ago
Erik Johnston	b96278d6fe	Ensure that we delete staging push actions on errors	7 years ago