5326 Commits (e83520cc42cb174a5d3dc5ca1dcce299ad4abb25)

Author	SHA1	Message	Date
David Robertson	2bb4bd1269	Test that bans win a join against a race when computing `/sync` response (#11701)	3 years ago
Patrick Cloke	6bf81a7a61	Bundle aggregations outside of the serialization method. (#11612) ... This makes the serialization of events synchronous (and it no longer access the database), but we must manually calculate and provide the bundled aggregations. Overall this should cause no change in behavior, but is prep work for other improvements.	3 years ago
Patrick Cloke	6c68e874b1	Remove the /send_relation endpoint. (#11682) ... This was removed from MSC2674 before that was approved and is not used by any known clients.	3 years ago
Patrick Cloke	201c48c8de	Remove a Python 2-ism and improve type hints. (#11699) ... On Python 2, indexing a byte-string gives back a byte-string, while on Python 3 it gives back the ASCII equivalent as an int.	3 years ago
Olivier Wilkinson (reivilibre)	e87540abb1	Re-run Towncrier to add in the changelog entry for the Mjolnir workaround	3 years ago
Shay	70ce9aea71	Strip unauthorized fields from `unsigned` object in events received over federation (#11530) ... * add some tests to verify we are stripping unauthorized fields out of unsigned * add function to strip unauthorized fields from the unsigned object of event * newsfragment * update newsfragment number * add check to on_send_membership_event * refactor tests * fix lint error * slightly refactor tests and add some comments * slight refactor * refactor tests * fix import error * slight refactor * remove unsigned filtration code from synapse/handlers/federation_event.py * lint * move unsigned filtering code to event base * refactor tests * update newsfragment * requested changes * remove unused retun values	3 years ago
reivilibre	eec34b1f2a	Work around Mjolnir compatibility issue by adding an import for `glob_to_regex` in `synapse.util`, where it moved from. (#11696)	3 years ago
lukasdenk	2ef1fea8d2	Make room creations denied by `user_may_create_room` cause an `M_FORBIDDEN` error to be returned, not `M_UNKNOWN` (#11672) ... Co-authored-by: reivilibre <olivier@librepush.net>	3 years ago
David Robertson	c9eb678b73	Remove debug logging for #4422 (#11693) ... as per https://github.com/matrix-org/synapse/pull/11532#discussion_r769123269	3 years ago
Travis Ralston	feb3e006d7	Fix space hierarchy endpoint to match MSC2946 (#11667) ... Fixes minor discrepancies between the /hierarchy endpoint described in MSC2946 and the implementation. Note that the changes impact the stable and unstable /hierarchy and unstable /spaces endpoints for both client and federation APIs.	3 years ago
Dirk Klimpel	3b51c763ba	Fix get federation status of destination if no error occured (#11593)	3 years ago
Shay	d8f94eeec2	Run `pyupgrade --py37-plus --keep-percent-format` on Synapse (#11685) ... * newsfragment * fix newsfragment number * update changelog * remove extra space	3 years ago
Patrick Cloke	83acdb23fe	Re-run towncrier.	3 years ago
Patrick Cloke	877b45e812	Include `io.element.thread` capability for MSC3440. (#11690)	3 years ago
David Robertson	88a78c6577	Cache empty responses from `/user/devices` (#11587) ... If we've never made a request to a remote homeserver, we should cache the response---even if the response is "this user has no devices".	3 years ago
Olivier Wilkinson (reivilibre)	9be5aacc2d	1.50.0rc1	3 years ago
Richard van der Hoff	0fb3dd0830	Refactor the way we set `outlier` (#11634) ... * `_auth_and_persist_outliers`: mark persisted events as outliers Mark any events that get persisted via `_auth_and_persist_outliers` as, well, outliers. Currently this will be a no-op as everything will already be flagged as an outlier, but I'm going to change that. * `process_remote_join`: stop flagging as outlier The events are now flagged as outliers later on, by `_auth_and_persist_outliers`. * `send_join`: remove `outlier=True` The events created here are returned in the result of `send_join` to `FederationHandler.do_invite_join`. From there they are passed into `FederationEventHandler.process_remote_join`, which passes them to `_auth_and_persist_outliers`... which sets the `outlier` flag. * `get_event_auth`: remove `outlier=True` stop flagging the events returned by `get_event_auth` as outliers. This method is only called by `_get_remote_auth_chain_for_event`, which passes the results into `_auth_and_persist_outliers`, which will flag them as outliers. * `_get_remote_auth_chain_for_event`: remove `outlier=True` we pass all the events into `_auth_and_persist_outliers`, which will now flag the events as outliers. * `_check_sigs_and_hash_and_fetch`: remove unused `outlier` parameter This param is now never set to True, so we can remove it. * `_check_sigs_and_hash_and_fetch_one`: remove unused `outlier` param This is no longer set anywhere, so we can remove it. * `get_pdu`: remove unused `outlier` parameter ... and chase it down into `get_pdu_from_destination_raw`. * `event_from_pdu_json`: remove redundant `outlier` param This is never set to `True`, so can be removed. * changelog * update docstring	3 years ago
Philipp Matthias Schäfer	eedb4527f1	Fix link from generated configuration file to documentation (#11678) ... Co-authored-by: reivilibre <olivier@librepush.net> Co-authored-by: reivilibre <oliverw@matrix.org>	3 years ago
Fr3shTea	0201c6371c	Fix SimpleHttpClient not sending Accept header in `get_json` (#11677) ... Co-authored-by: reivilibre <olivier@librepush.net>	3 years ago
Dirk Klimpel	7a1cefc6e3	Add admin API to get users' account data (#11664) ... Co-authored-by: reivilibre <olivier@librepush.net>	3 years ago
reivilibre	84bfe47b01	Re-apply: Move glob_to_regex and re_word_boundary to matrix-python-common #11505 (#11687) ... Co-authored-by: Sean Quah <seanq@element.io>	3 years ago
reivilibre	84d790a32e	Clarify SSO mapping provider documentation by writing `def` or `async def` before the names of methods, as appropriate. (#11681)	3 years ago
Callum Macdonald	7013e06e2f	Improve Docker docs for use with Postgres (#11640)	3 years ago
Donny Johnson	0715e77b06	Correct Synapse install command for FreeBSD. (#11267) ... Co-authored-by: reivilibre <olivier@librepush.net>	3 years ago
Richard van der Hoff	79f6d3550a	update ngnix reverse-proxy example (#11680) ... this should not be a case-insensitive match.	3 years ago
Richard van der Hoff	b38bdae3a2	Fix AssertionErrors after purging events (#11642) ... * Fix AssertionErrors after purging events If you purged a bunch of events from your database, and then restarted synapse without receiving more events, then you would get a bunch of AssertionErrors on restart. This fixes the situation by rewinding the stream processors. * `check-newsfragment`: ignore deleted newsfiles	3 years ago
Richard van der Hoff	878aa55293	`FederationClient.backfill`: stop flagging events as outliers (#11632) ... Events returned by `backfill` should not be flagged as outliers. Fixes: ``` AssertionError: null File "synapse/handlers/federation.py", line 313, in try_backfill dom, room_id, limit=100, extremities=extremities File "synapse/handlers/federation_event.py", line 517, in backfill await self._process_pulled_events(dest, events, backfilled=True) File "synapse/handlers/federation_event.py", line 642, in _process_pulled_events await self._process_pulled_event(origin, ev, backfilled=backfilled) File "synapse/handlers/federation_event.py", line 669, in _process_pulled_event assert not event.internal_metadata.is_outlier() ``` See https://sentry.matrix.org/sentry/synapse-matrixorg/issues/231992 Fixes #8894.	3 years ago
Richard van der Hoff	2359ee3864	Remove redundant `get_current_events_token` (#11643) ... * Push `get_room_{min,max_stream_ordering}` into StreamStore Both implementations of this are identical, so we may as well push it down and get rid of the abstract base class nonsense. * Remove redundant `StreamStore` class This is empty now * Remove redundant `get_current_events_token` This was an exact duplicate of `get_room_max_stream_ordering`, so let's get rid of it. * newsfile	3 years ago
Richard van der Hoff	bd9821f7f1	Better error messages from `get_create_event_for_room` (#11638) ... "Unknown room" can mean a multitude of things here. To help with debugging, add some more words to the exception text.	3 years ago
Patrick Cloke	8422a7f7f6	Include the topic event in the prejoin state, per MSC3173. (#11666) ... Invites and knocks will now include the topic in the stripped state send to clients before joining the room.	3 years ago
Shay	13c974ed35	Drop Bionic from Debian builds (#11633) ... * update Trove classifiers to remove py36 * stop building bionic * update dh-virtualenv * newsfragment * fix newsfragment * update version refs * another try at correct tag * Update changelog	3 years ago
Patrick Cloke	cbd82d0b2d	Convert all namedtuples to attrs. (#11665) ... To improve type hints throughout the code.	3 years ago
Dirk Klimpel	07a3b5daba	Add type hints to `synapse/storage/databases/main/events_bg_updates.py` (#11654)	3 years ago
reivilibre	2c7f5e74e5	Fix a type annotation in `test_account_data.py` and remove it from the Mypy exclusion list. (#11657) ... Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	3 years ago
Dirk Klimpel	f82d38ed2e	Improve type hints in storage classes. (#11652) ... By using cast and making ignores more specific.	3 years ago
Patrick Cloke	f58b300d27	Do not attempt to bundled aggregations for /members and /state. (#11623) ... Both of those APIs return state events, which will not have bundled aggregations added anyway.	3 years ago
Dirk Klimpel	15bb1c8511	Add type hints to `synapse/storage/databases/main/stats.py` (#11653)	3 years ago
Shay	fcfe67578f	Update to the current version of Black and run it on Synapse codebase (#11596) ... * update black version * run updated version of black on code * newsfragment * enumerate python versions	3 years ago
Patrick Cloke	66d7aa783a	Fix mypy error with opentracing.tags. (#11622)	3 years ago
AndrewFerr	c500bf37d6	Add details for how to set up TURN behind NAT (#11553) ... Signed-off-by: Andrew Ferrazzutti <fair@miscworks.net>	3 years ago
Shay	87da37374a	Drop EOL python 3.6 from CI (#11595) ... * remove python 3.6 and postgres 9.6 from github workflow * remove python 3.6 env from tox * newsfragment * correct postgres version * add py310 to tox env list	3 years ago
Richard van der Hoff	aa874a1390	1.49.2	3 years ago
Richard van der Hoff	2bf31f7807	Pin to frozendict<2.1.2 (#11625) ... ... to work around breakage on buster (https://github.com/Marco-Sulla/python-frozendict/issues/41)	3 years ago
reivilibre	e6897e7383	Refactor `tests.util.setup_test_homeserver` and `tests.server.setup_test_homeserver`. (#11503)	3 years ago
Patrick Cloke	b6102230a7	Add type hints to event_push_actions. (#11594)	3 years ago
Richard van der Hoff	2215954147	Various opentracing enhancements (#11619) ... * Wrap `auth.get_user_by_req` in an opentracing span give `get_user_by_req` its own opentracing span, since it can result in a non-trivial number of sub-spans which it is useful to group together. This requires a bit of reorganisation because it also sets some tags (and may force tracing) on the servlet span. * Emit opentracing span for encoding json responses This can be a significant time sink. * Rename all sync spans with a prefix * Write an opentracing span for encoding sync response * opentracing span to group generate_room_entries * opentracing spans within sync.encode_response * changelog * Use the `trace` decorator instead of context managers	3 years ago
Richard van der Hoff	8c36d332d5	1.49.1	3 years ago
Patrick Cloke	dd47788752	Do not bundle aggregations for APIs which shouldn't include them. (#11592) ... And make bundling aggregations opt-in, instead of opt-out to avoid having APIs to include extraneous data (and being much heavier than necessary).	3 years ago
Richard van der Hoff	c3e38b88f2	Improve opentracing support for `ResponseCache` (#11607) ... This adds some opentracing annotations to ResponseCache, to make it easier to see what's going on; in particular, it adds a link back to the initial trace which is actually doing the work of generating the response.	3 years ago
Richard van der Hoff	60fa4935b5	Improve opentracing for incoming HTTP requests (#11618) ... * remove `start_active_span_from_request` Instead, pull out a separate function, `span_context_from_request`, to extract the parent span, which we can then pass into `start_active_span` as normal. This seems to be clearer all round. * Remove redundant tags from `incoming-federation-request` These are all wrapped up inside a parent span generated in AsyncResource, so there's no point duplicating all the tags that are set there. * Leave request spans open until the request completes It may take some time for the response to be encoded into JSON, and that JSON to be streamed back to the client, and really we want that inside the top-level span, so let's hand responsibility for closure to the SynapseRequest. * opentracing logs for HTTP request events * changelog	3 years ago