878 Commits (2959184a42398277ff916206235b844a8f7be5d7)

Author	SHA1	Message	Date
Patrick Cloke	cf05258f76	Remove groups replication code. (#12900) ... The replication logic for groups is no longer used, so the message passing infrastructure can be removed.	3 years ago
Patrick Cloke	a8db8c6eba	Remove user-visible groups/communities code (#12553) ... Makes it so that groups/communities no longer exist from a user-POV. E.g. we remove: * All API endpoints (including Client-Server, Server-Server, and admin). * Documented configuration options (and the experimental flag, which is now unused). * Special handling during room upgrades. * The `groups` section of the `/sync` response.	3 years ago
Nick Mills-Barrett	1f9013ce60	Add the `batch_send` endpoint to generic workers (#12868)	3 years ago
Nick Mills-Barrett	2e5f88b5e6	Add the `/account/whoami` endpoint to generic workers (#12866)	3 years ago
David Robertson	d38d242411	Reload cache factors from disk on SIGHUP (#12673)	3 years ago
reivilibre	699192fc1a	Add the `update_user_directory_from_worker` configuration option (superseding `update_user_directory`) to allow a generic worker to be designated as the worker to update the user directory. (#12654) ... Co-authored-by: Shay <hillerys@element.io>	3 years ago
David Robertson	fa0eab9c8e	Use `ParamSpec` in a few places (#12667)	3 years ago
reivilibre	c2d50e9f6c	Add the `notify_appservices_from_worker` configuration option (superseding `notify_appservices`) to allow a generic worker to be designated as the worker to send traffic to Application Services. (#12452)	3 years ago
David Robertson	6463244375	Remove unused `# type: ignore`s (#12531) ... Over time we've begun to use newer versions of mypy, typeshed, stub packages---and of course we've improved our own annotations. This makes some type ignore comments no longer necessary. I have removed them. There was one exception: a module that imports `select.epoll`. The ignore is redundant on Linux, but I've kept it ignored for those of us who work on the source tree using not-Linux. (#11771) I'm more interested in the config line which enforces this. I want unused ignores to be reported, because I think it's useful feedback when annotating to know when you've fixed a problem you had to previously ignore. * Installing extras before typechecking Lacking an easy way to install all extras generically, let's bite the bullet and make install the hand-maintained `all` extra before typechecking. Now that https://github.com/matrix-org/backend-meta/pull/6 is merged to the release/v1 branch.	3 years ago
Patrick Cloke	4586119f0b	Add missing type hints to config classes. (#12402)	3 years ago
reivilibre	f871222880	Move `update_client_ip` background job from the main process to the background worker. (#12251)	3 years ago
Shay	3c41d87b67	Add restrictions by default to open registration in Synapse (#12091)	3 years ago
Nick Mills-Barrett	1530cef192	Make it possible to enable compression for the metrics HTTP resource (#12258) ... * Make it possible to enable compression for the metrics HTTP resource This can provide significant bandwidth savings pulling metrics from synapse instances. * Add changelog file. * Fix type hint	3 years ago
Patrick Cloke	54f674f7a9	Deprecate the groups/communities endpoints and add an experimental configuration flag. (#12200)	3 years ago
Patrick Cloke	3e4af36bc8	Rename get_tcp_replication to get_replication_command_handler. (#12192) ... Since the object it returns is a ReplicationCommandHandler. This is clean-up from adding support to Redis where the command handler was added as an additional layer of abstraction from the TCP protocol.	3 years ago
David Robertson	313581e4e9	Use importlib.metadata to read requirements (#12088) ... * Pull runtime dep checks into their own module * Reimplement `check_requirements` using `importlib` I've tried to make this clearer. We start by working out which of Synapse's requirements we need to be installed here and now. I was surprised that there wasn't an easier way to see which packages were installed by a given extra. I've pulled out the error messages into functions that deal with "is this for an extra or not". And I've rearranged the loop over two different sets of requirements into one loop with a "must be instaled" flag. I hope you agree that this is clearer. * Test cases	3 years ago
Richard van der Hoff	e24ff8ebe3	Remove `HomeServer.get_datastore()` (#12031) ... The presence of this method was confusing, and mostly present for backwards compatibility. Let's get rid of it. Part of #11733	3 years ago
David Robertson	4ae956c8bb	Use version string helper from matrix-common (#11979) ... * Require latest matrix-common * Use the common function	3 years ago
Patrick Cloke	380c3d40f4	Return JSON errors for unknown resources under /matrix/client. (#11930) ... Re-applies the changes from 3e0cfd447e (#11602), reverting d93ec0a0ba (#11764) now that the conflict with the webclient listener was fixed in 119edf51eb (#11895).	3 years ago
Patrick Cloke	119edf51eb	Remove support for the webclient listener. (#11895) ... Also remove support for non-HTTP(S) web_client_location.	3 years ago
Shay	b8bf600700	Check that `gc` method is available before using in `synapse/app/_base` (#11816) ... * add check that gc.freeze is available before calling * newsfragment * lint * Update comment Co-authored-by: Dan Callahan <danc@element.io> Co-authored-by: Dan Callahan <danc@element.io>	3 years ago
Brendan Abolivier	1d5f7b2cc6	Log modules at startup (#11813)	3 years ago
Shay	9006ee36d1	Drop support for and remove references to EOL Python 3.6 (#11683) ... * remove reference in comments to python3.6 * upgrade tox python env in script * bump python version in example for completeness * upgrade python version requirement in setup doc * upgrade necessary python version in __init__.py * upgrade python version in setup.py * newsfragment * drops refs to bionic and replace with focal * bump refs to postgres 9.6 to 10 * fix hanging ci * try installing tzdata first * revert change made in b979f336 * ignore new random mypy error while debugging other error * fix lint error for temporary workaround * revert change to install list * try passing env var * export debian frontend var? * move line and add comment * bump pillow dependency * bump lxml depenency * install libjpeg-dev for pillow * bump automat version to one compatible with py3.8 * add libwebp for pillow * bump twisted trunk python version * change suffix of newsfragment * remove redundant python 3.7 checks * lint	3 years ago
Patrick Cloke	d09099642e	Fix redirecting to the webclient for non-HTTP(S) web_client_location. (#11783) ... To not change the behaviour during the deprecation period. Follow-up to #11774.	3 years ago
Patrick Cloke	91221b6961	Add deprecation warnings for `webclient` listener and non-HTTP(S) `web_client_location`. (#11774) ... This changes the behaviour of the root endpoint to redirect directly to the configuration of `web_client_location` if it is given an HTTP(S) URL.	3 years ago
Andrew Morgan	d93ec0a0ba	Partially revert #11602 to prevent webclient overriding client resource (#11764)	3 years ago
Richard van der Hoff	20c6d85c6e	Simplify GC prometheus metrics (#11723) ... Rather than hooking into the reactor loop, just add a timed task that runs every 100 ms to do the garbage collection. Part 1 of a quest to simplify the reactor monkey-patching.	3 years ago
Patrick Cloke	3e0cfd447e	Return JSON errors for unknown resources under /matrix/client. (#11602) ... Instead of returning 404 errors with HTML bodies when an unknown prefix was requested (e.g. /matrix/client/v1 before Synapse v1.49.0).	3 years ago
Olivier Wilkinson (reivilibre)	4dd9ea8f4f	Revert "Revert accidental fast-forward merge from v1.49.0rc1" ... This reverts commit 158d73ebdd.	3 years ago
Sean Quah	158d73ebdd	Revert accidental fast-forward merge from v1.49.0rc1 ... Revert "Sort internal changes in changelog" Revert "Update CHANGES.md" Revert "1.49.0rc1" Revert "Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505) (#11527)" Revert "Refactors in `_generate_sync_entry_for_rooms` (#11515)" Revert "Correctly register shutdown handler for presence workers (#11518)" Revert "Fix `ModuleApi.looping_background_call` for non-async functions (#11524)" Revert "Fix 'delete room' admin api to work on incomplete rooms (#11523)" Revert "Correctly ignore invites from ignored users (#11511)" Revert "Fix the test breakage introduced by #11435 as a result of concurrent PRs (#11522)" Revert "Stabilise support for MSC2918 refresh tokens as they have now been merged into the Matrix specification. (#11435)" Revert "Save the OIDC session ID (sid) with the device on login (#11482)" Revert "Add admin API to get some information about federation status (#11407)" Revert "Include bundled aggregations in /sync and related fixes (#11478)" Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505)" Revert "Update backward extremity docs to make it clear that it does not indicate whether we have fetched an events' `prev_events` (#11469)" Revert "Support configuring the lifetime of non-refreshable access tokens separately to refreshable access tokens. (#11445)" Revert "Add type hints to `synapse/tests/rest/admin` (#11501)" Revert "Revert accidental commits to develop." Revert "Newsfile" Revert "Give `tests.server.setup_test_homeserver` (nominally!) the same behaviour" Revert "Move `tests.utils.setup_test_homeserver` to `tests.server`" Revert "Convert one of the `setup_test_homeserver`s to `make_test_homeserver_synchronous`" Revert "Disambiguate queries on `state_key` (#11497)" Revert "Comments on the /sync tentacles (#11494)" Revert "Clean up tests.storage.test_appservice (#11492)" Revert "Clean up `tests.storage.test_main` to remove use of legacy code. (#11493)" Revert "Clean up `tests.test_visibility` to remove legacy code. (#11495)" Revert "Minor cleanup on recently ported doc pages (#11466)" Revert "Add most of the missing type hints to `synapse.federation`. (#11483)" Revert "Avoid waiting for zombie processes in `synctl stop` (#11490)" Revert "Fix media repository failing when media store path contains symlinks (#11446)" Revert "Add type annotations to `tests.storage.test_appservice`. (#11488)" Revert "`scripts-dev/sign_json`: support for signing events (#11486)" Revert "Add MSC3030 experimental client and federation API endpoints to get the closest event to a given timestamp (#9445)" Revert "Port wiki pages to documentation website (#11402)" Revert "Add a license header and comment. (#11479)" Revert "Clean-up get_version_string (#11468)" Revert "Link background update controller docs to summary (#11475)" Revert "Additional type hints for config module. (#11465)" Revert "Register the login redirect endpoint for v3. (#11451)" Revert "Update openid.md" Revert "Remove mention of OIDC certification from Dex (#11470)" Revert "Add a note about huge pages to our Postgres doc (#11467)" Revert "Don't start Synapse master process if `worker_app` is set (#11416)" Revert "Expose worker & homeserver as entrypoints in `setup.py` (#11449)" Revert "Bundle relations of relations into the `/relations` result. (#11284)" Revert "Fix `LruCache` corruption bug with a `size_callback` that can return 0 (#11454)" Revert "Eliminate a few `Any`s in `LruCache` type hints (#11453)" Revert "Remove unnecessary `json.dumps` from `tests.rest.admin` (#11461)" Revert "Merge branch 'master' into develop" This reverts commit 26b5d2320f. This reverts commit bce4220f38. This reverts commit 966b5d0fa0. This reverts commit 088d748f2c. This reverts commit 14d593f72d. This reverts commit 2a3ec6facf. This reverts commit eccc49d755. This reverts commit b1ecd19c5d. This reverts commit 9c55dedc8c. This reverts commit 2d42e586a8. This reverts commit 2f053f3f82. This reverts commit a15a893df8. This reverts commit 8b4b153c9e. This reverts commit 494ebd7347. This reverts commit a77c369897. This reverts commit 4eb77965cd. This reverts commit 637df95de6. This reverts commit e5f426cd54. This reverts commit 8cd68b8102. This reverts commit 6cae125e20. This reverts commit 7be88fbf48. This reverts commit b3fd99b74a. This reverts commit f7ec6e7d9e. This reverts commit 5640992d17. This reverts commit d26808dd85. This reverts commit f91624a595. This reverts commit 16d39a5490. This reverts commit 8a4c296987. This reverts commit 49e1356ee3. This reverts commit d2279f471b. This reverts commit b50e39df57. This reverts commit 858d80bf0f. This reverts commit 435f044807. This reverts commit f61462e1be. This reverts commit a6f1a3abec. This reverts commit 84dc50e160. This reverts commit ed635d3285. This reverts commit 7b62791e00. This reverts commit 153194c771. This reverts commit f44d729d4c. This reverts commit a265fbd397. This reverts commit b9fef1a7cd. This reverts commit b0eb64ff7b. This reverts commit f1795463bf. This reverts commit 70cbb1a5e3. This reverts commit 42bf020463. This reverts commit 379f2650cf. This reverts commit 7ff22d6da4. This reverts commit 5a0b652d36. This reverts commit 432a174bc1. This reverts commit b14f8a1baf, reversing changes made to e713855dca.	3 years ago
Patrick Cloke	f44d729d4c	Additional type hints for config module. (#11465) ... This adds some misc. type hints to helper methods used in the `synapse.config` module.	3 years ago
Shay	70cbb1a5e3	Don't start Synapse master process if `worker_app` is set (#11416) ... * Add check to catch syanpse master process starting when workers are configured * add test to verify that starting master process with worker config raises error * newsfragment * specify config.worker.worker_app in check * update test * report specific config option that triggered the error Co-authored-by: reivilibre <oliverw@matrix.org> * clarify error message Co-authored-by: reivilibre <oliverw@matrix.org> Co-authored-by: reivilibre <oliverw@matrix.org>	3 years ago
Maximilian Bosch	42bf020463	Expose worker & homeserver as entrypoints in `setup.py` (#11449) ... Co-authored-by: reivilibre <oliverw@matrix.org>	3 years ago
Patrick Cloke	a4521ce0a8	Support the stable /hierarchy endpoint from MSC2946 (#11329) ... This also makes additional updates where the implementation had drifted from the approved MSC. Unstable endpoints will be removed at a later data.	3 years ago
Tulir Asokan	7b4e228e41	Fix using MSC2716 batch sending with event persistence workers (#11220) ... Signed-off-by: Tulir Asokan <tulir@beeper.com>	3 years ago
Sean Quah	84fac0f814	Add type annotations to `synapse.metrics` (#10847)	3 years ago
Aaron R	d993c3bb1e	Add support for `/_matrix/media/v3` APIs (#11371) ... * Add support for `/_matrix/media/v3` APIs Signed-off-by: Aaron Raimist <aaron@raim.ist> * Update `workers.md` to use v3 client and media APIs Signed-off-by: Aaron Raimist <aaron@raim.ist> * Add changelog Signed-off-by: Aaron Raimist <aaron@raim.ist>	3 years ago
Aaron R	dfa536490e	Add support for `/_matrix/client/v3` APIs (#11318) ... This is one of the changes required to support Matrix 1.1 Signed-off-by: Aaron Raimist <aaron@raim.ist>	3 years ago
Patrick Cloke	5cace20bf1	Add missing type hints to `synapse.app`. (#11287)	3 years ago
Richard van der Hoff	71f9966f27	Support for serving server well-known files (#11211) ... Fixes https://github.com/matrix-org/synapse/issues/8308	3 years ago
Erik Johnston	82d2168a15	Add metrics to the threadpools (#11178)	3 years ago
Rafael Gonçalves	0e16b418f6	Add knock information in admin exported data (#11171) ... Signed-off-by: Rafael Goncalves <rafaelgoncalves@riseup.net>	3 years ago
Sean Quah	f3a4be8700	Shut down the DNS threadpool (#11190) ... The DNS threadpool must be explicitly stopped, otherwise Synapse will hang indefinitely when asked to shut down.	3 years ago
Erik Johnston	7004f43da1	Move DNS lookups into separate thread pool (#11177) ... This is to stop large bursts of lookups starving out other users of the thread pools. Fixes #11049.	3 years ago
Sean Quah	2b82ec425f	Add type hints for most `HomeServer` parameters (#11095)	3 years ago
Hillery Shay	7d70582eb0	Fix broken export-data admin command and add a test for it to CI (#11078) ... Fix broken export-data admin command and add a test for it to CI	3 years ago
Azrenbeth	cdd308845b	Port the Password Auth Providers module interface to the new generic interface (#10548) ... Co-authored-by: Azrenbeth <7782548+Azrenbeth@users.noreply.github.com> Co-authored-by: Brendan Abolivier <babolivier@matrix.org>	3 years ago
Patrick Cloke	f4b1a9a527	Require direct references to configuration variables. (#10985) ... This removes the magic allowing accessing configurable variables directly from the config object. It is now required that a specific configuration class is used (e.g. `config.foo` must be replaced with `config.server.foo`).	3 years ago
Patrick Cloke	94b620a5ed	Use direct references for configuration variables (part 6). (#10916)	3 years ago
Patrick Cloke	bb7fdd821b	Use direct references for configuration variables (part 5). (#10897)	3 years ago