watcha-synapse

Commit Graph

Author	SHA1	Message	Date
Patrick Cloke	f3fba4914d	Reduce the number of tests using TCP replication. (#13543 ) Uses Redis replication in additional test cases (instead of TCP replication). A small step towards dropping TCP replication.	3 years ago
reivilibre	177b884ad7	Lay some foundation work to allow workers to only subscribe to some kinds of messages, reducing replication traffic. (#12672 )	3 years ago
Patrick Cloke	7fbf42499d	Use `getClientAddress` instead of `getClientIP`. (#12599 ) getClientIP was deprecated in Twisted 18.4.0, which also added getClientAddress. The Synapse minimum version for Twisted is currently 18.9.0, so all supported versions have the new API.	3 years ago
David Robertson	a7293ef16f	Bump `black` and `click` versions (#12320 )	3 years ago
David Robertson	a2b00a4486	Bump `black` and `click` versions (#12320 )	3 years ago
Patrick Cloke	3e4af36bc8	Rename get_tcp_replication to get_replication_command_handler. (#12192 ) Since the object it returns is a ReplicationCommandHandler. This is clean-up from adding support to Redis where the command handler was added as an additional layer of abstraction from the TCP protocol.	3 years ago
Richard van der Hoff	e24ff8ebe3	Remove `HomeServer.get_datastore()` (#12031 ) The presence of this method was confusing, and mostly present for backwards compatibility. Let's get rid of it. Part of #11733	3 years ago
Patrick Cloke	d0e78af35e	Add missing type hints to synapse.replication. (#11938 )	3 years ago
David Robertson	4c96ce396e	Misc typing fixes for `tests`, part 1 of N (#11323 ) * Annotate HomeserverTestCase.servlets * Correct annotation of federation_auth_origin * Use AnyStr custom_headers instead of a Union This allows (str, str) and (bytes, bytes). This disallows (str, bytes) and (bytes, str) * DomainSpecificString.SIGIL is a ClassVar	3 years ago
David Robertson	e46ac85d67	type-hint `HomeserverTestcase.setup_test_homeserver` (#10961 ) * type-hint `HomeserverTestcase.setup_test_homeserver` For better IDE completion. A small drive-by.	3 years ago
David Robertson	29364145b2	Pass str to twisted's IReactorTCP (#10895 ) This follows a correction made in twisted/twisted#1664 and should fix our Twisted Trial CI job. Until that change is in a twisted release, we'll have to ignore the type of the `host` argument. I've raised #10899 to remind us to review the issue in a few months' time.	3 years ago
Patrick Cloke	47854c71e9	Use direct references for configuration variables (part 4). (#10893 )	3 years ago
Jonathan de Jong	93729719b8	Use inline type hints in `tests/` (#10350 ) This PR is tantamount to running: python3.8 -m com2ann -v 6 tests/ (com2ann requires python 3.8 to run)	4 years ago
Jonathan de Jong	89cfc3dd98	[pyupgrade] `tests/` (#10347 )	4 years ago
Richard van der Hoff	3ff2251754	Improved validation for received requests (#9817 ) * Simplify `start_listening` callpath * Correctly check the size of uploaded files	4 years ago
Richard van der Hoff	84936e2264	Kill off `_PushHTTPChannel`. (#9878 ) First of all, a fixup to `FakeChannel` which is needed to make it work with the default HTTP channel implementation. Secondly, it looks like we no longer need `_PushHTTPChannel`, because as of #8013, the producer that gets attached to the `HTTPChannel` is now an `IPushProducer`. This is good, because it means we can remove a whole load of test-specific boilerplate which causes variation between tests and production.	4 years ago
Richard van der Hoff	59d24c5bef	pass a reactor into SynapseSite (#9874 )	4 years ago
Erik Johnston	00a6db9676	Move some replication processing out of generic_worker (#9796 ) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	4 years ago
Jonathan de Jong	4b965c862d	Remove redundant "coding: utf-8" lines (#9786 ) Part of #9744 Removes all redundant `# -- coding: utf-8 --` lines from files, as python 3 automatically reads source code as utf-8 now. `Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>`	4 years ago
Jonathan de Jong	2ca4e349e9	Bugbear: Add Mutable Parameter fixes (#9682 ) Part of #9366 Adds in fixes for B006 and B008, both relating to mutable parameter lint errors. Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>	4 years ago
Andrew Morgan	5fdff97719	Fix CI by ignore type for None module import (#9709 )	4 years ago
Patrick Cloke	d29b71aa50	Fix remaining mypy issues due to Twisted upgrade. (#9608 )	4 years ago
Patrick Cloke	7fdc6cefb3	Fix additional type hints. (#9543 ) Type hint fixes due to Twisted 21.2.0 adding type hints.	4 years ago
Eric Eastwood	0a00b7ff14	Update black, and run auto formatting over the codebase (#9381 ) - Update black version to the latest - Run black auto formatting over the codebase - Run autoformatting according to [`docs/code_style.md `](`80d6dc9783/docs/code_style.md`) - Update `code_style.md` docs around installing black to use the correct version	4 years ago
Erik Johnston	dd8da8c5f6	Precompute joined hosts and store in Redis (#9198 )	4 years ago
Richard van der Hoff	7ea85302f3	fix up various test cases A few test cases were relying on being able to mount non-client servlets on the test resource. it's better to give them their own Resources.	4 years ago
Patrick Cloke	30fba62108	Apply an IP range blacklist to push and key revocation requests. (#8821 ) Replaces the `federation_ip_range_blacklist` configuration setting with an `ip_range_blacklist` setting with wider scope. It now applies to: * Federation * Identity servers * Push notifications * Checking key validitity for third-party invite events The old `federation_ip_range_blacklist` setting is still honored if present, but with reduced scope (it only applies to federation and identity servers).	4 years ago
Jonathan de Jong	ca60822b34	Simplify the way the `HomeServer` object caches its internal attributes. (#8565 ) Changes `@cache_in_self` to use underscore-prefixed attributes.	4 years ago
Richard van der Hoff	be8fa65d0b	Remove redundant calls to `render()`	4 years ago
Richard van der Hoff	791d7cd6f0	Rename `create_test_json_resource` to `create_test_resource` (#8759 ) The root resource isn't necessarily a JsonResource, so rename this method accordingly, and update a couple of test classes to use the method rather than directly manipulating self.resource.	4 years ago
Erik Johnston	9a7e0d2ea6	Don't require hiredis to run unit tests (#8680 )	4 years ago
Dan Callahan	aff1eb7c67	Tell Black to format code for Python 3.5 (#8664 ) This allows trailing commas in multi-line arg lists. Minor, but we might as well keep our formatting current with regard to our minimum supported Python version. Signed-off-by: Dan Callahan <danc@element.io>	4 years ago
Jonathan de Jong	6b5a115c0a	Solidify the HomeServer constructor. (#8515 ) This implements a more standard API for instantiating a homeserver and moves some of the dependency injection into the test suite. More concretely this stops using `setattr` on all `kwargs` passed to `HomeServer`.	4 years ago
Erik Johnston	6c5d5e507e	Add unit test for event persister sharding (#8433 )	4 years ago
Erik Johnston	a7bdf98d01	Rename database classes to make some sense (#8033 )	5 years ago
Erik Johnston	f13061d515	Fix client reader sharding tests (#7853 ) * Fix client reader sharding tests * Newsfile * Fix typing * Update changelog.d/7853.misc Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com> * Move mocking of http_client to tests Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	5 years ago
Erik Johnston	18c1e52d82	Clean up replication unit tests. (#7490 )	5 years ago
Richard van der Hoff	d5aa7d93ed	Fix catchup-on-reconnect for the Federation Stream (#7374 ) looks like we managed to break this during the refactorathon.	5 years ago
Erik Johnston	0e719f2398	Thread through instance name to replication client. (#7369 ) For in memory streams when fetching updates on workers we need to query the source of the stream, which currently is hard coded to be master. This PR threads through the source instance we received via `POSITION` through to the update function in each stream, which can then be passed to the replication client for in memory streams.	5 years ago
Erik Johnston	3085cde577	Use `stream.current_token()` and remove `stream_positions()` (#7172 ) We move the processing of typing and federation replication traffic into their handlers so that `Stream.current_token()` points to a valid token. This allows us to remove `get_streams_to_replicate()` and `stream_positions()`.	5 years ago
Richard van der Hoff	c2e1a2110f	Fix limit logic for EventsStream (#7358 ) * Factor out functions for injecting events into database I want to add some more flexibility to the tools for injecting events into the database, and I don't want to clutter up HomeserverTestCase with them, so let's factor them out to a new file. * Rework TestReplicationDataHandler This wasn't very easy to work with: the mock wrapping was largely superfluous, and it's useful to be able to inspect the received rows, and clear out the received list. * Fix AssertionErrors being thrown by EventsStream Part of the problem was that there was an off-by-one error in the assertion, but also the limit logic was too simple. Fix it all up and add some tests.	5 years ago
Erik Johnston	fce663889b	Add some replication tests (#7278 ) Specifically some tests for the typing stream, which means we test streams that fetch missing updates via HTTP (rather than via the DB). We also shuffle things around a bit so that we create two separate `HomeServer` objects, rather than trying to insert a slaved store into places. Note: `test_typing.py` is heavily inspired by `test_receipts.py`	5 years ago
Erik Johnston	5016b162fc	Move client command handling out of TCP protocol (#7185 ) The aim here is to move the command handling out of the TCP protocol classes and to also merge the client and server command handling (so that we can reuse them for redis protocol). This PR simply moves the client paths to the new `ReplicationCommandHandler`, a future PR will move the server paths too.	5 years ago
Erik Johnston	4cff617df1	Move catchup of replication streams to worker. (#7024 ) This changes the replication protocol so that the server does not send down `RDATA` for rows that happened before the client connected. Instead, the server will send a `POSITION` and clients then query the database (or master out of band) to get up to date.	5 years ago
Erik Johnston	48c3a96886	Port synapse.replication.tcp to async/await (#6666 ) * Port synapse.replication.tcp to async/await * Newsfile * Correctly document type of on_<FOO> functions as async * Don't be overenthusiastic with the asyncing....	5 years ago
Amber Brown	0f87b912ab	Implementation of MSC2314 (#6176 )	5 years ago
Amber Brown	b36c82576e	Run Black on the tests again (#5170 )	6 years ago
Richard van der Hoff	9bde730ef8	Fix bug where read-receipts lost their timestamps (#4927 ) Make sure that they are sent correctly over the replication stream. Fixes: #4898	6 years ago

37 Commits (04d7f56f53d7d5530ce7470bc51fcf0b43facf85)