watcha-synapse

Commit Graph

Author	SHA1	Message	Date
kegsay	0c55c76da8	Better complement docs (#16946 )	2 years ago
Erik Johnston	930dc9e2d3	Fix typo	2 years ago
Erik Johnston	8613f7693e	More renaming	2 years ago
kegsay	11a8ae0632	complement: enable dirty runs (#16520 ) * complement: enable dirty runs * Add changelog * Set a low connpool limit when running in Complement Dirty runs can cause many containers to be running concurrently, which seems to easily exhaust resources on the host. The increased speedup from dirty runs also seems to use more db connections on workers, which are misconfigured currently to have `SUM(workers * cp_max) > max_connections`, causing ``` FATAL: sorry, too many clients already ``` which results in tests failing. * Try p=2 concurrency to restrict slowness of servers which causes partial state join tests to flake * Debug logging * Only run flakey tests * Only adjust connection pool limits in worker mode * Move cp vars to somewhere where they get executed in CI * Move cp values back to where they actually work * Debug logging * Try p=1 to see if this makes worker mode happier * Remove debug logging	2 years ago
Erik Johnston	3cf1a3aa17	Use bookwork as docker base image (#16324 )	2 years ago
Eric Eastwood	0f02f0b4da	Remove experimental MSC2716 implementation to incrementally import history into existing rooms (#15748 ) Context for why we're removing the implementation: - https://github.com/matrix-org/matrix-spec-proposals/pull/2716#issuecomment-1487441010 - https://github.com/matrix-org/matrix-spec-proposals/pull/2716#issuecomment-1504262734 Anyone wanting to continue MSC2716, should also address these leftover tasks: https://github.com/matrix-org/synapse/issues/10737 Closes https://github.com/matrix-org/synapse/issues/10737 in the fact that it is not longer necessary to track those things.	3 years ago
Jason Little	874378c052	Docker fully qualified image names (#15689 ) * Fully qualified docker image names for the main Dockerfile and Complement related. * Fully qualified docker image names for Dockerfiles associated with building Debian release artifacts. This one is harder and is separate from the other commit in case it wasn't correct or was unwanted. I decided to do the expansion on the docker images in the Dockerfile itself, instead of the various source places that build which distribution that is selected, as it would have been more invasive with the scripts breaking up the string for tagging and such. This one is untested. * Changelog * Update docker/Dockerfile-workers * Update docker/complement/Dockerfile --------- Co-authored-by: reivilibre <olivier@librepush.net>	3 years ago
Jason Little	003a25ae5c	Additional functionality for declaring worker types in Complement (#14921 ) Co-authored-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>	3 years ago
realtyem	58214dbb9b	Allow enabling the asyncio reactor in complement (#14858 ) Signed-off-by: Jason Little realtyem@gmail.com	3 years ago
reivilibre	22cc93afe3	Enable Faster Remote Room Joins against worker-mode Synapse. (#14752 ) * Enable Complement tests for Faster Remote Room Joins on worker-mode * (dangerous) Add an override to allow Complement to use FRRJ under workers * Newsfile Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> * Fix race where we didn't send out replication notification * MORE HACKS * Fix get_un_partial_stated_rooms_token to take instance_name * Fix bad merge * Remove warning * Correctly advance un_partial_stated_room_stream * Fix merge * Add another notify_replication * Fixups * Create a separate ReplicationNotifier * Fix test * Fix portdb * Create a separate ReplicationNotifier * Fix test * Fix portdb * Fix presence test * Newsfile * Apply suggestions from code review * Update changelog.d/14752.misc Co-authored-by: Erik Johnston <erik@matrix.org> * lint Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> Co-authored-by: Erik Johnston <erik@matrix.org>	3 years ago
Andrew Morgan	a7b54ca8d8	Implement MSC3930: polls push rules (#14787 )	3 years ago
David Robertson	5b3af1c7d0	Stabilise serving partial join responses (#14839 ) Serving partial join responses is no longer experimental. They will only be served under the stable identifier if the the undocumented config flag experimental.msc3706_enabled is set to true. Synapse continues to request a partial join only if the undocumented config flag experimental.faster_joins is set to true; this setting remains present and unaffected.	3 years ago
Andrew Morgan	54cd90ea60	Implement MSC3890: Remotely silence local notifications (#14775 )	3 years ago
Andrew Morgan	c4456114e1	Add experimental support for MSC3391: deleting account data (#14714 )	3 years ago
reivilibre	be3a8a85e3	Add `--editable` flag to `complement.sh` which uses an editable install of Synapse for faster turn-around times whilst developing iteratively. (#14548 ) Co-authored-by: Mathieu Velten <mathieuv@matrix.org>	3 years ago
Eric Eastwood	8f10c8b054	Move MSC3030 `/timestamp_to_event` endpoint to stable v1 location (#14471 ) Fix https://github.com/matrix-org/synapse/issues/14390 - Client API: `/_matrix/client/unstable/org.matrix.msc3030/rooms/<roomID>/timestamp_to_event?ts=<timestamp>&dir=<direction>` -> `/_matrix/client/v1/rooms/<roomID>/timestamp_to_event?ts=<timestamp>&dir=<direction>` - Federation API: `/_matrix/federation/unstable/org.matrix.msc3030/timestamp_to_event/<roomID>?ts=<timestamp>&dir=<direction>` -> `/_matrix/federation/v1/timestamp_to_event/<roomID>?ts=<timestamp>&dir=<direction>` Complement test changes: https://github.com/matrix-org/complement/pull/559	3 years ago
realtyem	69814eb282	Allow override for requesting specific worker types for Complement on command line. (#14324 ) * Expose getting SYNAPSE_WORKER_TYPES from external, allowing override of workers requested. * Add WORKER_TYPES variable option to complement.sh script that passes requested workers into start_for_complement.sh entrypoint. * Update docs to reflect this new ability. * Changelog * Don't rely on soft wrapping to format long strings Good idea dklimpel. Thanks for catching that. Co-authored-by: Dirk Klimpel <5740567+dklimpel@users.noreply.github.com> * Small nits just noticed in docs. * Fixup new line in docs. Co-authored-by: Dirk Klimpel <5740567+dklimpel@users.noreply.github.com>	3 years ago
Patrick Cloke	59ca73006c	Enable testing MSC3874 in complement. (#14339 )	3 years ago
Jonathan de Jong	e440f9674a	Enable URL previews in complement homeserver config. (#14198 )	3 years ago
Patrick Cloke	c604d2c218	Mark /relations endpoint as usable on workers. (#14028 ) Co-authored-by: Eric Eastwood <erice@element.io>	3 years ago
Mathieu Velten	42dd992bb7	Dockerfile for tests: align comments with current behavior (#13867 ) Signed-off-by: Mathieu Velten <mathieuv@matrix.org> Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	3 years ago
Mathieu Velten	384dca53d6	complement: init postgres DB directly inside the target image (#13819 ) Doing so in the base postgres image doesn't work with buildah because changes in a declared VOLUME in the Dockerfile is supposed to be discarded, cf https://docs.docker.com/engine/reference/builder/#volume Signed-off-by: Mathieu Velten <mathieuv@matrix.org>	3 years ago
Brendan Abolivier	10e4093839	Call out buildkit is required when building test docker images (#13338 ) Co-authored-by: David Robertson <davidr@element.io>	3 years ago
David Robertson	b977867358	Rate limit joins per-room (#13276 )	3 years ago
Richard van der Hoff	512486bbeb	Docker: copy postgres from base image (#13279 ) When building the docker images for complement testing, copy a preinstalled complement over from a base image, rather than apt installing it. This avoids network traffic and is much faster.	4 years ago
Till	fa10468eb4	[Complement] Allow device_name lookup over federation (#13167 )	4 years ago
reivilibre	9667bad55d	Improve startup times in Complement test runs against workers, particularly in CPU-constrained environments. (#13127 ) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	4 years ago
reivilibre	90cadcd403	Add a Subject Alternative Name to the certificate generated for Complement tests. (#13071 )	4 years ago
Richard van der Hoff	1e0044e8f9	Complement: use SQLite by default (#13075 ) If no database is configured explicitly, use sqlite. This means that you don't have to pass any variables into the image.	4 years ago
Erik Johnston	c95b04bb0e	Change default `sync_response_cache_duration` (#13042 )	4 years ago
reivilibre	538044ac01	Collapse Docker build commands in Complement CI runs to make the logs easier to read. (#13058 )	4 years ago
reivilibre	67f51c84f8	Merge the Complement testing Docker images into a single, multi-purpose image. (#12881 ) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	4 years ago
reivilibre	67aae05ece	Support registering Application Services when running with workers under Complement. (#12826 ) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	4 years ago
reivilibre	438925c422	Fix Complement `TestCanRegisterAdmin` with workers, by adding Complement's shared registration secret. (#12819 )	4 years ago
reivilibre	4fef76ca34	Remove Caddy from the Synapse workers image used in Complement. (#12818 )	4 years ago
Till	e8ae472d3b	Update configs used by Complement to allow more invites (#12731 )	4 years ago
reivilibre	d743b25c8f	Use supervisord to supervise Postgres and Caddy in the Complement image. (#12480 ) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	4 years ago
Richard van der Hoff	f5668f0b4a	Await un-partial-stating after a partial-state join (#12399 ) When we join a room via the faster-joins mechanism, we end up with "partial state" at some points on the event DAG. Many parts of the codebase need to wait for the full state to load. So, we implement a mechanism to keep track of which events have partial state, and wait for them to be fully-populated.	4 years ago
Richard van der Hoff	960b4fb409	complement-synapse-workers: factor out separate entry point script (#12467 ) ... with a bit more verbosity.	4 years ago
Richard van der Hoff	214f3b7d21	Enable certificate checking during complement tests (#12435 )	4 years ago
Richard van der Hoff	5f72ea1bde	Move complement setup stuff into the Synapse repo (#12404 ) Fixes matrix-org/complement#330 (or it will, once we remove the old files). It's not quite a lift-and-shift: I've also taken the opportunity to get rid of the custom CA that we used to use to sign the TLS certs, which has been superceded by the CA exposed by Complement.	4 years ago

41 Commits (watcha-develop)