watcha-synapse

Commit Graph

Author	SHA1	Message	Date
Richard van der Hoff	8af8a9bce5	Dockerfile-workers: give the master its own log config (#12466 ) When we run a worker-mode synapse under docker, everything gets logged to stdout. Currently, output from the workers is tacked with a worker name, for example: ``` 2022-04-13 15:27:56,810 - worker:frontend_proxy1 - synapse.util.caches.lrucache - 154 - INFO - LruCache._expire_old_entries-0 - Dropped 0 items from caches ``` - note `worker:frontend_proxy1`. No such tag is applied to log lines from the master, which makes somewhat confusing reading. To fix this, we generate a dedicated log config file for the master in the same way that we do for the workers, and use that.	3 years ago
Shay	8e2759f2d8	Limit `device_id` size to 512B (#12454 ) *	3 years ago
Andrew Morgan	0922462fc7	docs: Don't render the table of contents on the print page (#12340 )	3 years ago
David Baker	73d8ded0b0	Prevent a sync request from removing a user's busy presence status (#12213 ) In trying to use the MSC3026 busy presence status, the user's status would be set back to 'online' next time they synced. This change makes it so that syncing does not affect a user's presence status if it is currently set to 'busy': it must be removed through the presence API. The MSC defers to implementations on the behaviour of busy presence, so this ought to remain compatible with the MSC.	3 years ago
Nick Mills-Barrett	e3a49f4784	Fix missing sync events during historical batch imports (#12319 ) Discovered after much in-depth investigation in #12281. Closes: #12281 Closes: #3305 Signed off by: Nick Mills-Barrett nick@beeper.com	3 years ago
David Robertson	d24cd17820	Use poetry lockfile in twisted trunk CI job (#12425 ) Fixes #12458 Co-authored-by: Sean Quah <seanq@element.io> Co-authored-by: Dan Callahan <danc@element.io>	3 years ago
Jonathan de Jong	36d8b83888	Rename Mutual Rooms `unstable_features` flag to match MSC (#12445 ) Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>	3 years ago
Shay	32545d2e26	Bump twisted version to the latest in lockfile (#12441 )	3 years ago
David Robertson	5a275a2377	Run "main" trial tests under poetry (#12438 ) * Run "main" trial tests under poetry Olddeps and twisted trunk tests are handled in separate PRs. The PyPy config is a best-effort only; it's completely untested. Pulled out from #12337. * Changelog	3 years ago
David Robertson	58c657322a	Run lints under poetry in CI; remove lint tox jobs (#12434 ) Co-authored-by: Dan Callahan <danc@element.io>	3 years ago
Erik Johnston	aa28110264	Process device list updates asynchronously (#12365 )	3 years ago
Patrick Cloke	4bdbebccb9	Remove the unstable event field for `/send_join` per MSC3083. (#12395 ) This was missed when initially stabilising room version 8 and was left in as a compatibility shim. Most homeservers have upgraded to a version which expects the proper field name, and the failure mode is reasonable (a user on an older server may have to attempt joining the room twice with an obscure error message the first time).	3 years ago
Erik Johnston	ba1588461b	Fix typos in release script docs (#12450 )	3 years ago
Erik Johnston	a468768104	Merge branch 'release-v1.57' into develop	3 years ago
Patrick Cloke	9535fd0f9c	Disable groups/communities by default. (#12344 ) This disables the endpoints (and sync response fields) for groups/communities by default.	3 years ago
Erik Johnston	9b1f360091	Update changelog	3 years ago
Richard van der Hoff	643c0c50c1	Update UPGRADE notes to include more details about v1.57 upgrade failure mode (#12448 )	3 years ago
Richard van der Hoff	320186319a	Resync state after partial-state join (#12394 ) We work through all the events with partial state, updating the state at each of them. Once it's done, we recalculate the state for the whole room, and then mark the room as having complete state.	3 years ago
Erik Johnston	e31d06f6f0	Split changelogs by year	3 years ago
Patrick Cloke	86cf6a3a17	Remove references to unstable identifiers from MSC3440. (#12382 ) Removes references to unstable thread relation, unstable identifiers for filtering parameters, and the experimental config flag.	3 years ago
Erik Johnston	3810730ba5	Don't line wrap	3 years ago
Erik Johnston	641f43ba81	1.57.0rc1	3 years ago
Dirk Klimpel	1783156dbc	Add some type hints to datastore (#12423 ) * Add some type hints to datastore * newsfile * change `Collection` to `List` * refactor return type of `select_users_txn` * correct type hint in `stream.py` * Remove `Optional` in `select_users_txn` * remove not needed return type in `__init__` * Revert change in `get_stream_id_for_event_txn` * Remove import from `Literal`	3 years ago
David Robertson	4e13743738	Poetry: select olddeps using `poetry` (#12407 ) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	3 years ago
Erik Johnston	3ad74b63e5	Specify tls extra for Twisted dependency. (#12444 ) * Specify `tls` extra for Twisted dependency. It was already pulled in for us by `treq`, but we should be explicit that we do use the `tls` functionality of Twisted directly. * Mark `idna` as dev-dependency This doesn't actually change anything, as `Twisted[tls]` will put it in as a main dependency anyway.	3 years ago
David Robertson	5f8173dd80	Workaround pip bug installing latest treq and not-latest twisted from hashes (#12439 ) The requirements file generated by `poetry export` isn't correctly processed by `pip install -r requirements.txt`. It contains twisted and treq, both pinned to 22.2.0. When `pip` installs treq, it notices that `Twisted[tls]` is required. It then tries to acquire the latest twisted release, only to fail (because this hash isn't listed in the requirements file).From e.g. https://github.com/matrix-org/synapse/runs/5977154990?check_suite_focus=true > ``` > #15 9.204 Collecting Twisted[tls]>=18.7.0 > #15 9.205 ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==. These do not: > #15 9.205 Twisted[tls]>=18.7.0 from `38622ff95b`e907db1987c4d92edd09/Twisted-22.4.0-py3-none-any.whl#sha256=f9f7a91f94932477a9fc3b169d57f54f96c6e74a23d78d9ce54039a7f48928a2 (from treq==22.2.0->-r /synapse/requirements.txt (line 724)) > #15 ERROR: executor failed running [/bin/sh -c pip install --prefix="/install" --no-warn-script-location -r /synapse/requirements.txt]: exit code: 1 > ``` The underlying pip issue is https://github.com/pypa/pip/issues/9644. A comment notes that one can avoid this behaviour with by `pip install`ing with the `--no-deps` flag. Let us do so. (At first glance, the problem looks like https://github.com/python-poetry/poetry/issues/5311, but that was a bug in `poetry install`; this is `poetry export`, whose behaviour is fine AFAICS).	3 years ago
Patrick Cloke	ab3165efb7	Remove experimental configuration flag for MSC3666. (#12436 )	3 years ago
Patrick Cloke	4586119f0b	Add missing type hints to config classes. (#12402 )	3 years ago
Richard van der Hoff	214f3b7d21	Enable certificate checking during complement tests (#12435 )	3 years ago
Patrick Cloke	772bad2562	Do not consider events by ignored users for bundled aggregations (#12235 ) Consider the requester's ignored users when calculating the bundled aggregations. See #12285 / `4df10d3214` for corresponding changes for the `/relations` endpoint.	3 years ago
Richard van der Hoff	3cdf5a1386	Fix up healthcheck generation for workers docker image (#12405 ) This wasn't quite generating the right thing.	3 years ago
David Robertson	961ee75a9b	Disallow untyped defs in synapse._scripts (#12422 ) Of note: * No untyped defs in `register_new_matrix_user` This one might be contraversial. `request_registration` has three dependency-injection arguments used for testing. I'm removing the injection of the `requests` module and using `unitest.mock.patch` in the test cases instead. Doing `reveal_type(requests)` and `reveal_type(requests.get)` before the change: ``` synapse/_scripts/register_new_matrix_user.py:45: note: Revealed type is "Any" synapse/_scripts/register_new_matrix_user.py:46: note: Revealed type is "Any" ``` And after: ``` synapse/_scripts/register_new_matrix_user.py:44: note: Revealed type is "types.ModuleType" synapse/_scripts/register_new_matrix_user.py:45: note: Revealed type is "def (url: Union[builtins.str, builtins.bytes], params: Union[Union[_typeshed.SupportsItems[Union[builtins.str, builtins.bytes, builtins.int, builtins.float], Union[builtins.str, builtins.bytes, builtins.int, builtins.float, typing.Iterable[Union[builtins.str, builtins.bytes, builtins.int, builtins.float]], None]], Tuple[Union[builtins.str, builtins.bytes, builtins.int, builtins.float], Union[builtins.str, builtins.bytes, builtins.int, builtins.float, typing.Iterable[Union[builtins.str, builtins.bytes, builtins.int, builtins.float]], None]], typing.Iterable[Tuple[Union[builtins.str, builtins.bytes, builtins.int, builtins.float], Union[builtins.str, builtins.bytes, builtins.int, builtins.float, typing.Iterable[Union[builtins.str, builtins.bytes, builtins.int, builtins.float]], None]]], builtins.str, builtins.bytes], None] =, data: Union[Any, None] =, headers: Union[Any, None] =, cookies: Union[Any, None] =, files: Union[Any, None] =, auth: Union[Any, None] =, timeout: Union[Any, None] =, allow_redirects: builtins.bool =, proxies: Union[Any, None] =, hooks: Union[Any, None] =, stream: Union[Any, None] =, verify: Union[Any, None] =, cert: Union[Any, None] =, json: Union[Any, None] =) -> requests.models.Response" ``` * Drive-by comment in `synapse.storage.types` * No untyped defs in `synapse_port_db` This was by far the most painful. I'm happy to break this up into smaller pieces for review if it's not managable as-is.	3 years ago
Richard van der Hoff	5f72ea1bde	Move complement setup stuff into the Synapse repo (#12404 ) Fixes matrix-org/complement#330 (or it will, once we remove the old files). It's not quite a lift-and-shift: I've also taken the opportunity to get rid of the custom CA that we used to use to sign the TLS certs, which has been superceded by the CA exposed by Complement.	3 years ago
reivilibre	85ca963c1a	Add Module API for reading and writing global account data. (#12391 )	3 years ago
David Robertson	98ec375b26	CI: Fix the export-data job to run under poetry (#12418 ) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	3 years ago
reivilibre	e630722f11	Optimise `_update_client_ips_batch_txn` to batch together database operations. (#12252 ) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	3 years ago
David Robertson	0cd182f296	Make `synapse._scripts` pass typechecks (#12421 )	3 years ago
David Robertson	dd5cc37aa4	Stop maintaining a list of lint targets in `lint.sh` (#12420 )	3 years ago
David Robertson	95a038c106	Unify HTTP query parameter type hints (#12415 ) * Pull out query param types to `synapse.http.types` * Use QueryParams everywhere * Simplify `encode_query_args` * Add annotation which would have caught #12410	3 years ago
Jorge Florian	2e2d8cc2f9	Update the server notices user profile in room if changed. (#12115 )	3 years ago
David Robertson	7851a2c62f	CI: Get the portdb job to run under poetry (#12412 )	3 years ago
Jorge Florian	78e4d96a4d	Add missing type definitions for scripts in docker folder (#12280 ) Signed-off-by: Jorge Florian <jafn28@gmail.com>	3 years ago
Erik Johnston	7732c4902c	Fix rejecting invites over federation (#12409 ) Currently causes future incremental syncs to fail. Broke by #12191	3 years ago
Erik Johnston	36af768c13	Fix fetching public rooms over federation (#12410 ) Broke by #12364	3 years ago
Patrick Cloke	1a90c1e3af	Do not add groups to sync results if disabled. (#12408 )	3 years ago
Erik Johnston	d1cd96ce29	Add opentracing spans to calls to external cache (#12380 )	3 years ago
David Robertson	3a7e97c7ad	Poetry: use locked environment in Docker images (#12385 )	3 years ago
Patrick Cloke	0bcb651b3f	Support the v1 endpoint for `/relations`. (#12403 ) Now that MSC2675 has passed FCP and the implementation is compliant with the final version.	3 years ago
Eric Eastwood	350062661c	Clarify that we mark as outliers because we don't have any state for them (#12345 ) As discussed at https://github.com/matrix-org/synapse/pull/12179#discussion_r837263852	3 years ago
Eric Eastwood	f931c0602a	Update changelog to describe changes from #12370 relative to `develop` (#12401 )	3 years ago

... 3 4 5 6 7 ...

20709 Commits (24b590de32154eb3965220bd62715e52b37b4074) All Branches Search

20709 Commits (24b590de32154eb3965220bd62715e52b37b4074)

All Branches