watcha-synapse

Commit Graph

Author	SHA1	Message	Date
Nick Mills-Barrett	86e366a46e	Remove old empty/redundant slaved stores. (#13349 )	2 years ago
Erik Johnston	0b87eb8e0c	Make DictionaryCache have better expiry properties (#13292 )	2 years ago
Patrick Cloke	3343035a06	Use a real room in the notification rotation tests. (#13260 ) Instead of manually inserting fake data. This fixes some issues with having to manually calculate stream orderings and other oddities.	2 years ago
Nick Mills-Barrett	cc21a431f3	Async get event cache prep (#13242 ) Some experimental prep work to enable external event caching based on #9379 & #12955. Doesn't actually move the cache at all, just lays the groundwork for async implemented caches. Signed off by Nick @ Beeper (@Fizzadar)	2 years ago
Erik Johnston	0ca4172b5d	Don't pull out state in `compute_event_context` for unconflicted state (#13267 )	2 years ago
Erik Johnston	757bc0caef	Fix notification count after a highlighted message (#13223 ) Fixes #13196 Broke by #13005	2 years ago
Petr Vaněk	bb20113c8f	Remove obsolete RoomEventsStoreTestCase (#13200 ) All tests are prefixed with `STALE_` and therefore they are silently skipped. They were moved to `STALE_` in version `v0.5.0` in commit `2fcce3b3c5` - `Remove stale tests`. Tests from `RoomEventsStoreTestCase` class are not used for last 8 years, I believe the best would be to remove them entirely. Signed-off-by: Petr Vaněk <arkamar@atlas.cz>	2 years ago
Erik Johnston	723ce73d02	Fix stuck notification counts on small servers (#13168 )	2 years ago
Erik Johnston	dbce28b2f1	Fix unread counts on large servers (#13140 )	2 years ago
Šimon Brandner	13e359aec8	Implement MSC3827: Filtering of `/publicRooms` by room type (#13031 ) Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com>	2 years ago
Erik Johnston	92a0c18ef0	Improve performance of getting unread counts in rooms (#13119 )	2 years ago
Erik Johnston	7469824d58	Fix serialization errors when rotating notifications (#13118 )	2 years ago
Patrick Cloke	d3d84685ce	Add type hints to event push actions tests. (#13099 )	2 years ago
Erik Johnston	0d1d3e0708	Speed up `get_unread_event_push_actions_by_room` (#13005 ) Fixes #11887 hopefully. The core change here is that `event_push_summary` now holds a summary of counts up until a much more recent point, meaning that the range of rows we need to count in `event_push_actions` is much smaller. This needs two major changes: 1. When we get a receipt we need to recalculate `event_push_summary` rather than just delete it 2. The logic for deleting `event_push_actions` is now divorced from calculating `event_push_summary`. In future it would be good to calculate `event_push_summary` while we persist a new event (it should just be a case of adding one to the relevant rows in `event_push_summary`), as that will further simplify the get counts logic and remove the need for us to periodically update `event_push_summary` in a background job.	2 years ago
Erik Johnston	e3163e2e11	Reduce the amount of state we pull from the DB (#12811 )	3 years ago
Erik Johnston	888a29f412	Wait for lazy join to complete when getting current state (#12872 )	3 years ago
Patrick Cloke	7bc08f3201	Remove remaining bits of groups code. (#12936 ) * Update worker docs to remove group endpoints. * Removes an unused parameter to `ApplicationService`. * Break dependency between media repo and groups. * Avoid copying `m.room.related_groups` state events during room upgrades.	3 years ago
Erik Johnston	1e453053cb	Rename storage classes (#12913 )	3 years ago
Sumner Evans	bda4600399	LockStore: fix acquiring a lock via `LockStore.try_acquire_lock` (#12832 ) Signed-off-by: Sumner Evans <sumner@beeper.com>	3 years ago
Patrick Cloke	c52abc1cfd	Additional constants for EDU types. (#12884 ) Instead of hard-coding strings in many places.	3 years ago
Matt C	a7da00d4f7	Add storage and module API methods to get monthly active users and their appservices (#12838 )	3 years ago
Erik Johnston	b83bc5fab5	Pull out less state when handling gaps mk2 (#12852 )	3 years ago
Dirk Klimpel	444588c5fc	Add some type hints to tests files (#12833 ) Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>	3 years ago
Richard van der Hoff	24b590de32	Remove code which updates `application_services_state.last_txn` (#12680 ) This column is unused as of #12209, so let's stop writing to it.	3 years ago
Erik Johnston	fcf951d5dc	Track in memory events using weakrefs (#10533 )	3 years ago
Erik Johnston	c72d26c1e1	Refactor `EventContext` (#12689 ) Refactor how the `EventContext` class works, with the intention of reducing the amount of state we fetch from the DB during event processing. The idea here is to get rid of the cached `current_state_ids` and `prev_state_ids` that live in the `EventContext`, and instead defer straight to the database (and its caching). One change that may have a noticeable effect is that we now no longer prefill the `get_current_state_ids` cache on a state change. However, that query is relatively light, since its just a case of reading a table from the DB (unlike fetching state at an event which is more heavyweight). For deployments with workers this cache isn't even used. Part of #12684	3 years ago
Richard van der Hoff	147f098fb4	Stop writing to `event_reference_hashes` (#12679 ) This table is never read, since #11794. We stop writing to it; in future we can drop it altogether.	3 years ago
David Robertson	2607b3e181	Update mypy to 0.950 and fix complaints (#12650 )	3 years ago
Richard van der Hoff	96e0cdbc5a	Add a consistency check on events read from the database (#12620 ) I've seen a few errors which can only plausibly be explained by the calculated event id for an event being different from the ID of the event in the database. It should be cheap to check this, so let's do so and raise an exception.	3 years ago
Sean Quah	78b99de7c2	Prefer `make_awaitable` over `defer.succeed` in tests (#12505 ) When configuring the return values of mocks, prefer awaitables from `make_awaitable` over `defer.succeed`. `Deferred`s are only awaitable once, so it is inappropriate for a mock to return the same `Deferred` multiple times. Also update `run_in_background` to support functions that return arbitrary awaitables. Signed-off-by: Sean Quah <seanq@element.io>	3 years ago
Erik Johnston	f59e3f4c90	Mark remote device list updates as already handled (#12557 )	3 years ago
Sean Quah	8a87b4435a	Handle cancellation in `EventsWorkerStore._get_events_from_cache_or_db` (#12529 ) Multiple calls to `EventsWorkerStore._get_events_from_cache_or_db` can reuse the same database fetch, which is initiated by the first call. Ensure that cancelling the first call doesn't cancel the other calls sharing the same database fetch. Signed-off-by: Sean Quah <seanq@element.io>	3 years ago
Richard van der Hoff	f5668f0b4a	Await un-partial-stating after a partial-state join (#12399 ) When we join a room via the faster-joins mechanism, we end up with "partial state" at some points on the event DAG. Many parts of the codebase need to wait for the full state to load. So, we implement a mechanism to keep track of which events have partial state, and wait for them to be fully-populated.	3 years ago
Erik Johnston	0b014eb25e	Only send out device list updates for our own users (#12465 ) Broke in #12365	3 years ago
Erik Johnston	aa28110264	Process device list updates asynchronously (#12365 )	3 years ago
reivilibre	e630722f11	Optimise `_update_client_ips_batch_txn` to batch together database operations. (#12252 ) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	3 years ago
Eric Eastwood	793d03e2c5	Generate historic pagination token for `/messages` when no `?from` token provided (#12370 )	3 years ago
Dirk Klimpel	d666fc02fa	Add type hints to some tests files (#12371 )	3 years ago
Erik Johnston	5c9e39e619	Track device list updates per room. (#12321 ) This is a first step in dealing with #7721. The idea is basically that rather than calculating the full set of users a device list update needs to be sent to up front, we instead simply record the rooms the user was in at the time of the change. This will allow a few things: 1. we can defer calculating the set of remote servers that need to be poked about the change; and 2. during `/sync` and `/keys/changes` we can avoid also avoid calculating users who share rooms with other users, and instead just look at the rooms that have changed. However, care needs to be taken to correctly handle server downgrades. As such this PR writes to both `device_lists_changes_in_room` and the `device_lists_outbound_pokes` table synchronously. In a future release we can then bump the database schema compat version to `69` and then we can assume that the new `device_lists_changes_in_room` exists and is handled. There is a temporary option to disable writing to `device_lists_outbound_pokes` synchronously, allowing us to test the new code path does work (and by implication upgrading to a future release and downgrading to this one will work correctly). Note: Ideally we'd do the calculation of room to servers on a worker (e.g. the background worker), but currently only master can write to the `device_list_outbound_pokes` table.	3 years ago
Richard van der Hoff	f0b03186d9	Add type hints for `tests/unittest.py`. (#12347 ) In particular, add type hints for get_success and friends, which are then helpful in a bunch of places.	3 years ago
Richard van der Hoff	33ebee47e4	Remove redundant `get_success` calls in test code (#12346 ) There are a bunch of places we call get_success on an immediate value, which is unnecessary. Let's rip them out, and remove the redundant functionality in get_success and friends.	3 years ago
reivilibre	c4cf916ed7	Default to `private` room visibility rather than `public` when a client does not specify one, according to spec. (#12350 )	3 years ago
Nick Mills-Barrett	993d90f82b	Use a sequence to generate AS transaction IDs, drop `last_txn` AS state (#12209 ) Switching to a sequence means there's no need to track `last_txn` on the AS state table to generate new TXN IDs. This also means that there is no longer contention between the AS scheduler and AS handler on updates to the `application_services_state` table, which will prevent serialization errors during the complete AS txn transaction.	3 years ago
Richard van der Hoff	b7762b0c9f	Move single-use methods out of `TestCase` (#12348 ) These methods are only used by a single testcase, so they shouldn't be cluttering up the base `TestCase` class.	3 years ago
Andrew Morgan	d8d0271977	Send device list updates to application services (MSC3202) - part 1 (#11881 ) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>	3 years ago
Andrew Morgan	c8cbd66d3b	Start application service stream token tracking from 1 (#12193 ) Co-authored-by: Erik Johnston <erik@matrix.org>	3 years ago
Shay	e78d4f61fc	Refuse to start if DB has an unsafe locale (#12262 )	3 years ago
Dirk Klimpel	9d21ecf7ce	Add type hints to tests files. (#12256 )	3 years ago
Sean Quah	6121056740	Handle cancellation in `DatabasePool.runInteraction()` (#12199 ) To handle cancellation, we ensure that `after_callback`s and `exception_callback`s are always run, since the transaction will complete on another thread regardless of cancellation. We also wait until everything is done before releasing the `CancelledError`, so that logging contexts won't get used after they have been finished. Signed-off-by: Sean Quah <seanq@element.io>	3 years ago
Patrick Cloke	dda9b7fc4d	Use the ignored_users table to test event visibility & sync. (#12225 ) Instead of fetching the raw account data and re-parsing it. The ignored_users table is a denormalised version of the account data for quick searching.	3 years ago

1 2 3 4 5 ...

575 Commits (979d94de2984a9712373c3684ba69d2f911ca08a)