196 Commits (bcaec2915ac74937171e27d507b8f9c0e39d3677)

Author	SHA1	Message	Date
Matthew Hodgson	bcaec2915a	incorporate review	6 years ago
Matthew Hodgson	924eb34d94	add a filtered_types param to limit filtering to specific types	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Richard van der Hoff	43e02c409d	Disable partial state group caching for wildcard lookups ... When _get_state_for_groups is given a wildcard filter, just do a complete lookup. Hopefully this will give us the best of both worlds by not filling up the ram if we only need one or two keys, but also making the cache still work for the federation reader usecase.	7 years ago
Richard van der Hoff	eb32b2ca20	Optimise state_group_cache update ... (1) matrix-org-hotfixes has removed the intern calls; let's do the same here. (2) remove redundant iteritems() so we can used an optimised db update.	7 years ago
Richard van der Hoff	d3a8c9c55e	Fix sql error in _get_state_groups_from_groups ... If this was called with a `(type, None)` entry in types (which is supposed to return all state of type `type`), it would explode with a sql error.	7 years ago
Erik Johnston	042eedfa2b	Add hacky cache factor override system	7 years ago
Amber Brown	c936a52a9e	Consistently use six's iteritems and wrap lazy keys/values in list() if they're not meant to be lazy (#3307)	7 years ago
Matthew Hodgson	a6c8f7c875	add pydoc	7 years ago
Matthew Hodgson	9f77001e27	pep8	7 years ago
Matthew Hodgson	d144ed6ffb	fix bug #2926 (loading all state for a given type from the DB if the state_key is None) (#2990) ... Fixes a regression that had crept in where the caching layer upholds requests for loading state which is filtered by type (but not by state_key), but the DB layer itself would interpret a missing state_key as a request to filter by null state_key rather than returning all state_keys.	7 years ago
Matthew Hodgson	ccca02846d	make it work	7 years ago
Matthew Hodgson	f0f9a0605b	remove comment now #2969 is fixed	7 years ago
Matthew Hodgson	afbf4d3dcc	typoe	7 years ago
Matthew Hodgson	865377a70d	disable optimisation for searching for state groups ... when type filter includes wildcards on state_key	7 years ago
Matthew Hodgson	b2aba9e430	build where_clause sanely	7 years ago
Matthew Hodgson	52f7e23c72	PR feedbackz	7 years ago
Matthew Hodgson	1b1c137771	fix bug #2926	7 years ago
Matthew Hodgson	fdedcd1f4d	correctly handle None state_keys ... and fix include_other_types thinko	7 years ago
Matthew Hodgson	97c0496cfa	fix sqlite where clause	7 years ago
Matthew Hodgson	8713365265	typos	7 years ago
Matthew Hodgson	9b334b3f97	WIP experiment in lazyloading room members	7 years ago
Erik Johnston	106906a65e	Don't serialize current state over replication	7 years ago
Erik Johnston	fd1601c596	Fix state group storage bug in workers ... We needed to move `_count_state_group_hops_txn` to the StateGroupWorkerStore.	7 years ago
Erik Johnston	3d33eef6fc	Store state groups separately from events (#2784) ... * Split state group persist into seperate storage func * Add per database engine code for state group id gen * Move store_state_group to StateReadStore This allows other workers to use it, and so resolve state. * Hook up store_state_group * Fix tests * Rename _store_mult_state_groups_txn * Rename StateGroupReadStore * Remove redundant _have_persisted_state_group_txn * Update comments * Comment compute_event_context * Set start val for state_group_id_seq ... otherwise we try to recreate old state groups * Update comments * Don't store state for outliers * Update comment * Update docstring as state groups are ints	7 years ago
Richard van der Hoff	35a4b63240	Pull out bits of StateStore to a mixin ... ... so that we don't need to secretly gut-wrench it for use in the slaved stores. I haven't done the other stores yet, but we should. I'm tired of the workers breaking every time we tweak the stores because I forgot to gut-wrench the right method. fixes https://github.com/matrix-org/synapse/issues/2655.	7 years ago
Richard van der Hoff	4dd1bfa8c1	Revert "Revert "move _state_group_cache to statestore"" ... We're going to fix this properly on this branch, so that the _state_group_cache can end up in StateGroupReadStore. This reverts commit ab335edb02.	7 years ago
Richard van der Hoff	6cfee09be9	Make __init__ consitstent across Store heirarchy ... Add db_conn parameters to the `__init__` methods of the *Store classes, so that they are all consistent, which makes the multiple inheritance work correctly (and so that we can later extract mixins which can be used in the slavedstores)	7 years ago
Erik Johnston	ab335edb02	Revert "move _state_group_cache to statestore" ... This reverts commit f5cf3638e9.	7 years ago
Richard van der Hoff	f5cf3638e9	move _state_group_cache to statestore ... this is internal to statestore, so let's keep it there.	7 years ago
Erik Johnston	5946aa0877	Prefill forward extrems and event to state groups	8 years ago
Erik Johnston	8060974344	Fix replication	8 years ago
Erik Johnston	b0d975e216	Comments	8 years ago
Erik Johnston	e54d7d536e	Cache state deltas	8 years ago
Erik Johnston	ea11ee09f3	Ensure we don't use unpersisted state group as prev group	8 years ago
Erik Johnston	6ba21bf2b8	Comments	8 years ago
Erik Johnston	dfbda5e025	Faster cache for get_joined_hosts	8 years ago
Erik Johnston	bbfe4e996c	Make get_state_groups_from_groups faster. ... Most of the time was spent copying a dict to filter out sentinel values that indicated that keys did not exist in the dict. The sentinel values were added to ensure that we cached the non-existence of keys. By updating DictionaryCache to keep track of which keys were known to not exist itself we can remove a dictionary copy.	8 years ago
Erik Johnston	608b5a6317	Take a copy before prefilling, as it may be a frozendict	8 years ago
Erik Johnston	e4435b014e	Update comment	8 years ago
Erik Johnston	871605f4e2	Comments	8 years ago
Erik Johnston	bfbc907cec	Prefill state caches	8 years ago
Erik Johnston	587f07543f	Revert "Prefill state caches"	8 years ago
Erik Johnston	2c2dcf81d0	Update comment	8 years ago
Erik Johnston	1827057acc	Comments	8 years ago
Erik Johnston	a2c89a225c	Prefill state caches	8 years ago
Erik Johnston	f053a1409e	Make state caches cache in ascii	8 years ago
Erik Johnston	22f3d3ae76	Reduce _get_state_group_for_event cache size	8 years ago
Erik Johnston	e4f3431116	Remove unused cache	8 years ago
Erik Johnston	2a3e822f44	Comment	8 years ago