2902 Commits (b18cd25e42711d99c62a098203f59f4e12f3fca7)

Author	SHA1	Message	Date
Erik Johnston	495ea92350	Fix pep8	6 years ago
Erik Johnston	483ba85c7a	Analyze user_ips before running deduplication ... Due to the table locks taken out by the naive upsert, the table statistics may be out of date. During deduplication it is important that the correct index is used as otherwise a full table scan may be incorrectly used, which can end up thrashing the database badly.	6 years ago
Erik Johnston	362d80b770	Reduce user_ips bloat during dedupe background update ... The background update to remove duplicate rows naively deleted and reinserted the duplicates. For large tables with a large number of duplicates this causes a lot of bloat (with postgres), as the inserted rows are appended to the table, since deleted rows will not be overwritten until a VACUUM has happened. This should hopefully also help ensure that the query in the last batch uses the correct index, as inserting a large number of new rows without analyzing will upset the query planner.	6 years ago
Richard van der Hoff	56710c7df5	Fix 'no unique or exclusion constraint' error (#4591) ... Add more tables to the list of tables which need a background update to complete before we can upsert into them, which fixes a race against the background updates.	6 years ago
Hubert Chathi	8248637173	add new endpoint to update backup versions	6 years ago
Andrew Morgan	627ecd358e	Filter user directory state query to a subset of state events (#4462) ... * Filter user directory state query to a subset of state events * Add changelog	6 years ago
Andrew Morgan	d239f67c25	Raise an exception instead of returning None	6 years ago
Andrew Morgan	3ed3cb4339	New function for getting room's create event	6 years ago
Richard van der Hoff	e707e7b38d	Fix infinite loop when an event is redacted in a v3 room (#4535)	6 years ago
Amber Brown	3f189c902e	Fix flake8 (#4519)	6 years ago
Erik Johnston	c21b7cbc09	Update synapse/storage/events_worker.py	6 years ago
Erik Johnston	4db252c073	Check redaction state when event is pulled out of the database	6 years ago
Erik Johnston	6d23ec2111	Fix typo	6 years ago
Erik Johnston	b5d510ad64	Remove unused arg	6 years ago
Richard van der Hoff	82165eeb05	Update synapse/storage/events_worker.py ... Co-Authored-By: erikjohnston <erikj@jki.re>	6 years ago
Erik Johnston	7709d2bd16	Implement rechecking of redactions	6 years ago
Erik Johnston	be47cfa9c9	Refactor event building into EventBuilder ... This is so that everything is done in one place, making it easier to change the event format based on room version	6 years ago
Amber Brown	94fb63e44f	Fix typo in upserts code (#4505) ... * fix obvious problem :| * changelog	6 years ago
Amber Brown	7072fe3084	Fix UPSERTs on SQLite 3.24+ (#4477)	6 years ago
Andrew Morgan	0b3fd1401f	Don't require sqlite3 when using postgres (#4466)	6 years ago
Erik Johnston	1953067136	Disable native upserts for sqlite, as they don't work	6 years ago
Erik Johnston	678a92cb56	Replace missed usages of FrozenEvent	6 years ago
Erik Johnston	be6a7e47fa	Revert "Require event format version to parse or create events"	6 years ago
Erik Johnston	b8082a5445	Use term 'out of band membership' instead	6 years ago
Andrew Morgan	e1781b043b	Remove redundant create event None check	6 years ago
Richard van der Hoff	03c85335d1	Apply suggestions from code review ... Co-Authored-By: anoadragon453 <1342360+anoadragon453@users.noreply.github.com>	6 years ago
Amber Brown	0e27501ee5	Fix UPSERT check (#4459)	6 years ago
Erik Johnston	e8c9f15397	Replace missed usages of FrozenEvent	6 years ago
Amber Brown	58f6c48183	Use native UPSERTs where possible (#4306)	6 years ago
Erik Johnston	7c288c2250	Clarify the invite flows	6 years ago
Erik Johnston	886e5acc76	Store rejected remote invite events as outliers ... Currently they're stored as non-outliers even though the server isn't in the room, which can be problematic in places where the code assumes it has the state for all non outlier events. In particular, there is an edge case where persisting the leave event triggers a state resolution, which requires looking up the room version from state. Since the server doesn't have the state, this causes an exception to be thrown.	6 years ago
Erik Johnston	be1065af59	isort	6 years ago
Erik Johnston	c5a296b10c	Add support for persisting event format versions ... Currently we only have the one event format version defined, but this adds the necessary infrastructure to persist and fetch the format versions alongside the events. We specify the format version rather than the room version as: 1. We don't necessarily know the room version, existing events may be either v1 or v2. 2. We'd need to be careful to prevent/handle correctly if different events in the same room reported to be of different versions, which sounds annoying.	6 years ago
Erik Johnston	90743c9d89	Fixup removal of duplicate `user_ips` rows (#4432) ... * Remove unnecessary ORDER BY clause * Add logging * Newsfile	6 years ago
Erik Johnston	7f503f83b9	Refactor to rewrite the SQL instead	6 years ago
Erik Johnston	1c9704f8ab	Don't shadow params	6 years ago
Erik Johnston	2557531f0f	Fix bug when removing duplicate rows from user_ips ... This was caused by accidentally overwritting a `last_seen` variable in a for loop, causing the wrong value to be written to the progress table. The result of which was that we didn't scan sections of the table when searching for duplicates, and so some duplicates did not get deleted.	6 years ago
Andrew Morgan	277e50462d	Do not return in a deferred function	6 years ago
Andrew Morgan	c433f61091	Ensure new filter is actually created	6 years ago
Andrew Morgan	c9bfb058d8	Fix a bug with single-room search searching all rooms ... * Create a new method for getting predecessor rooms * Remove formatting change	6 years ago
Andrew Morgan	25d64a846a	Fix typos	6 years ago
Erik Johnston	25dd56ace3	Fix race when persisting create event (#4404) ... * Fix race when persisting create event When persisting a chunk of DAG it is sometimes requried to do a state resolution, which requires knowledge of the room version. If this happens while we're persisting the create event then we need to use that event rather than attempting to look it up in the database.	6 years ago
Andrew Morgan	df3a661e4a	Search for messages across predecessor rooms ... Signed-off-by: Andrew Morgan <andrew@amorgan.xyz>	6 years ago
Amber Brown	a35c66a00b	Remove duplicates in the user_ips table and add an index (#4370)	6 years ago
Amber Brown	7960c26fda	Fix adding new rows instead of updating them if one of the key values is a NULL in upserts. (#4369)	6 years ago
Neil Johnson	84b6fae1f5	Ensure synchrotrons can access is_support_user in the storage layer	6 years ago
Will Hunt	0708f437cc	Log roomid along with Unknown room (#4297)	6 years ago
Richard van der Hoff	1a6d5bfa08	Debian packaging via dh_virtualenv (#4285)	6 years ago
Neil Johnson	d2f7c4e6b1	create support user (#4141) ... Allow for the creation of a support user. A support user can access the server, join rooms, interact with other users, but does not appear in the user directory nor does it contribute to monthly active user limits.	6 years ago
Amber Brown	c7144b105c	Settings Fix deleting e2e room keys on xenial (#4295)	6 years ago