166 Commits (55159c48e31129c87b55d15d203df946ca33f884)

Author	SHA1	Message	Date
Ankit Dobhal	d66f9070cd	Fixed code misc. quality issues (#9649) ... - Merge 'isinstance' calls. - Remove unnecessary dict call outside of comprehension. - Use 'sys.exit()' calls.	4 years ago
Erik Johnston	16108c579d	Fix SQL delta file taking a long time to run (#9516) ... Fixes #9504	4 years ago
Patrick Cloke	65a9eb8994	Include newly added sequences in the port DB script. (#9449) ... And ensure the consistency of `event_auth_chain_id`.	4 years ago
Erik Johnston	7036e24e98	Add background update for add chain cover index (#9029)	4 years ago
Erik Johnston	b530eaa262	Allow running sendToDevice on workers (#9044)	4 years ago
Richard van der Hoff	3ad699cc65	Fix generate_log_config script (#8952) ... It used to write an empty file if you gave it a -o arg.	4 years ago
Erik Johnston	1b15a3d92c	Fix port script so that it can be run again after failure. (#8755) ... If the script fails (or is CTRL-C'ed) between porting some of the events table and copying of the sequences then the port script will immediately die if run again due to the postgres DB having inconsistencies between sequences and tables. The fix is to move the porting of sequences to before porting the tables, so that there is never a period where the Postgres DB is inconsistent. To do that we need to change how we port the sequences so that it calculates the values from the SQLite DB rather than the Postgres DB. Fixes #8619	4 years ago
Erik Johnston	41a389934e	Fix port script fails when DB has no backfilled events. (#8729) ... Fixes #8618	4 years ago
Erik Johnston	5829872bec	Fix port script to handle foreign key constraints (#8730)	4 years ago
Erik Johnston	1eb9de90c0	Improve start time by adding index to e2e_cross_signing_keys (#8694) ... We do a `SELECT MAX(stream_id) FROM e2e_cross_signing_keys` on startup.	4 years ago
Andrew Morgan	a312e890f5	Cast errors generated during synapse_port_db to str (#8585) ... I noticed in https://github.com/matrix-org/synapse/issues/8575 that the `end_error` variable in `synapse_port_db` is set to an `Exception`, even though later we expect it to be a `str`. This PR simply casts an exception raised to a string. I'm doing this instead of having `end_error` be of type exception as we explicitly set `end_error` to a str here: d25eb8f370/scripts/synapse_port_db (L542-L547) This whole file could probably use some heavy refactoring, but until then at least this fix will prevent exception contents from being hidden from us and users.	4 years ago
Hubert Chathi	3cd78bbe9e	Add support for MSC2732: olm fallback keys (#8312)	4 years ago
Erik Johnston	e3debf9682	Add logging on startup/shutdown (#8448) ... This is so we can tell what is going on when things are taking a while to start up. The main change here is to ensure that transactions that are created during startup get correctly logged like normal transactions.	4 years ago
Dagfinn Ilmari Mannsåker	bd715e1278	Add `ui_auth_sessions_ips` table to `synapse_port_db` ignore list (#8410) ... This table was created in #8034 (1.20.0). It references `ui_auth_sessions`, which is ignored, so this one should be too. Signed-off-by: Dagfinn Ilmari Mannsåker <ilmari@ilmari.org>	4 years ago
Patrick Cloke	f3e5c2e702	Mark the shadow_banned column as boolean in synapse_port_db. (#8386)	4 years ago
Erik Johnston	6fdf577593	Add new sequences to port DB script (#8387)	4 years ago
Patrick Cloke	13099ae431	Mark the shadow_banned column as boolean in synapse_port_db. (#8386)	4 years ago
Jonathan de Jong	837293c314	Remove obsolete __future__ imports (#8337)	4 years ago
Brendan Abolivier	2ffd6783c7	Revert #7736 (#8039)	4 years ago
Erik Johnston	a7bdf98d01	Rename database classes to make some sense (#8033)	4 years ago
Brendan Abolivier	8dff4a1242	Re-implement unread counts (#7736)	4 years ago
Richard van der Hoff	c445bc0cad	Use a postgres sequence to generate guest user IDs	4 years ago
Patrick Cloke	24110255cd	Sync ignored table names in synapse_port_db to current database schema (#7717)	4 years ago
Patrick Cloke	95e41f368b	Allow local media to be marked as safe from being quarantined. (#7718)	4 years ago
Patrick Cloke	6418b0379f	Ignore the UI Auth sessions when porting from sqlite to postgresql (#7711)	5 years ago
Dagfinn Ilmari Mannsåker	a3f11567d9	Replace all remaining six usage with native Python 3 equivalents (#7704)	5 years ago
Erik Johnston	e5c67d04db	Add option to move event persistence off master (#7517)	5 years ago
Erik Johnston	d7983b63a6	Support any process writing to cache invalidation stream. (#7436)	5 years ago
Ivan Vilata-i-Balaguer	837f62266b	Avoid attribute error when `password_config` present but empty (#6753) ... The old statement returned `None` for such a `password_config` (like the one created on first run), thus retrieval of the `pepper` key failed with `AttributeError`. Fixes #5315 Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>	5 years ago
Brendan Abolivier	07124d028d	Port synapse_port_db to async/await (#6718) ... * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review	5 years ago
Erik Johnston	28c98e51ff	Add `local_current_membership` table (#6655) ... Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.	5 years ago
Richard van der Hoff	bf46821180	Refuse to start if sqlite is older than 3.11.0	5 years ago
Richard van der Hoff	e97d1cf001	Modify check_database to take a connection rather than a cursor ... We might not need the cursor at all.	5 years ago
Richard van der Hoff	85db7f73be	Add a background update to clear tombstoned rooms from the directory (#6648) ... * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass	5 years ago
Richard van der Hoff	08815566bc	Automate generation of the sample and debian log configs (#6627)	5 years ago
Erik Johnston	75d8f26ac8	Split state groups into a separate data store (#6296)	5 years ago
Richard van der Hoff	b95b762560	Add an export_signing_key script (#6546) ... I want to do some key rotation, and it is silly that we don't have a way to do this.	5 years ago
Erik Johnston	2284eb3a53	Add database config class (#6513) ... This encapsulates config for a given database and is the way to get new connections.	5 years ago
Erik Johnston	71ee22c0ba	Fix port db script	5 years ago
Erik Johnston	8b77fc6506	Fix DB scripts	5 years ago
Erik Johnston	756d4942f5	Move DB pool and helper functions into dedicated Database class	5 years ago
Brendan Abolivier	f8421a1404	Fix background updates for synapse_port_db	5 years ago
Brendan Abolivier	6cd11109db	Make synapse_port_db exit with a non-0 code if something failed	5 years ago
Erik Johnston	ee86abb2d6	Remove underscore from SQLBaseStore functions	5 years ago
Andrew Morgan	57f09e01f5	Fix error when using synapse_port_db on a vanilla synapse db	5 years ago
Andrew Morgan	54fef094b3	Remove usage of deprecated logger.warn method from codebase (#6271) ... Replace every instance of `logger.warn` with `logger.warning` as the former is deprecated.	5 years ago
Andrew Morgan	ff39cb46de	Fix up changelog	5 years ago
Brendan Abolivier	2891693da6	Add new boolean column to synapse_port_db	5 years ago
Brendan Abolivier	b2510dce85	Fix import paths in synapse_port_db	5 years ago
Brendan Abolivier	c97ed64db3	Make synapse_port_db correctly create indexes (#6102) ... Make `synapse_port_db` correctly create indexes in the PostgreSQL database, by having it run the background updates on the database before migrating the data. To ensure we're migrating the right data, also block the port if the SQLite3 database still has pending or ongoing background updates. Fixes #4877	5 years ago