178 Commits (48278a0d09c19f008910b10ec5922327c09533f2)

Author	SHA1	Message	Date
Erik Johnston	6250b95efe	Add index to `local_group_updates.stream_id` (#11231) ... This should speed up startup times and generally increase performance of groups.	3 years ago
reivilibre	4c838112dc	Remove unnecessary list comprehension in `synapse_port_db` to fix linting in CI (#11043)	3 years ago
Patrick Cloke	f4b1a9a527	Require direct references to configuration variables. (#10985) ... This removes the magic allowing accessing configurable variables directly from the config object. It is now required that a specific configuration class is used (e.g. `config.foo` must be replaced with `config.server.foo`).	3 years ago
Nick Barrett	c80878d22a	Add `--run-background-updates` option to `update_database` script. (#10954) ... Signed-off-by: Nick Barrett <nick@beeper.com>	3 years ago
Sean	924276f482	Add a partial index to `presence_stream` to speed up startups (#10748) ... Signed-off-by: Sean Quah <seanq@element.io>	3 years ago
Erik Johnston	6655ea5587	Add script for getting info about recently registered users (#10290)	3 years ago
Quentin Gliech	bd4919fb72	MSC2918 Refresh tokens implementation (#9450) ... This implements refresh tokens, as defined by MSC2918 This MSC has been implemented client side in Hydrogen Web: vector-im/hydrogen-web#235 The basics of the MSC works: requesting refresh tokens on login, having the access tokens expire, and using the refresh token to get a new one. Signed-off-by: Quentin Gliech <quentingliech@gmail.com>	3 years ago
Richard van der Hoff	daca7b2794	Fix off-by-one-error in synapse_port_db (#9991) ... fixes #9979	4 years ago
Richard van der Hoff	6482075c95	Run `black` on the scripts (#9981) ... Turns out these scripts weren't getting linted.	4 years ago
Richard van der Hoff	51065c44bb	Fix port_db on empty db (#9930) ... ... and test it.	4 years ago
Erik Johnston	9d25a0ae65	Split presence out of master (#9820)	4 years ago
Jonathan de Jong	4b965c862d	Remove redundant "coding: utf-8" lines (#9786) ... Part of #9744 Removes all redundant `# -*- coding: utf-8 -*-` lines from files, as python 3 automatically reads source code as utf-8 now. `Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>`	4 years ago
Ankit Dobhal	d66f9070cd	Fixed code misc. quality issues (#9649) ... - Merge 'isinstance' calls. - Remove unnecessary dict call outside of comprehension. - Use 'sys.exit()' calls.	4 years ago
Erik Johnston	16108c579d	Fix SQL delta file taking a long time to run (#9516) ... Fixes #9504	4 years ago
Patrick Cloke	65a9eb8994	Include newly added sequences in the port DB script. (#9449) ... And ensure the consistency of `event_auth_chain_id`.	4 years ago
Erik Johnston	7036e24e98	Add background update for add chain cover index (#9029)	4 years ago
Erik Johnston	b530eaa262	Allow running sendToDevice on workers (#9044)	4 years ago
Richard van der Hoff	3ad699cc65	Fix generate_log_config script (#8952) ... It used to write an empty file if you gave it a -o arg.	4 years ago
Erik Johnston	1b15a3d92c	Fix port script so that it can be run again after failure. (#8755) ... If the script fails (or is CTRL-C'ed) between porting some of the events table and copying of the sequences then the port script will immediately die if run again due to the postgres DB having inconsistencies between sequences and tables. The fix is to move the porting of sequences to before porting the tables, so that there is never a period where the Postgres DB is inconsistent. To do that we need to change how we port the sequences so that it calculates the values from the SQLite DB rather than the Postgres DB. Fixes #8619	4 years ago
Erik Johnston	41a389934e	Fix port script fails when DB has no backfilled events. (#8729) ... Fixes #8618	4 years ago
Erik Johnston	5829872bec	Fix port script to handle foreign key constraints (#8730)	4 years ago
Erik Johnston	1eb9de90c0	Improve start time by adding index to e2e_cross_signing_keys (#8694) ... We do a `SELECT MAX(stream_id) FROM e2e_cross_signing_keys` on startup.	4 years ago
Andrew Morgan	a312e890f5	Cast errors generated during synapse_port_db to str (#8585) ... I noticed in https://github.com/matrix-org/synapse/issues/8575 that the `end_error` variable in `synapse_port_db` is set to an `Exception`, even though later we expect it to be a `str`. This PR simply casts an exception raised to a string. I'm doing this instead of having `end_error` be of type exception as we explicitly set `end_error` to a str here: d25eb8f370/scripts/synapse_port_db (L542-L547) This whole file could probably use some heavy refactoring, but until then at least this fix will prevent exception contents from being hidden from us and users.	4 years ago
Hubert Chathi	3cd78bbe9e	Add support for MSC2732: olm fallback keys (#8312)	4 years ago
Erik Johnston	e3debf9682	Add logging on startup/shutdown (#8448) ... This is so we can tell what is going on when things are taking a while to start up. The main change here is to ensure that transactions that are created during startup get correctly logged like normal transactions.	4 years ago
Dagfinn Ilmari Mannsåker	bd715e1278	Add `ui_auth_sessions_ips` table to `synapse_port_db` ignore list (#8410) ... This table was created in #8034 (1.20.0). It references `ui_auth_sessions`, which is ignored, so this one should be too. Signed-off-by: Dagfinn Ilmari Mannsåker <ilmari@ilmari.org>	4 years ago
Patrick Cloke	f3e5c2e702	Mark the shadow_banned column as boolean in synapse_port_db. (#8386)	4 years ago
Erik Johnston	6fdf577593	Add new sequences to port DB script (#8387)	4 years ago
Patrick Cloke	13099ae431	Mark the shadow_banned column as boolean in synapse_port_db. (#8386)	4 years ago
Jonathan de Jong	837293c314	Remove obsolete __future__ imports (#8337)	4 years ago
Brendan Abolivier	2ffd6783c7	Revert #7736 (#8039)	4 years ago
Erik Johnston	a7bdf98d01	Rename database classes to make some sense (#8033)	4 years ago
Brendan Abolivier	8dff4a1242	Re-implement unread counts (#7736)	4 years ago
Richard van der Hoff	c445bc0cad	Use a postgres sequence to generate guest user IDs	4 years ago
Patrick Cloke	24110255cd	Sync ignored table names in synapse_port_db to current database schema (#7717)	4 years ago
Patrick Cloke	95e41f368b	Allow local media to be marked as safe from being quarantined. (#7718)	4 years ago
Patrick Cloke	6418b0379f	Ignore the UI Auth sessions when porting from sqlite to postgresql (#7711)	5 years ago
Dagfinn Ilmari Mannsåker	a3f11567d9	Replace all remaining six usage with native Python 3 equivalents (#7704)	5 years ago
Erik Johnston	e5c67d04db	Add option to move event persistence off master (#7517)	5 years ago
Erik Johnston	d7983b63a6	Support any process writing to cache invalidation stream. (#7436)	5 years ago
Ivan Vilata-i-Balaguer	837f62266b	Avoid attribute error when `password_config` present but empty (#6753) ... The old statement returned `None` for such a `password_config` (like the one created on first run), thus retrieval of the `pepper` key failed with `AttributeError`. Fixes #5315 Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>	5 years ago
Brendan Abolivier	07124d028d	Port synapse_port_db to async/await (#6718) ... * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review	5 years ago
Erik Johnston	28c98e51ff	Add `local_current_membership` table (#6655) ... Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.	5 years ago
Richard van der Hoff	bf46821180	Refuse to start if sqlite is older than 3.11.0	5 years ago
Richard van der Hoff	e97d1cf001	Modify check_database to take a connection rather than a cursor ... We might not need the cursor at all.	5 years ago
Richard van der Hoff	85db7f73be	Add a background update to clear tombstoned rooms from the directory (#6648) ... * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass	5 years ago
Richard van der Hoff	08815566bc	Automate generation of the sample and debian log configs (#6627)	5 years ago
Erik Johnston	75d8f26ac8	Split state groups into a separate data store (#6296)	5 years ago
Richard van der Hoff	b95b762560	Add an export_signing_key script (#6546) ... I want to do some key rotation, and it is silly that we don't have a way to do this.	5 years ago
Erik Johnston	2284eb3a53	Add database config class (#6513) ... This encapsulates config for a given database and is the way to get new connections.	5 years ago