79 Commits (a511a890d7c556ad357d27443e5665e6cc25e0b5)

Author	SHA1	Message	Date
Eric Eastwood	a511a890d7	Enable MSC2716 Complement tests in Synapse (#12145) ... Co-authored-by: Brendan Abolivier <babolivier@matrix.org>	3 years ago
Eric Eastwood	31b125ccec	Enable MSC3030 Complement tests in Synapse (#12144) ... The Complement tests for MSC3030 are now merged, https://github.com/matrix-org/complement/pull/178 Synapse implmentation: https://github.com/matrix-org/synapse/pull/9445	3 years ago
David Robertson	1fbe0316a9	Add suffices to scripts in scripts-dev (#12137) ... * Rename scripts-dev to have suffices * Update references to `scripts-dev` * Changelog * These scripts don't pass mypy	3 years ago
David Robertson	5f62a094de	Detox, part 1 of N (#12119) ... * Don't use `tox` for `check-sampleconfig` * Don't use `tox` for check-newsfragment	3 years ago
David Robertson	af2c1e3d2a	Tidy the building of sdists and wheels (#12051) ... * Don't build distribution pkgs in tests.yml * Run `release-artifacts` on release branches * Use backend-meta workflow for packaging	3 years ago
Richard van der Hoff	bb98c593a5	Prepare for rename of default complement branch (#11971) ... use `HEAD` rather than hardcoding `master`	3 years ago
kegsay	a3865ed525	Run Complement tests sequentially (#11910) ... Since #11811 there has been general Complement flakiness around networking. It seems like tests are hitting the wrong containers. In an effort to diagnose the cause of this, as well as reduce its impact on this project, set the parallelsim to 1 (no parallelism) when running tests. If this fixes the flakiness then this indicates the cause and I can diagnose this further. If this doesn't fix the flakiness then that implies some kind of test pollution which also helps to diagnose this further.	3 years ago
kegsay	0938f32e93	CI: run Complement on the VM, not inside Docker (#11811) ... * CI: run Complement on the VM, not inside Docker This requires https://github.com/matrix-org/complement/pull/289 We now run Complement on the VM instead of inside a Docker container. This is to allow Complement to bind to any high-numbered port when it starts up its own federation servers. We want to do this to allow for more concurrency when running complement tests. Previously, Complement only ever bound to `:8448` when running its own federation server. This prevented multiple federation tests running at the same time as they would fight each other on the port. This did however allow Complement to run in Docker, as the host could just port forward `:8448` to allow homeserver containers to communicate to Complement. Now that we are using random ports however, we cannot use Docker to run Complement. This ends up being a good thing because: - Running Complement tests locally is closer to how they run in CI. - Allows the `CI` env var to be removed in Complement. - Slightly speeds up runs as we don't need to pull down the Complement image prior to running tests. This assumes GHA caches actions sensibly. * Changelog * Full stop * Update .github/workflows/tests.yml Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> * Review comments * Update .github/workflows/tests.yml Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	3 years ago
Richard van der Hoff	2d327d25bf	Skip the initial amd64-only Docker build (#11810) ... PyNaCl's recent 1.5.0 release on PyPi includes arm64 wheels, which means our arm64 docker images now build in a sensible amount of time, so we can skip the amd64-only build.	3 years ago
Shay	9006ee36d1	Drop support for and remove references to EOL Python 3.6 (#11683) ... * remove reference in comments to python3.6 * upgrade tox python env in script * bump python version in example for completeness * upgrade python version requirement in setup doc * upgrade necessary python version in __init__.py * upgrade python version in setup.py * newsfragment * drops refs to bionic and replace with focal * bump refs to postgres 9.6 to 10 * fix hanging ci * try installing tzdata first * revert change made in b979f336 * ignore new random mypy error while debugging other error * fix lint error for temporary workaround * revert change to install list * try passing env var * export debian frontend var? * move line and add comment * bump pillow dependency * bump lxml depenency * install libjpeg-dev for pillow * bump automat version to one compatible with py3.8 * add libwebp for pillow * bump twisted trunk python version * change suffix of newsfragment * remove redundant python 3.7 checks * lint	3 years ago
David Robertson	4ca8fcdd5a	Invite PR submitters to credit themselves (#11744) ... Co-authored-by: Brendan Abolivier <babolivier@matrix.org>	3 years ago
Richard van der Hoff	d41c4654db	Use buildkit's cache feature to speed up docker builds (#11691) ... Having spent much of the last week attempting to run complement tests from somewhere with damp string instead of internet... something had to be done.	3 years ago
kegsay	3be63654e4	Prettier complement logs (#11707) ... * Prettier complement logs * Changelog	3 years ago
Shay	87da37374a	Drop EOL python 3.6 from CI (#11595) ... * remove python 3.6 and postgres 9.6 from github workflow * remove python 3.6 env from tox * newsfragment * correct postgres version * add py310 to tox env list	3 years ago
Olivier Wilkinson (reivilibre)	4dd9ea8f4f	Revert "Revert accidental fast-forward merge from v1.49.0rc1" ... This reverts commit 158d73ebdd.	3 years ago
Sean Quah	158d73ebdd	Revert accidental fast-forward merge from v1.49.0rc1 ... Revert "Sort internal changes in changelog" Revert "Update CHANGES.md" Revert "1.49.0rc1" Revert "Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505) (#11527)" Revert "Refactors in `_generate_sync_entry_for_rooms` (#11515)" Revert "Correctly register shutdown handler for presence workers (#11518)" Revert "Fix `ModuleApi.looping_background_call` for non-async functions (#11524)" Revert "Fix 'delete room' admin api to work on incomplete rooms (#11523)" Revert "Correctly ignore invites from ignored users (#11511)" Revert "Fix the test breakage introduced by #11435 as a result of concurrent PRs (#11522)" Revert "Stabilise support for MSC2918 refresh tokens as they have now been merged into the Matrix specification. (#11435)" Revert "Save the OIDC session ID (sid) with the device on login (#11482)" Revert "Add admin API to get some information about federation status (#11407)" Revert "Include bundled aggregations in /sync and related fixes (#11478)" Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505)" Revert "Update backward extremity docs to make it clear that it does not indicate whether we have fetched an events' `prev_events` (#11469)" Revert "Support configuring the lifetime of non-refreshable access tokens separately to refreshable access tokens. (#11445)" Revert "Add type hints to `synapse/tests/rest/admin` (#11501)" Revert "Revert accidental commits to develop." Revert "Newsfile" Revert "Give `tests.server.setup_test_homeserver` (nominally!) the same behaviour" Revert "Move `tests.utils.setup_test_homeserver` to `tests.server`" Revert "Convert one of the `setup_test_homeserver`s to `make_test_homeserver_synchronous`" Revert "Disambiguate queries on `state_key` (#11497)" Revert "Comments on the /sync tentacles (#11494)" Revert "Clean up tests.storage.test_appservice (#11492)" Revert "Clean up `tests.storage.test_main` to remove use of legacy code. (#11493)" Revert "Clean up `tests.test_visibility` to remove legacy code. (#11495)" Revert "Minor cleanup on recently ported doc pages (#11466)" Revert "Add most of the missing type hints to `synapse.federation`. (#11483)" Revert "Avoid waiting for zombie processes in `synctl stop` (#11490)" Revert "Fix media repository failing when media store path contains symlinks (#11446)" Revert "Add type annotations to `tests.storage.test_appservice`. (#11488)" Revert "`scripts-dev/sign_json`: support for signing events (#11486)" Revert "Add MSC3030 experimental client and federation API endpoints to get the closest event to a given timestamp (#9445)" Revert "Port wiki pages to documentation website (#11402)" Revert "Add a license header and comment. (#11479)" Revert "Clean-up get_version_string (#11468)" Revert "Link background update controller docs to summary (#11475)" Revert "Additional type hints for config module. (#11465)" Revert "Register the login redirect endpoint for v3. (#11451)" Revert "Update openid.md" Revert "Remove mention of OIDC certification from Dex (#11470)" Revert "Add a note about huge pages to our Postgres doc (#11467)" Revert "Don't start Synapse master process if `worker_app` is set (#11416)" Revert "Expose worker & homeserver as entrypoints in `setup.py` (#11449)" Revert "Bundle relations of relations into the `/relations` result. (#11284)" Revert "Fix `LruCache` corruption bug with a `size_callback` that can return 0 (#11454)" Revert "Eliminate a few `Any`s in `LruCache` type hints (#11453)" Revert "Remove unnecessary `json.dumps` from `tests.rest.admin` (#11461)" Revert "Merge branch 'master' into develop" This reverts commit 26b5d2320f. This reverts commit bce4220f38. This reverts commit 966b5d0fa0. This reverts commit 088d748f2c. This reverts commit 14d593f72d. This reverts commit 2a3ec6facf. This reverts commit eccc49d755. This reverts commit b1ecd19c5d. This reverts commit 9c55dedc8c. This reverts commit 2d42e586a8. This reverts commit 2f053f3f82. This reverts commit a15a893df8. This reverts commit 8b4b153c9e. This reverts commit 494ebd7347. This reverts commit a77c369897. This reverts commit 4eb77965cd. This reverts commit 637df95de6. This reverts commit e5f426cd54. This reverts commit 8cd68b8102. This reverts commit 6cae125e20. This reverts commit 7be88fbf48. This reverts commit b3fd99b74a. This reverts commit f7ec6e7d9e. This reverts commit 5640992d17. This reverts commit d26808dd85. This reverts commit f91624a595. This reverts commit 16d39a5490. This reverts commit 8a4c296987. This reverts commit 49e1356ee3. This reverts commit d2279f471b. This reverts commit b50e39df57. This reverts commit 858d80bf0f. This reverts commit 435f044807. This reverts commit f61462e1be. This reverts commit a6f1a3abec. This reverts commit 84dc50e160. This reverts commit ed635d3285. This reverts commit 7b62791e00. This reverts commit 153194c771. This reverts commit f44d729d4c. This reverts commit a265fbd397. This reverts commit b9fef1a7cd. This reverts commit b0eb64ff7b. This reverts commit f1795463bf. This reverts commit 70cbb1a5e3. This reverts commit 42bf020463. This reverts commit 379f2650cf. This reverts commit 7ff22d6da4. This reverts commit 5a0b652d36. This reverts commit 432a174bc1. This reverts commit b14f8a1baf, reversing changes made to e713855dca.	3 years ago
Patrick Cloke	a4521ce0a8	Support the stable /hierarchy endpoint from MSC2946 (#11329) ... This also makes additional updates where the implementation had drifted from the approved MSC. Unstable endpoints will be removed at a later data.	3 years ago
Patrick Cloke	9d1971a5c4	Return the stable `event` field from `/send_join` per MSC3083. (#11413) ... This does not remove the unstable field and still parses both. Handling of the unstable field will need to be removed in the future.	3 years ago
Richard van der Hoff	e2e9bea1ce	Publish a `develop` docker image (#11380) ... I'd find it helpful to have a docker image corresponding to current develop, without having to build my own.	3 years ago
Dirk Klimpel	93aa670642	Update outdated links in `PULL_REQUEST_TEMPLATE.md` (#11225)	3 years ago
Hillery Shay	7d70582eb0	Fix broken export-data admin command and add a test for it to CI (#11078) ... Fix broken export-data admin command and add a test for it to CI	3 years ago
Patrick Cloke	8711e15734	Always dump logs from trial during CI. (#11068) ... Instead of only dumping them if trial passes.	3 years ago
Erik Johnston	0b4d5ce5e3	Fix CI to run the unit tests without optional deps (#11017) ... This also turns off calculating code coverage, as we didn't use it and it was a lot of noise	3 years ago
Brendan Abolivier	b0460936c8	Add the synapse-core team as code owners (#10994) ... Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>	3 years ago
David Robertson	6f6e956338	Run CI with Python 3.10 and Postgres 14 (#10992)	3 years ago
Patrick Cloke	ebd8baf61f	Clear our destination directories before copying files to GitHub pages. (#10869) ... This should fix stale deleted files being still accessible.	3 years ago
David Robertson	f455b0e420	GHA: reintroduce an env var for `$GITHUB_HEAD_REF` (#10659) ... This should ensure GHA runs synapse against the same-named sytest branch	3 years ago
Dan Callahan	2efc838f05	Avoid duplicate issues from Twisted trunk failures (#10672) ... Setting `update_existing: true` in the `create-an-issue` GitHub Action will avoid opening duplicate issues if an open issue already exists with an identical title. If no open issues match the title, then a new issue will be created. This helps avoid spamming our issue tracker should there be a failure when testing against Twisted's trunk. This PR also pins the SHA of the `create-an-issue` action to mitigate the risk of a malicious actor gaining access to JasonEtco's account. See GitHub's page on security hardening third party actions for more: https://docs.github.com/en/actions/learn-github-actions/security-hardening-for-github-actions#using-third-party-actions Signed-off-by: Dan Callahan <danc@element.io>	3 years ago
Richard van der Hoff	4db65f911a	Run a nightly CI build against Twisted trunk. (#10651) ... This creates a GHA workflow which runs at 8am every day, and runs mypy, trial and sytest against Twisted's current trunk. If any of the jobs fail, it opens an issue.	3 years ago
David Robertson	878528913d	Remove buildkite-era comment	3 years ago
David Robertson	74fcd5aab9	portdb also uses coverage, so provide $TOP there	3 years ago
David Robertson	cb5976ebd7	set TOP in sytest containers	3 years ago
David Robertson	33ef86aa25	Rename ci to .ci	3 years ago
David Robertson	58e5da5aa0	Remove buildkite from portdb CI tests	3 years ago
David Robertson	c5988a8eb7	Remove unused BUILDKITE_BRANCH env var	3 years ago
David Robertson	3d67b8c82b	Move sytest worker-blacklist to ci directory	3 years ago
David Robertson	03fb99a5c8	check-newsfragment: pass pr number explicitly ... use PULL_REQUEST_NUMBER instead of BUILDKITE_PULL_REQUEST remove the other user of BUILDKITE_PULL_REQUEST, namely merge_base_branch.sh	3 years ago
David Robertson	8da9e3cb69	Move test_old_deps.sh to new ci dir	3 years ago
Erik Johnston	e33f14e8d5	Don't fail CI when lint-newfile job was skipped (#10529)	3 years ago
Richard van der Hoff	a6ea32a798	Fix the `tests-done` github actions step, again (#10512)	3 years ago
Patrick Cloke	13944678c3	Use new go test running syntax for complement. (#10488) ... Updates CI and the helper script t ensures all tests are run (in parallel).	3 years ago
Richard van der Hoff	f22252d4f9	Enable docker image caching for the deb build (#10431)	3 years ago
Richard van der Hoff	4c3fdfc808	Fix an error in the docker workflow (#10461)	3 years ago
Richard van der Hoff	5e2df47f72	Cancel redundant GHA workflows (#10451)	3 years ago
Richard van der Hoff	f1347bcfdc	Fix the tests-done Github Actions job (#10444)	3 years ago
Richard van der Hoff	c6509991f3	Move the docker image build to Github Actions (#10416) ... it's flaky on circleCI, and having to manage multiple CI providers is painful.	3 years ago
Richard van der Hoff	97c8ae90f7	Add a github actions job recording success of other jobs. (#10430)	3 years ago
Richard van der Hoff	07e0992a76	Make GHA config more efficient (#10383) ... A few things here: * Build the debs for single distro for each PR, so that we can see if it breaks. Do the same for develop. Building all the debs ties up the GHA workers for ages. * Stop building the debs for release branches. Again, it takes ages, and I don't think anyone is actually going to stop and look at them. We'll know they are working when we make an RC. * Change the configs so that if we manually cancel a workflow, it actually does something.	3 years ago
Richard van der Hoff	2d8b60e0f2	Github Actions workflow to attach release artifacts to release (#10379)	3 years ago
Richard van der Hoff	ae81ec428d	Build the python release artifacts in GHA too	3 years ago