11254 Commits (8c69b735e3186875a8bf676241f990470fb7c592)

 

All Branches   

Search

Author	SHA1	Message	Date
Richard van der Hoff	8c69b735e3	Make Distributor run its processes as a background process ... This is more involved than it might otherwise be, because the current implementation just drops its logcontexts and runs everything in the sentinel context. It turns out that we aren't actually using a bunch of the functionality here (notably suppress_failures and the fact that Distributor.fire returns a deferred), so the easiest way to fix this is actually by simplifying a bunch of code.	6 years ago
Richard van der Hoff	08436c556a	changelog	6 years ago
Richard van der Hoff	667fba68f3	Run things as background processes ... This fixes #3518, and ensures that we get useful logs and metrics for lots of things that happen in the background. (There are certainly more things that happen in the background; these are just the common ones I've found running a single-process synapse locally).	6 years ago
Richard van der Hoff	65d6a0e477	Merge pull request #3553 from matrix-org/rav/background_process_tracking ... Resource tracking for background processes	6 years ago
Richard van der Hoff	dab00faa83	Merge pull request #3367 from matrix-org/rav/drop_re_signing_hacks ... Remove event re-signing hacks	6 years ago
David Baker	c91a44572e	Merge pull request #3514 from matrix-org/dbkr/turn_dont_add_defaults ... Comment dummy TURN parameters in default config	6 years ago
Richard van der Hoff	92aecd557b	changelog	6 years ago
Richard van der Hoff	6e3fc657b4	Resource tracking for background processes ... This introduces a mechanism for tracking resource usage by background processes, along with an example of how it will be used. This will help address #3518, but more importantly will give us better insights into things which are happening but not being shown up by the request metrics. We *could* do this with Measure blocks, but: - I think having them pulled out as a completely separate metric class will make it easier to distinguish top-level processes from those which are nested. - I want to be able to report on in-flight background processes, and I don't think we want to do this for *all* Measure blocks.	6 years ago
Richard van der Hoff	0aed3fc346	Merge pull request #3546 from matrix-org/rav/fix_erasure_over_federation ... Fix visibility of events from erased users over federation	6 years ago
Richard van der Hoff	79eb339c66	add a comment	6 years ago
Richard van der Hoff	4a11df5b64	changelog	6 years ago
Richard van der Hoff	d897be6a98	Fix visibility of events from erased users over federation	6 years ago
Richard van der Hoff	9c04b4abf9	Merge pull request #3541 from matrix-org/rav/optimize_filter_events_for_server ... Refactor and optimze filter_events_for_server	6 years ago
Richard van der Hoff	94440ae994	fix imports	6 years ago
Amber Brown	bc006b3c9d	Refactor REST API tests to use explicit reactors (#3351)	6 years ago
Erik Johnston	c7320a5564	Merge pull request #3544 from matrix-org/erikj/fixup_stream_cache ... Fix perf regression in PR #3530	6 years ago
Richard van der Hoff	2172a3d8cb	add a comment	6 years ago
Erik Johnston	b2aa05a8d6	Use efficient .intersection	6 years ago
Erik Johnston	850238b4ef	Add unit test	6 years ago
Erik Johnston	9952d18e4d	Newsfile	6 years ago
Erik Johnston	547b1355d3	Fix perf regression in PR #3530 ... The get_entities_changed function was changed to return all changed entities since the given stream position, rather than only those changed from a given list of entities. This resulted in the function incorrectly returning large numbers of entities that, for example, caused large increases in database usage.	6 years ago
Amber Brown	3fe0938b76	Merge pull request #3530 from matrix-org/erikj/stream_cache ... Don't return unknown entities in get_entities_changed	6 years ago
Amber Brown	fe10dd9fb2	Merge pull request #3540 from krombel/enforce_isort ... check isort by travis	6 years ago
Krombel	9677b1d1c0	rename 'isort' to 'check_isort' as requested	6 years ago
Richard van der Hoff	2731bf7ac3	Changelog	6 years ago
Richard van der Hoff	09e29fb58b	Attempt to make _filter_events_for_server more efficient	6 years ago
Richard van der Hoff	15b13b537f	Add a test which profiles filter_events_for_server in a large room	6 years ago
Krombel	78a9ddcf9a	rerun isort with latest version	6 years ago
Richard van der Hoff	ea69d35651	Move filter_events_for_server out of FederationHandler ... for easier unit testing.	6 years ago
Krombel	4a27000548	check isort by travis	6 years ago
Amber Brown	8a4f05fefb	Fix develop because I broke it :( (#3535)	6 years ago
Amber Brown	8532953c04	Merge pull request #3534 from krombel/use_parse_and_asserts_from_servlet ... Use parse and asserts from http.servlet	6 years ago
Amber Brown	a2374b2c7f	fix sytests	6 years ago
Amber Brown	33b60c01b5	Make auth & transactions more testable (#3499)	6 years ago
Krombel	516f960ad8	add changelog	6 years ago
Krombel	3366b9c534	rename assert_params_in_request to assert_params_in_dict ... the method "assert_params_in_request" does handle dicts and not requests. A request body has to be parsed to json before this method can be used	6 years ago
Krombel	32fd6910d0	Use parse_{int,str} and assert from http.servlet ... parse_integer and parse_string can take a request and raise errors in case we have wrong or missing params. This PR tries to use them more to deduplicate some code and make it better readable	6 years ago
Erik Johnston	bc832f822f	Fixup unit test	6 years ago
Richard van der Hoff	2aba1f549c	Merge pull request #3533 from matrix-org/rav/fix_federation_ratelimite_queue ... Make FederationRateLimiter queue requests properly	6 years ago
Richard van der Hoff	08546be40f	better changelog	6 years ago
Richard van der Hoff	b03a0e14db	changelog	6 years ago
Richard van der Hoff	3b391d9c45	Fix unit tests	6 years ago
Richard van der Hoff	33b40d0a25	Make FederationRateLimiter queue requests properly ... popitem removes the *most recent* item by default [1]. We want the oldest. Fixes #3524 [1]: https://docs.python.org/2/library/collections.html#collections.OrderedDict.popitem	6 years ago
Erik Johnston	5f263b607e	Newsfile	6 years ago
Erik Johnston	77b692e65d	Don't return unknown entities in get_entities_changed ... The stream cache keeps track of all entities that have changed since a particular stream position, so get_entities_changed does not need to return unknown entites when given a larger stream position. This makes it consistent with the behaviour of has_entity_changed.	6 years ago
Matthew Hodgson	ba22b6a456	typo	6 years ago
Richard van der Hoff	6dff49b8a9	Merge pull request #3521 from matrix-org/rav/optimise_stream_change_cache ... Reduce set building in get_entities_changed	6 years ago
Richard van der Hoff	38c5fa7ee4	changelog	6 years ago
Richard van der Hoff	fa5c2bc082	Reduce set building in get_entities_changed ... This line shows up as about 5% of cpu time on a synchrotron: not_known_entities = set(entities) - set(self._entity_to_key) Presumably the problem here is that _entity_to_key can be largeish, and building a set for its keys every time this function is called is slow. Here we rewrite the logic to avoid building so many sets.	6 years ago
Richard van der Hoff	4c4dd6299d	Merge pull request #3316 from matrix-org/rav/enforce_report_api ... Enforce the specified API for report_event	6 years ago