121 Commits (watcha-develop)

Author	SHA1	Message	Date
Erik Johnston	23740eaa3d	Correctly mention previous copyright (#16820) ... During the migration the automated script to update the copyright headers accidentally got rid of some of the existing copyright lines. Reinstate them.	10 months ago
Patrick Cloke	8e1e62c9e0	Update license headers	1 year ago
Patrick Cloke	d38d0dffc9	Use StrCollection in additional places. (#16301)	1 year ago
David Robertson	d162aecaac	Quick & dirty metric for background update status (#15740) ... * Quick & dirty metric for background update status * Changelog * Remove debug Co-authored-by: Mathieu Velten <mathieuv@matrix.org> * Actually write to _aborted --------- Co-authored-by: Mathieu Velten <mathieuv@matrix.org>	1 year ago
dependabot[bot]	9bb2eac719	Bump black from 22.12.0 to 23.1.0 (#15103)	2 years ago
reivilibre	9af2be192a	Remove legacy Prometheus metrics names. They were deprecated in Synapse v1.69.0 and disabled by default in Synapse v1.71.0. (#14538)	2 years ago
reivilibre	be4250c7a8	Add experimental configuration option to allow disabling legacy Prometheus metric names. (#13540) ... Co-authored-by: David Robertson <davidr@element.io>	2 years ago
David Robertson	f30bcbd84a	Fix Synapse git info missing in version strings (#12973)	3 years ago
Richard van der Hoff	ae01a7edd3	Update type annotations for compatiblity with prometheus_client 0.14 (#12389) ... Principally, `prometheus_client.REGISTRY.register` now requires its argument to extend `prometheus_client.Collector`. Additionally, `Gauge.set` is now annotated so that passing `Optional[int]` causes an error.	3 years ago
David Robertson	4ae956c8bb	Use version string helper from matrix-common (#11979) ... * Require latest matrix-common * Use the common function	3 years ago
reivilibre	41818cda1f	Fix type errors introduced by new annotations in the Prometheus Client library. (#11832) ... Co-authored-by: David Robertson <davidr@element.io>	3 years ago
Richard van der Hoff	6a78ede569	Improve `reactor_tick_time` metric (#11724) ... The existing implementation of the `python_twisted_reactor_tick_time` metric is pretty useless, because it *only* measures the time taken to execute timed calls and callbacks from threads. That neglects everything that happens off the back of I/O, which is obviously quite a lot for us. To improve this, I've hooked into a different place in the reactor - in particular, where it calls `epoll`. That call is the only place it should wait for something to happen - the rest of the loop *should* be quick. I've also removed `python_twisted_reactor_pending_calls`, because I don't believe anyone ever looks at it, and it's a nuisance to populate.	3 years ago
Richard van der Hoff	20c6d85c6e	Simplify GC prometheus metrics (#11723) ... Rather than hooking into the reactor loop, just add a timed task that runs every 100 ms to do the garbage collection. Part 1 of a quest to simplify the reactor monkey-patching.	3 years ago
Patrick Cloke	10a88ba91c	Use auto_attribs/native type hints for attrs classes. (#11692)	3 years ago
Sean Quah	84fac0f814	Add type annotations to `synapse.metrics` (#10847)	3 years ago
Erik Johnston	82d2168a15	Add metrics to the threadpools (#11178)	3 years ago
David Robertson	1bfd141205	Type hints for the remaining two files in `synapse.http`. (#11164) ... * Teach MyPy that the sentinel context is False This means that if `ctx: LoggingContextOrSentinel` then `bool(ctx)` narrows us to `ctx:LoggingContext`, which is a really neat find! * Annotate RequestMetrics - Raise errors for sentry if we use the sentinel context - Ensure we don't raise an error and carry on, but not recording stats - Include stack trace in the error case to lower Sean's blood pressure * Make mypy pass for synapse.http.request_metrics * Make synapse.http.connectproxyclient pass mypy Co-authored-by: reivilibre <oliverw@matrix.org>	3 years ago
Jonathan de Jong	bf72d10dbf	Use inline type hints in various other places (in `synapse/`) (#10380)	3 years ago
Erik Johnston	8771b1337d	Export jemalloc stats to prometheus when used (#9882)	4 years ago
Erik Johnston	1fb9a2d0bf	Limit how often GC happens by time. (#9902) ... Synapse can be quite memory intensive, and unless care is taken to tune the GC thresholds it can end up thrashing, causing noticable performance problems for large servers. We fix this by limiting how often we GC a given generation, regardless of current counts/thresholds. This does not help with the reverse problem where the thresholds are set too high, but that should only happen in situations where they've been manually configured. Adds a `gc_min_seconds_between` config option to override the defaults. Fixes #9890.	4 years ago
Jonathan de Jong	4b965c862d	Remove redundant "coding: utf-8" lines (#9786) ... Part of #9744 Removes all redundant `# -*- coding: utf-8 -*-` lines from files, as python 3 automatically reads source code as utf-8 now. `Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>`	4 years ago
Andrew Morgan	0d87c6bd12	Don't report anything from GaugeBucketCollector metrics until data is present (#8926) ... This PR modifies `GaugeBucketCollector` to only report data once it has been updated, rather than initially reporting a value of 0. Fixes zero values being reported for some metrics on startup until a background job to update the metric's value runs later.	4 years ago
Patrick Cloke	33a02f0f52	Fix additional type hints from Twisted upgrade. (#9518)	4 years ago
Eric Eastwood	0a00b7ff14	Update black, and run auto formatting over the codebase (#9381) ... - Update black version to the latest - Run black auto formatting over the codebase - Run autoformatting according to [`docs/code_style.md `](80d6dc9783/docs/code_style.md) - Update `code_style.md` docs around installing black to use the correct version	4 years ago
Erik Johnston	427ede619f	Add metrics for tracking 3PID /requestToken requests. (#8712) ... The main use case is to see how many requests are being made, and how many are second/third/etc attempts. If there are large number of retries then that likely indicates a delivery problem.	4 years ago
Richard van der Hoff	6d2d42f8fb	Rewrite BucketCollector ... This was a bit unweildy for what I wanted: in particular, I wanted to assign each measurement straight into a bucket, rather than storing an intermediate Counter which didn't do any bucketing at all. I've replaced it with something that is hopefully a bit easier to use. (I'm not entirely sure what the difference between a HistogramMetricFamily and a GaugeHistogramMetricFamily is, but given our counters can go down as well as up the latter *sounds* more accurate?)	4 years ago
Patrick Cloke	aec294ee0d	Use slots in attrs classes where possible (#8296) ... slots use less memory (and attribute access is faster) while slightly limiting the flexibility of the class attributes. This focuses on objects which are instantiated "often" and for short periods of time.	4 years ago
Patrick Cloke	c619253db8	Stop sub-classing object (#8249)	4 years ago
Erik Johnston	a99658074d	Add some metrics for inbound and outbound federation processing times (#7755)	4 years ago
Patrick Cloke	bd6dc17221	Replace iteritems/itervalues/iterkeys with native versions. (#7692)	5 years ago
Ivan Shapovalov	ac481a738e	synapse.metrics: implement detailed memory usage reporting on PyPy (#7536) ... PyPy's gc.get_stats() returns an object containing detailed allocator statistics which could be beneficial to collect as metrics. Signed-off-by: Ivan Shapovalov <intelfx@intelfx.name>	5 years ago
Richard van der Hoff	8c75667ad7	Add prometheus metrics for the number of active pushers (#7103)	5 years ago
Patrick Cloke	509e381afa	Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957) ... Ensure good comprehension hygiene using flake8-comprehensions.	5 years ago
Amber Brown	864f144543	Fix up some typechecking (#6150) ... * type checking fixes * changelog	5 years ago
Amber Brown	b617864cd9	Fix for structured logging tests stomping on logs (#6023)	5 years ago
Amber Brown	aeb9b2179e	Add a build info metric to Prometheus (#6005)	5 years ago
Amber Brown	7ad1d76356	Support Prometheus_client 0.4.0+ (#5636)	5 years ago
Amber Brown	071150ce19	Don't log GC 0s at INFO (#5557)	5 years ago
Amber Brown	32e7c9e7f2	Run Black. (#5482)	6 years ago
Erik Johnston	3ed595e327	Prometheus histograms are cumalative	6 years ago
Amber H. Brown	a10c8dae85	fix prometheus rendering error	6 years ago
Amber Brown	6312d6cc7c	Expose statistics on extrems to prometheus (#5384)	6 years ago
Richard van der Hoff	82ca6d1f9f	Add metrics for number of outgoing EDUs, by type (#4695)	6 years ago
Erik Johnston	d0f6c1ce21	Remove spurious comment	6 years ago
Erik Johnston	0a81038ea0	Add in flight real time metrics for Measure blocks	6 years ago
Richard van der Hoff	bab94da79c	fix metric name	6 years ago
Richard van der Hoff	53bca4690b	more metrics for the federation and appservice senders	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Amber Brown	6350bf925e	Attempt to be more performant on PyPy (#3462)	7 years ago
Richard van der Hoff	cbbfaa4be8	Fix description of "python_gc_time" metric	7 years ago