86 Commits (4a33a6dd19590b8e6626a5af5a69507dc11236f8)

Author	SHA1	Message	Date
Andrew Morgan	3916e1b97a	Clean up newline quote marks around the codebase (#6362)	5 years ago
Richard van der Hoff	1cb84c6486	Support for routing outbound HTTP requests via a proxy (#6239) ... The `http_proxy` and `HTTPS_PROXY` env vars can be set to a `host[:port]` value which should point to a proxy. The address of the proxy should be excluded from IP blacklists such as the `url_preview_ip_range_blacklist`. The proxy will then be used for * push * url previews * phone-home stats * recaptcha validation * CAS auth validation It will *not* be used for: * Application Services * Identity servers * Outbound federation * In worker configurations, connections from workers to masters Fixes #4198.	5 years ago
Amber Brown	020add5099	Update black to 19.10b0 (#6304) ... * update version of black and also fix the mypy config being overridden	5 years ago
Andrew Morgan	54fef094b3	Remove usage of deprecated logger.warn method from codebase (#6271) ... Replace every instance of `logger.warn` with `logger.warning` as the former is deprecated.	5 years ago
Erik Johnston	69f0054ce6	Port to use state storage	5 years ago
Erik Johnston	05bae6b4fc	Add opentracing span for HTTP push	5 years ago
Erik Johnston	d02e41dcb2	Handle pusher being deleted during processing. ... Instead of throwing a StoreError lets break out of processing loop and mark the pusher as stopped.	5 years ago
Amber Brown	4806651744	Replace returnValue with return (#5736)	5 years ago
Amber Brown	32e7c9e7f2	Run Black. (#5482)	6 years ago
Erik Johnston	5bec8d660d	Make starting pushers faster during start up ... We start all pushers on start up and immediately start a background process to fetch push to send. This makes start up incredibly painful when dealing with many pushers. Instead, let's do a quick fast DB check to see if there *may* be push to send and only start the background processes for those pushers. We also stagger starting up and doing those checks so that we don't try and handle all pushers at once.	6 years ago
Erik Johnston	1d9df51ff1	Correctly handle null data in HttpPusher	6 years ago
Richard van der Hoff	e07384c4e1	Add prometheus metrics for number of badge update pushes. (#4709) ... We're counting the number of push notifications, but not the number of badges; I'd like to see if they are significant.	6 years ago
Richard van der Hoff	b2200a8690	Logging improvements for the pusher (#4691)	6 years ago
Erik Johnston	b86d05a279	Clean up event accesses and tests ... This is in preparation to refactor FrozenEvent to support different event formats for different room versions	6 years ago
Richard van der Hoff	e564306e31	sanity-check the is_processing flag ... ... and rename it, for even more sanity	6 years ago
Richard van der Hoff	f749607c91	Make on_started synchronous too ... This brings it into line with on_new_notifications and on_new_receipts. It requires a little bit of hoop-jumping in EmailPusher to load the throttle params before the first loop.	6 years ago
Richard van der Hoff	e7a16c6210	Remove redundant run_as_background_process() from pusherpool ... `on_new_notifications` and `on_new_receipts` in `HttpPusher` and `EmailPusher` now always return synchronously, so we can remove the `defer.gatherResults` on their results, and the `run_as_background_process` wrappers can be removed too because the PusherPool methods will now complete quickly enough.	6 years ago
Richard van der Hoff	c7273c11bc	Give pushers their own background logcontext ... Each pusher has its own loop which runs for as long as it has work to do. This should run in its own background thread with its own logcontext, as other similar loops elsewhere in the system do - which means that CPU usage is consistently attributed to that loop, rather than to whatever request happened to start the loop.	6 years ago
Amber Brown	7c27c4d51c	merge (#3576)	6 years ago
Amber Brown	49af402019	run isort	6 years ago
Amber Brown	07cad26d65	Remove all global reactor imports & pass it around explicitly (#3424)	7 years ago
Amber Brown	85ba83eb51	fixes	7 years ago
Amber Brown	df9f72d9e5	replacing portions	7 years ago
Adrian Tschira	57b58e2174	make imports local ... Signed-off-by: Adrian Tschira <nota@notafile.com>	7 years ago
Richard van der Hoff	9255a6cb17	Improve exception handling for background processes ... There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.	7 years ago
Richard van der Hoff	03dd745fe2	Better logging when pushes fail	7 years ago
Richard van der Hoff	e051abd20b	add appid/device_display_name to to pusher logging	7 years ago
Richard van der Hoff	4528dd2443	Fix logging and add user_id	7 years ago
Richard van der Hoff	93efd7eb04	logging and debug for http pusher	7 years ago
David Baker	2a98ba0ed3	Rename redact_content option to include_content ... The redact_content option never worked because it read the wrong config section. The PR introducing it (https://github.com/matrix-org/synapse/pull/2301) had feedback suggesting the name be changed to not re-use the term 'redact' but this wasn't incorporated. This reanmes the option to give it a less confusing name, and also means that people who've set the redact_content option won't suddenly see a behaviour change when upgrading synapse, but instead can set include_content if they want to. This PR also updates the wording of the config comment to clarify that this has no effect on event_id_only push. Includes https://github.com/matrix-org/synapse/pull/2422	7 years ago
Richard van der Hoff	eaaabc6c4f	replace 'except:' with 'except Exception:' ... what could possibly go wrong	7 years ago
David Baker	436ee0a2ea	Also include the room_id ... as really it's part of the event ID	7 years ago
David Baker	b393f5db51	Use .get - it's much shorter	7 years ago
David Baker	a2562f9d74	Add support for event_id_only push format ... Param in the data dict of a pusher that tells an HTTP pusher to send just the event_id of the event it's notifying about and the notification counts. For clients that want to go & fetch the body of the event themselves anyway.	7 years ago
Caleb James DeLisle	75eba3b07d	Fix TravisCI tests for PR #2301	8 years ago
Caleb James DeLisle	1591eddaea	Add configuration parameter to allow redaction of content from push messages for google/apple devices	8 years ago
Erik Johnston	7356d52e73	Fix up push to use get_current_state_ids	8 years ago
Erik Johnston	b260f92936	Ignore AlreadyCalled errors on timer cancel	8 years ago
Mark Haines	0a7d3cd00f	Create separate methods for getting messages to push ... for the email and http pushers rather than trying to make a single method that will work with their conflicting requirements. The http pusher needs to get the messages in ascending stream order, and doesn't want to miss a message. The email pusher needs to get the messages in descending timestamp order, and doesn't mind if it misses messages.	8 years ago
David Baker	870c45913e	Use similar naming we use in email notifs for push ... Fixes https://github.com/vector-im/vector-web/issues/1654	9 years ago
Mark Haines	a3ac837599	Optionally split out the pushers into a separate process	9 years ago
Erik Johnston	86e9bbc74e	Add missing yield	9 years ago
Erik Johnston	e40f25ebe1	Rename log context	9 years ago
Erik Johnston	2ae91a9e2f	Make send_badge private	9 years ago
Erik Johnston	56da835eaf	Add necessary logging contexts	9 years ago
Erik Johnston	7be1065b8f	Add extra Measure	9 years ago
David Baker	9bb041791c	Run unsafe proces in a loop until we've caught up ... and wrap unsafe process in a try block	9 years ago
David Baker	d96a070a3a	Actually check if we;re processing	9 years ago
David Baker	7b6d519482	Make sure max stream ordering only increases	9 years ago
David Baker	52d1008661	Unsafe process should call itself if the max has changed	9 years ago