62 Commits (789606577ade2335f19e944efcfecfe808519b36)

Author	SHA1	Message	Date
Richard van der Hoff	39230d2171	Clean up some LoggingContext stuff (#7120) ... * Pull Sentinel out of LoggingContext ... and drop a few unnecessary references to it * Factor out LoggingContext.current_context move `current_context` and `set_context` out to top-level functions. Mostly this means that I can more easily trace what's actually referring to LoggingContext, but I think it's generally neater. * move copy-to-parent into `stop` this really just makes `start` and `stop` more symetric. It also means that it behaves correctly if you manually `set_log_context` rather than using the context manager. * Replace `LoggingContext.alive` with `finished` Turn `alive` into `finished` and make it a bit better defined.	5 years ago
Richard van der Hoff	c37db0211e	Share SSL contexts for non-federation requests (#7094) ... Extends #5794 etc to the SimpleHttpClient so that it also applies to non-federation requests. Fixes #7092.	5 years ago
Richard van der Hoff	1cb84c6486	Support for routing outbound HTTP requests via a proxy (#6239) ... The `http_proxy` and `HTTPS_PROXY` env vars can be set to a `host[:port]` value which should point to a proxy. The address of the proxy should be excluded from IP blacklists such as the `url_preview_ip_range_blacklist`. The proxy will then be used for * push * url previews * phone-home stats * recaptcha validation * CAS auth validation It will *not* be used for: * Application Services * Identity servers * Outbound federation * In worker configurations, connections from workers to masters Fixes #4198.	5 years ago
Erik Johnston	7777d353bf	Remove test debugs	5 years ago
Erik Johnston	1dec31560e	Change jitter to be a factor rather than absolute value	5 years ago
Erik Johnston	f299c5414c	Refactor MatrixFederationAgent to retry SRV. ... This refactors MatrixFederationAgent to move the SRV lookup into the endpoint code, this has two benefits: 1. Its easier to retry different host/ports in the same way as HostnameEndpoint. 2. We avoid SRV lookups if we have a free connection in the pool	5 years ago
Erik Johnston	e6e136decc	Retry well known on fail. ... If we have recently seen a valid well-known for a domain we want to retry on (non-final) errors a few times, to handle temporary blips in networking/etc.	5 years ago
Erik Johnston	17e1e80726	Retry well-known lookup before expiry. ... This gives a bit of a grace period where we can attempt to refetch a remote `well-known`, while still using the cached result if that fails. Hopefully this will make the well-known resolution a bit more torelant of failures, rather than it immediately treating failures as "no result" and caching that for an hour.	5 years ago
Erik Johnston	107ad133fc	Move well known lookup into a separate clas	5 years ago
Erik Johnston	af9f1c0764	Add a lower bound for TTL on well known results. ... It costs both us and the remote server for us to fetch the well known for every single request we send, so we add a minimum cache period. This is set to 5m so that we still honour the basic premise of "refetch frequently".	5 years ago
Erik Johnston	a9bcae9f50	Share SSL options for well-known requests	5 years ago
Amber Brown	4806651744	Replace returnValue with return (#5736)	5 years ago
Amber Brown	463b072b12	Move logging utilities out of the side drawer of util/ and into logging/ (#5606)	5 years ago
Richard van der Hoff	c3c6b00d95	Pass config_dir_path and data_dir_path into Config.read_config. (#5522) ... * Pull config_dir_path and data_dir_path calculation out of read_config_files * Pass config_dir_path and data_dir_path into read_config	6 years ago
Amber Brown	32e7c9e7f2	Run Black. (#5482)	6 years ago
Richard van der Hoff	db74c4fc6c	fix ci on py2, again	6 years ago
Richard van der Hoff	19780a521e	fix CI on python 2.7	6 years ago
Richard van der Hoff	e016681221	Tests for SSL certs for federation connections ... Add some tests for bad certificates for federation and .well-known connections	6 years ago
Richard van der Hoff	9fbb20a531	Stop hardcoding trust of old matrix.org key (#5374) ... There are a few changes going on here: * We make checking the signature on a key server response optional: if no verify_keys are specified, we trust to TLS to validate the connection. * We change the default config so that it does not require responses to be signed by the old key. * We replace the old 'perspectives' config with 'trusted_key_servers', which is also formatted slightly differently. * We emit a warning to the logs every time we trust a key server response signed by the old key.	6 years ago
Richard van der Hoff	e2dfb922e1	Validate federation server TLS certificates by default.	6 years ago
Amber Brown	df2ebd75d3	Migrate all tests to use the dict-based config format instead of hanging items off HomeserverConfig (#5171)	6 years ago
Andrew Morgan	5a4b328f52	Add ability to blacklist ip ranges for federation traffic (#5043)	6 years ago
Amber Brown	b36c82576e	Run Black on the tests again (#5170)	6 years ago
Andrew Morgan	6824ddd93d	Config option for verifying federation certificates (MSC 1711) (#4967)	6 years ago
Andrew Morgan	bb52a2e653	lint	6 years ago
Andrew Morgan	cd36a1283b	New test, fix issues	6 years ago
Andrew Morgan	c69df5d5d3	Fix comments. v0.99.2 -> v0.99.3	6 years ago
Andrew Morgan	94cb7939e4	Federation test fixed!	6 years ago
Andrew Morgan	621e7f37f1	Better exception handling	6 years ago
Andrew Morgan	ecea5af491	Correct var name	6 years ago
Andrew Morgan	86c60bda15	i should have given up x3	6 years ago
Andrew Morgan	45524f2f5e	i should have given up x2	6 years ago
Richard van der Hoff	5d27730a73	Move ClientTLSOptionsFactory init out of refresh_certificates (#4611) ... It's nothing to do with refreshing the certificates. No idea why it was here.	6 years ago
Richard van der Hoff	8a21b03fba	Treat an invalid .well-known the same as an absent one ... ... basically, carry on and fall back to SRV etc.	6 years ago
Richard van der Hoff	d428b46346	Update federation routing logic to check .well-known before SRV	6 years ago
Richard van der Hoff	c7b24ac3d0	Follow redirects on .well-known (#4520)	6 years ago
Richard van der Hoff	bc5f6e1797	Add a caching layer to .well-known responses (#4516)	6 years ago
Richard van der Hoff	cc2d650ef7	Relax requirement for a content-type on .well-known (#4511)	6 years ago
Richard van der Hoff	99e36d5e24	Implement MSC1708 (.well-known lookups for server routing) (#4489)	6 years ago
Richard van der Hoff	f2b553d656	Use SimpleResolverComplexifier in tests (#4497) ... two reasons for this. One, it saves a bunch of boilerplate. Two, it squashes unicode to IDNA-in-a-`str` (even on python 3) in a way that it turns out we rely on to give consistent behaviour between python 2 and 3.	6 years ago
Richard van der Hoff	0fd5b3b53e	Handle IP literals explicitly ... We don't want to be doing .well-known lookups on these guys.	6 years ago
Richard van der Hoff	d840019192	Fix idna and ipv6 literal handling in MatrixFederationAgent (#4487) ... Turns out that the library does a better job of parsing URIs than our reinvented wheel. Who knew. There are two things going on here. The first is that, unlike parse_server_name, URI.fromBytes will strip off square brackets from IPv6 literals, which means that it is valid input to ClientTLSOptionsFactory and HostnameEndpoint. The second is that we stay in `bytes` throughout (except for the argument to ClientTLSOptionsFactory), which avoids the weirdness of (sometimes) ending up with idna-encoded values being held in `unicode` variables. TBH it probably would have been ok but it made the tests fragile.	6 years ago
Richard van der Hoff	8520bc3109	Fix Host header sent by MatrixFederationAgent (#4468) ... Move the Host header logic down here so that (a) it is used if we reuse the agent elsewhere, and (b) we can mess about with it with .well-known.	6 years ago
Richard van der Hoff	afd69a0920	Look up the right SRV record	6 years ago
Richard van der Hoff	e1c8440e0c	lots more tests for MatrixFederationAgent	6 years ago
Richard van der Hoff	97fd29c019	Don't send IP addresses as SNI (#4452) ... The problem here is that we have cut-and-pasted an impl from Twisted, and then failed to maintain it. It was fixed in Twisted in https://github.com/twisted/twisted/pull/1047/files; let's do the same here.	6 years ago
Richard van der Hoff	d02c4532c0	Add a test for MatrixFederationAgent	6 years ago
Richard van der Hoff	7021784d46	put resolve_service in an object ... this makes it easier to stub things out for tests.	6 years ago
Richard van der Hoff	53a327b4d5	Require that service_name be a byte string ... it is only ever a bytes now, so let's enforce that.	6 years ago
Richard van der Hoff	7871146667	Make MatrixFederationClient use MatrixFederationAgent ... ... instead of the matrix_federation_endpoint	6 years ago