118 Commits (3c320c006ccaa984e1a4a46d5d5d2e5e23d11c6e)

Author	SHA1	Message	Date
Erik Johnston	d51b8a1674	Add quotes and be explicity about script-src	8 years ago
Erik Johnston	662b031a30	Allow PDF to be rendered from media repo	8 years ago
Erik Johnston	0af9e1a637	Set `Content-Security-Policy` on media repo ... This is to inform browsers that they should sandbox the returned media. This is particularly cruical for javascript/HTML files.	8 years ago
Erik Johnston	f90b3d83a3	Add None check to _iterate_over_text	8 years ago
Erik Johnston	109a560905	Flake8	8 years ago
Erik Johnston	48b5829aea	Fix up preview URL API. Add tests. ... This includes: - Splitting out methods of a class into stand alone functions, to make them easier to test. - Adding unit tests to split out functions, testing HTML -> preview. - Handle the fact that elements in lxml may have tail text.	8 years ago
Erik Johnston	5bcccfde6c	Don't include html comments in description	8 years ago
Erik Johnston	b5525c76d1	Typo	8 years ago
Erik Johnston	e97648c4e2	Test summarization	8 years ago
Erik Johnston	58c9653c6b	Don't infer paragrahs from newlines	8 years ago
Erik Johnston	6b58ade2f0	Comment on why we clone	8 years ago
Erik Johnston	9e66c58ceb	Spelling.	8 years ago
Erik Johnston	f83f5fbce8	Make it actually compile	8 years ago
Erik Johnston	aecaec3e10	Change the way we summarize URLs ... Using XPath is slow on some machines (for unknown reasons), so use a different approach to get a list of text nodes. Try to generate a summary that respect paragraph and then word boundaries, adding ellipses when appropriate.	8 years ago
Erik Johnston	f52cb4cd78	Remove race	9 years ago
Erik Johnston	a70688445d	Implement purge_media_cache admin API	9 years ago
Erik Johnston	314b146b2e	Track approximate last access time for remote media	9 years ago
Mark Haines	13e334506c	Remove the legacy v0 content upload API. ... The existing content can still be downloaded. The last upload to the matrix.org server was in January 2015, so it is probably safe to remove the upload API.	9 years ago
Erik Johnston	09a17f965c	Line lengths	9 years ago
Erik Johnston	1e9026e484	Handle floats as img widths	9 years ago
Erik Johnston	a60169ea09	Handle og props with not content	9 years ago
Erik Johnston	eba4ff1bcb	502 on /thumbnail when can't contact remote server	9 years ago
Mark Haines	eb79110beb	Clean up the blacklist/whitelist handling. ... Always set the config key with an empty list, even if a list isn't specified. This means that the codepaths are the same for both the empty list and for a missing key. Since the behaviour is the same for both cases this makes the code somewhat easier to reason about.	9 years ago
Mark Haines	8d7ad44331	Report per request metrics for all of the things using request_handler	9 years ago
Erik Johnston	e8884e5e9c	Add self.media_repo to PreviewUrlResource	9 years ago
Erik Johnston	a7001c311b	_make_dirs was moved to MediaRepository	9 years ago
Erik Johnston	9181e2f4c7	Add store to PreviewUrlResource	9 years ago
Erik Johnston	fb76a81ff7	Reorder imports	9 years ago
Erik Johnston	0c93df89b6	Move MediaRepository to media_repository module	9 years ago
Erik Johnston	43f0941e8f	Split out BaseMediaResource into MediaRepository ... This is so that a single MediaRepository can be shared across all resources, rather than having a "copy" per resource. In particular this allows us to guard against both the thumbnail and download resource triggering a download of remote content at the same time.	9 years ago
Matthew Hodgson	aaabbd3e9e	explicitly pass in the charset from Content-Type to lxml to fix cyrillic woes better	9 years ago
Matthew Hodgson	84f9cac4d0	fix cyrillic URL previews by hardcoding all page decoding to UTF-8 for now, rather than relying on lxml's heuristics which seem to get it wrong	9 years ago
Matthew Hodgson	f78b479118	fix urlparse import thinko breaking tiny URLs	9 years ago
Matthew Hodgson	bd77216d06	comment out 2c838f6459 due to risk of https://en.wikipedia.org/wiki/Billion_laughs attacks - thanks @torhve	9 years ago
Erik Johnston	d0633e6dbe	Sanitize the optional dependencies for spider API	9 years ago
Erik Johnston	17515bae14	PEP8	9 years ago
Matthew Hodgson	5ffacc5e84	fix typos and needless try/except from PR review	9 years ago
Matthew Hodgson	83b2f83da0	actually throw meaningful errors	9 years ago
Mark Haines	b36270b5e1	Fix pep8 warning	9 years ago
Matthew Hodgson	1ccabe2965	more PR feedback	9 years ago
Matthew Hodgson	dafef5a688	Add url_preview_enabled config option to turn on/off preview_url endpoint. defaults to off. ... Add url_preview_ip_range_blacklist to let admins specify internal IP ranges that must not be spidered. Add url_preview_url_blacklist to let admins specify URL patterns that must not be spidered. Implement a custom SpiderEndpoint and associated support classes to implement url_preview_ip_range_blacklist Add commentary and generally address PR feedback	9 years ago
Matthew Hodgson	cf51c4120e	report image size (bytewise) in OG meta	9 years ago
Matthew Hodgson	0834b152fb	char encoding	9 years ago
Matthew Hodgson	8b98a7e8c3	pep8	9 years ago
Matthew Hodgson	eab4d462f8	fix etag typing error. fix timestamp typing error	9 years ago
Matthew Hodgson	c3916462f6	rebase all image URLs	9 years ago
Matthew Hodgson	110780b18b	remove stale todo	9 years ago
Matthew Hodgson	b09e29a03c	Ensure only one download for a given URL is active at a time	9 years ago
Matthew Hodgson	7426c86eb8	add a persistent cache of URL lookups, and fix up the in-memory one to work	9 years ago
Matthew Hodgson	d1b154a10f	support gzip compression, and don't pass through error msgs	9 years ago