nextcloud-server

Commit Graph

Author	SHA1	Message	Date
Louis Chmn	00ec57efd6	fix(S3): Only append streams if non-seekable Later, when we rewind the stream in `writeMultiPart` during retry, both streams were rewinded, so the resulting stream was bigger than expected. Inspired by https://github.com/aws/aws-sdk-php/blob/master/src/S3/ObjectUploader.php#L136-L146 Signed-off-by: Louis Chmn <louis@chmn.me>	3 months ago
Robin Appelman	398b106f0c	fix: validate written size for s3 multipart uploads Signed-off-by: Robin Appelman <robin@icewind.nl>	5 months ago
Kent Delante	06b5ce5859	fix(s3): retry failed multipart uploads with decreased concurrency Signed-off-by: Kent Delante <kent.delante@proton.me>	7 months ago
Robin Appelman	8aae332622	feat: store original storage id and path in object store metadata Signed-off-by: Robin Appelman <robin@icewind.nl>	9 months ago
Robin Appelman	94114b99f7	feat: more generic way of passing metadata to object storage backends for new objects Signed-off-by: Robin Appelman <robin@icewind.nl>	9 months ago
Robin Appelman	ca547bb913	fix: don't perform the extra buffering in s3 stream write when the stream size is known Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	7da8951c57	fix: use php://temp instead of php://memory for multi-part upload buffer this should reduce potential memory issues if the limit is set very high Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Daniel Kesselberg	af6de04e9e	style: update codestyle for coding-standard 1.2.3 Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>	1 year ago
Andy Scherzinger	dae7c159f7	chore: Add SPDX header Signed-off-by: Andy Scherzinger <info@andy-scherzinger.de>	2 years ago
Côme Chilliet	ec5133b739	fix: Apply new coding standard to all files Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	2 years ago
Ferdinand Thiessen	32dee2f84a	feat(ObjectStore): Make S3 MultipartUpload concurrency configurable Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Ferdinand Thiessen	69c5e8ebde	fix(ObjectStore): Use common S3 trait so config and connection trait members are in sync Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Robin Appelman	c54f7bd761	fix: disable the internal s3sdk multi part copy logic Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Julius Härtl	e4054370b1	fix(s3): Add config option to disable multipart copy for certain s3 providers Signed-off-by: Julius Härtl <jus@bitgrid.net>	2 years ago
Robin Appelman	1043c21b35	only do a multipart s3 copy when above the regular copy limit Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Tobias Zimmerer	cdf96fab92	fix(s3): support SSE-C headers for the MultipartCopy call Signed-off-by: Tobias Zimmerer <3228193+ir0nhide@users.noreply.github.com>	2 years ago
Robin Appelman	eab8dd3ca0	use multipart copy for s3 Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Robin Appelman	b40fa64a8b	use multipart copy for s3 Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Robin Appelman	ea88ec1350	add utility command for object store objects Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Julius Härtl	159a0c8411	feat(s3): Add option to specify an SSE-C customer provided key Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
François Ménabé	cf9bdc0274	Manage s3 storage class in objectstore Signed-off-by: François Ménabé <francois.menabe@gmail.com>	3 years ago
Maxence Lange	cc639a8877	compare cached filesize on download Signed-off-by: Maxence Lange <maxence@artificial-owl.com>	3 years ago
Julius Härtl	214a50d071	Avoid allocating too much memory for the buffer Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
Robin Appelman	61fdd91dcf	don't set `null` as a bundle path Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	f1486890d7	only use nextcloud bundle when explicitly enabled Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	bffa67c48b	also use nextcloud certificate bundle when downloading from s3 Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Louis Chemineau	bc2c02f451	Wrap S3 multipart upload exception Signed-off-by: Louis Chemineau <louis@chmn.me>	4 years ago
Louis Chemineau	0b768c17d2	Wrap S3 multipart upload exception Signed-off-by: Louis Chemineau <louis@chmn.me>	4 years ago
Julius Härtl	2aac757805	Make max size for single put uploads configurable Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Robin Appelman	09ffac5e6d	s3 external storage listing rework Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Bernd Rederlechner	3866f388b1	Refactor writeObject to only use MultipartUpload when required Signed-off-by: Bernd Rederlechner <Bernd.Rederlechner@t-systems.com> Co-authored-by: Julius Härtl <jus@bitgrid.net>	4 years ago
John Molakvoæ (skjnldsv)	215aef3cbd	Update php licenses Signed-off-by: John Molakvoæ (skjnldsv) <skjnldsv@protonmail.com>	5 years ago
Robin Appelman	effb7dc8ba	set mimetype for objects uploaded to object storages Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Maxime Besson	547438527d	fix(proxy): reaching s3 storage behind some http proxy Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Samuel	03fe74b95e	fix(proxy): reaching s3 storage behind some http proxy Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Robin Appelman	3eb764e65d	remove explicit fclose from S3->writeStream streams get closed automatically when dropped, and in some cases the stream seems to be already closed by the S3 library, in which case trying to close it again will raise an error Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	9d4848e863	use in objectstore copy Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Christoph Wurst	2a054e6c04	Update the license headers for Nextcloud 20 Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Florent	3594ba6971	Upload part size as S3 parameter instead of constant value Some S3 providers need a custom upload part size (500 MB static value in Nextcloud). Here is a commit to change this value via S3 configuration, instead of using S3_UPLOAD_PART_SIZE constant. A new parameter is added for an S3 connection : uploadPartSize Signed-off-by: Florent <florent@coppint.com>	6 years ago
Christoph Wurst	cb057829f7	Update license headers for 19 Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Christoph Wurst	1584c9ae9c	Add visibility to all methods and position of static keyword Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Robin Appelman	7b07e7251c	make seekable s3 stream generic Signed-off-by: Robin Appelman <robin@icewind.nl>	6 years ago
Lukas Stabe	14401efb0f	Enable fseek for files in S3 storage Signed-off-by: Lukas Stabe <lukas@stabe.de>	6 years ago
Christoph Wurst	5bf3d1bb38	Update license headers Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Morris Jobke	e45fb5fa3e	Fix typo in comment Signed-off-by: Morris Jobke <hey@morrisjobke.de>	7 years ago
Roeland Jago Douma	e953205908	Use HTTP1.1 to read S3 objects Some of the READs otherwise use HTTP/1.0 which is not always supported by all backends. HTTP/1.1 is there since 1999 way longer than S3 so safe to assume it is always there IMO. Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>	7 years ago
Roeland Jago Douma	61d66d7954	Fix empty file uploads to S3 Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>	7 years ago
Robin Appelman	1d322d3b37	always use multipart uploader for s3 uploads the multipart uploader handles non seekable streams while `upload` does not Signed-off-by: Robin Appelman <robin@icewind.nl>	7 years ago
Robin Appelman	6c9f2644cf	Add objectExists to objectstore interface Signed-off-by: Robin Appelman <robin@icewind.nl>	7 years ago
Morris Jobke	d3d045dd5c	Remove unused import statements Signed-off-by: Morris Jobke <hey@morrisjobke.de>	8 years ago

1 2

60 Commits (addParameterTypingVersionsMapper)