202 Commits (43589312ccbdf977bb6d89eae3bec28bde2dceff)

Author	SHA1	Message	Date
Julius Härtl	159a0c8411	feat(s3): Add option to specify an SSE-C customer provided key ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
Côme Chilliet	f5c361cf44	composer run cs:fix ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	3 years ago
François Ménabé	cf9bdc0274	Manage s3 storage class in objectstore ... Signed-off-by: François Ménabé <francois.menabe@gmail.com>	3 years ago
Maxence Lange	cc639a8877	compare cached filesize on download ... Signed-off-by: Maxence Lange <maxence@artificial-owl.com>	3 years ago
Robin Appelman	a5036a973c	allow disabling object store write check ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Carl Schwan	a5ea677370	Rename file1 and file2 to source and target in Storage abstraction ... Signed-off-by: Carl Schwan <carl@carlschwan.eu>	3 years ago
Julius Härtl	214a50d071	Avoid allocating too much memory for the buffer ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
Robin Appelman	457822c144	don't update the folder size if we know it hasn't changed ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	61fdd91dcf	don't set `null` as a bundle path ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	f1486890d7	only use nextcloud bundle when explicitly enabled ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	bffa67c48b	also use nextcloud certificate bundle when downloading from s3 ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Jasper Weyne	0633a1d9f5	Disable ~/.aws/config access by S3ConnectionTrait ... This commit sets the 'use_aws_shared_config_files' option to false, in order to disable configuration loading from ~/.aws/config by the AWS SDK, specifically the S3Client. It is a continuation of #27040, as that PR only changed the behaviour of the CredentialsProvider; this change affects the ConfigurationProvider as well. Signed-off-by: Jasper Weyne <jasperweyne@gmail.com>	4 years ago
Julius Härtl	0f0e74a78c	Cleanup temporary files after finishing the write to object storage ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Côme Chilliet	069477e608	Migrate more classes of lib/private to LoggerInterface ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	4 years ago
Carl Schwan	7817845538	Add a metadata service to store file metadata ... Signed-off-by: Carl Schwan <carl@carlschwan.eu>	4 years ago
Côme Chilliet	ea23523c70	Adapt more code to migration to LoggerInterface ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	4 years ago
Côme Chilliet	6be7aa112f	Migrate from ILogger to LoggerInterface in lib/private ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	4 years ago
Robin Appelman	1156214a26	don't try to get custom certs for s3 primary storage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	194a21f374	use the nextcloud certificate bundle for s3 ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Louis Chemineau	bc2c02f451	Wrap S3 multipart upload exception ... Signed-off-by: Louis Chemineau <louis@chmn.me>	4 years ago
Louis Chemineau	0b768c17d2	Wrap S3 multipart upload exception ... Signed-off-by: Louis Chemineau <louis@chmn.me>	4 years ago
Julius Härtl	2aac757805	Make max size for single put uploads configurable ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Julius Härtl	e475dfe16c	Fix php-cs for S3ConnectionTrait.php ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Côme Chilliet	66bdda568a	Fix Guzzle function calls ... Since 1.7.0 and 2.0 these functions are turned into static methods. See https://github.com/guzzle/psr7#upgrading-from-function-api Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	4 years ago
Stephen Cuppett	4a6a2c2b48	Simplify S3ConnectionTrait to defaultProvider plus option ... When we initially added the EC2 and ECS IAM role support in #24700, we had to use a workaround by explicitly ordering the various providers due to an inconsistency in the AWS SDK for PHP. We submitted a PR there to get that squared away. Now, we've consumed that version upstream for the SDK and can update our code here to be the most concise version as well as position ourselves to pick up new methods as those become available and prevalent in AWS (for acquiring credentials). See also: https://github.com/nextcloud/server/pull/24700#issuecomment-747650892 See also: https://github.com/aws/aws-sdk-php/pull/2172 Signed-off-by: Stephen Cuppett <steve@cuppett.com>	4 years ago
John Molakvoæ	6ab2feaa54	Implement multibucket shift for ObjectStore ... Signed-off-by: John Molakvoæ <skjnldsv@protonmail.com>	4 years ago
Carl Schwan	bfa60aaf27	Fix permissions when copying from ObjectStorage ... Make sure that when a user copy a file from a directory they don't have all permissions to a directory where they have more permissions, the permissions are correctly set to the one from the parent taget folder. This was caused by the ObjectStoreStorage::copyFromStorage using the jailed storage and cache entry instead of the unjailed one like other storages (the local one). Steps to reproduce + Use object storage + Create a groupfolder with one group having full permission and another one who can just read files. + With an user who is in the second group, copy a file from the groupfolder to the home folder of this user. + The file in the home folder of the user will be read only and can't be deleted even though it is in their home folder and they are the owner. In oc_filecache, the permissions stored for this file are 1 (READ) Signed-off-by: Carl Schwan <carl@carlschwan.eu>	4 years ago
Robin Appelman	09ffac5e6d	s3 external storage listing rework ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Bernd Rederlechner	3866f388b1	Refactor writeObject to only use MultipartUpload when required ... Signed-off-by: Bernd Rederlechner <Bernd.Rederlechner@t-systems.com> Co-authored-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Maxime Besson	388a458cd5	fix(proxy): use accessor ... Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Christoph Wurst	6d5cfe0c66	Move DateTime::RFC2822 to DateTimeInterface::2822 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Julius Härtl	21db463bc9	Reset checksum when writing files to object store ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	5 years ago
John Molakvoæ (skjnldsv)	215aef3cbd	Update php licenses ... Signed-off-by: John Molakvoæ (skjnldsv) <skjnldsv@protonmail.com>	5 years ago
Florent	d4444f2472	Avoid reading ~/.aws/config when using S3 provider ... When using S3 storage, we sometimes have open_basedir errors due to aws-sdk-php trying to read ~/.aws/config which is out of open_basedir restrictions. Christoph Wurst already added csm=false config in #21406 but it wasn't enough, we also need to set use_arn_region=false, added in this commit. Signed-off-by: Florent <florent@coppint.com>	5 years ago
Robin Appelman	ef6f2e68f0	explicitly close source stream on object store upload even if count wrapper isn't needed ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	effb7dc8ba	set mimetype for objects uploaded to object storages ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Maxime Besson	547438527d	fix(proxy): reaching s3 storage behind some http proxy ... Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Samuel	03fe74b95e	fix(proxy): reaching s3 storage behind some http proxy ... Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Robin Appelman	ad636ae12d	use returned file id for object store copy ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	3eb764e65d	remove explicit fclose from S3->writeStream ... streams get closed automatically when dropped, and in some cases the stream seems to be already closed by the S3 library, in which case trying to close it again will raise an error Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	c87b1a50d9	apply object store copy optimization when 'cross storage' copy is within the same object store ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
dependabot-preview[bot]	eb502c02ff	Bump nextcloud/coding-standard from 0.3.0 to 0.5.0 ... Bumps [nextcloud/coding-standard](https://github.com/nextcloud/coding-standard) from 0.3.0 to 0.5.0. - [Release notes](https://github.com/nextcloud/coding-standard/releases) - [Changelog](https://github.com/nextcloud/coding-standard/blob/master/CHANGELOG.md) - [Commits](https://github.com/nextcloud/coding-standard/compare/v0.3.0...v0.5.0) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Christoph Wurst	9ce3ea3368	Update license headers ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Christoph Wurst	73c7d0dc81	Bump icewind/streams from 0.7.1 to 0.7.2 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Tigran Mkrtchyan	4f2dc18f58	storage: update IStorage#file_put_contents docs to match usage ... The current phpdoc of IStorage#file_put_contents doesnt corresponds to it's actual usage in code, e.g. Signed-off-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>	5 years ago
Christoph Wurst	d89a75be0b	Update all license headers for Nextcloud 21 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
James Letendre	45a02ee30c	Fix failing tests ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	ad95e51cbe	Add web identity provider to S3 connection chain ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	5b756a9fb0	Replace defaultProvider with explicit calls to exclude user home directory lookup ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	85aa77539b	Resolves #24699, Support ES2 and ECS instance providers for S3 buckets ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago