64 Commits (appStoreDisabledOcc)

Author	SHA1	Message	Date
Robin Appelman	df3a9e221d	fix: throw correct exception type when we can't verify if an s3 bucket exists ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Daniel Kesselberg	af6de04e9e	style: update codestyle for coding-standard 1.2.3 ... Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>	1 year ago
Git'Fellow	c84e76a749	fix(s3): Don't wait indefinitely for S3 to return ... Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: lint Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: use AwsException Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: Throw on connection failure Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: Wrap all in try catch block Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: use RequestTimeout error message Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> log: use OCP Server class Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: Handle connect timeout only Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com> fix: Handle errors more generically Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>	2 years ago
Ferdinand Thiessen	ae1f5cc56d	fix(S3): Adjust usage of guzzle promise ... `Promise\promise_for` was deprecated and is now removed and replaced with the static API (`Create::promiseFor`). Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Josh	63886147ba	fix(ObjectStore): handle empty S3 hostname ... Fixes #45637 The support for s3-accelerate added in #44496 introduced a regression in AWS S3 environments when `hostname` is blank (which is a valid configuration w/ AWS since the hostname gets auto-generated). Signed-off-by: Josh <josh.t.richards@gmail.com>	2 years ago
Andy Scherzinger	dae7c159f7	chore: Add SPDX header ... Signed-off-by: Andy Scherzinger <info@andy-scherzinger.de>	2 years ago
Robin Appelman	40d9a3fcab	feat: add option to enable s3 acceleration ... Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Ferdinand Thiessen	32dee2f84a	feat(ObjectStore): Make S3 MultipartUpload concurrency configurable ... Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Ferdinand Thiessen	69c5e8ebde	fix(ObjectStore): Use common S3 trait so config and connection trait members are in sync ... Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Julius Härtl	e4054370b1	fix(s3): Add config option to disable multipart copy for certain s3 providers ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	2 years ago
Robin Appelman	1043c21b35	only do a multipart s3 copy when above the regular copy limit ... Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Hamid Dehnavi	ea06cf2f39	Convert isset ternary to null coalescing operator ... Signed-off-by: Hamid Dehnavi <hamid.dev.pro@gmail.com>	2 years ago
Thomas Citharel	3f28fc58aa	fix(s3): fix handling verify_bucket_exists parameter ... If 'verify_bucket_exists' is set to false in the config.php s3 configuration, it's supposed to avoid verifying that the bucket exists. However empty(falsy) will always return true, so this condition would not work. Signed-off-by: Thomas Citharel <tcit@tcit.fr>	2 years ago
Julius Härtl	159a0c8411	feat(s3): Add option to specify an SSE-C customer provided key ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
François Ménabé	cf9bdc0274	Manage s3 storage class in objectstore ... Signed-off-by: François Ménabé <francois.menabe@gmail.com>	3 years ago
Robin Appelman	f1486890d7	only use nextcloud bundle when explicitly enabled ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	bffa67c48b	also use nextcloud certificate bundle when downloading from s3 ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Jasper Weyne	0633a1d9f5	Disable ~/.aws/config access by S3ConnectionTrait ... This commit sets the 'use_aws_shared_config_files' option to false, in order to disable configuration loading from ~/.aws/config by the AWS SDK, specifically the S3Client. It is a continuation of #27040, as that PR only changed the behaviour of the CredentialsProvider; this change affects the ConfigurationProvider as well. Signed-off-by: Jasper Weyne <jasperweyne@gmail.com>	4 years ago
Côme Chilliet	069477e608	Migrate more classes of lib/private to LoggerInterface ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	4 years ago
Robin Appelman	1156214a26	don't try to get custom certs for s3 primary storage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Robin Appelman	194a21f374	use the nextcloud certificate bundle for s3 ... Signed-off-by: Robin Appelman <robin@icewind.nl>	4 years ago
Julius Härtl	2aac757805	Make max size for single put uploads configurable ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Julius Härtl	e475dfe16c	Fix php-cs for S3ConnectionTrait.php ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Stephen Cuppett	4a6a2c2b48	Simplify S3ConnectionTrait to defaultProvider plus option ... When we initially added the EC2 and ECS IAM role support in #24700, we had to use a workaround by explicitly ordering the various providers due to an inconsistency in the AWS SDK for PHP. We submitted a PR there to get that squared away. Now, we've consumed that version upstream for the SDK and can update our code here to be the most concise version as well as position ourselves to pick up new methods as those become available and prevalent in AWS (for acquiring credentials). See also: https://github.com/nextcloud/server/pull/24700#issuecomment-747650892 See also: https://github.com/aws/aws-sdk-php/pull/2172 Signed-off-by: Stephen Cuppett <steve@cuppett.com>	4 years ago
Bernd Rederlechner	3866f388b1	Refactor writeObject to only use MultipartUpload when required ... Signed-off-by: Bernd Rederlechner <Bernd.Rederlechner@t-systems.com> Co-authored-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Maxime Besson	388a458cd5	fix(proxy): use accessor ... Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
John Molakvoæ (skjnldsv)	215aef3cbd	Update php licenses ... Signed-off-by: John Molakvoæ (skjnldsv) <skjnldsv@protonmail.com>	5 years ago
Florent	d4444f2472	Avoid reading ~/.aws/config when using S3 provider ... When using S3 storage, we sometimes have open_basedir errors due to aws-sdk-php trying to read ~/.aws/config which is out of open_basedir restrictions. Christoph Wurst already added csm=false config in #21406 but it wasn't enough, we also need to set use_arn_region=false, added in this commit. Signed-off-by: Florent <florent@coppint.com>	5 years ago
Samuel	03fe74b95e	fix(proxy): reaching s3 storage behind some http proxy ... Signed-off-by: Maxime Besson <maxime.besson@worteks.com>	5 years ago
Christoph Wurst	d89a75be0b	Update all license headers for Nextcloud 21 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
James Letendre	45a02ee30c	Fix failing tests ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	ad95e51cbe	Add web identity provider to S3 connection chain ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	5b756a9fb0	Replace defaultProvider with explicit calls to exclude user home directory lookup ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
James Letendre	85aa77539b	Resolves #24699, Support ES2 and ECS instance providers for S3 buckets ... Signed-off-by: James Letendre <james.letendre@gmail.com>	5 years ago
Roeland Jago Douma	65141d4864	Allow config to specify the bucket exists ... In the 99% case the bucket is just always there. And if it is not the read/write will fail hard anyways. Esp on big instances the Objectstore is not always fast and this can save a few hundered ms of each request that acess the objectstore. In short it is adding 'verify_bucket_exists' => false To the S3 config part Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>	5 years ago
Christoph Wurst	2a054e6c04	Update the license headers for Nextcloud 20 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Stephen Cuppett	5ef0f86ce7	Resolves #19790, Provides Support for IAM Credentials ... Includes support for either leveraging environment variables passed to the PHP runtime or IAM instance profile present on the host being used. The default and first choice is still the parameter file as documented. See also: https://docs.aws.amazon.com/sdk-for-php/v3/developer-guide/guide_credentials_provider.html#chaining-providers Signed-off-by: Stephen Cuppett <steve@cuppett.com>	5 years ago
Christoph Wurst	d3a4bc91f7	Fix static method call for s3 bucket compat check ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Christoph Wurst	9d392891be	Disable Client-Side Monitoring on AWS storage ... The S3 client enables this by default and then tries to read `.aws/config`. This causes `open_basedir` restriction related error for some setups. So this patch disables the CSM because it's most likely unused anyway. Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Florent	3594ba6971	Upload part size as S3 parameter instead of constant value ... Some S3 providers need a custom upload part size (500 MB static value in Nextcloud). Here is a commit to change this value via S3 configuration, instead of using S3_UPLOAD_PART_SIZE constant. A new parameter is added for an S3 connection : uploadPartSize Signed-off-by: Florent <florent@coppint.com>	6 years ago
Christoph Wurst	1a9330cd69	Update the license headers for Nextcloud 19 ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Christoph Wurst	b80ebc9674	Use the short array syntax, everywhere ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Christoph Wurst	5bf3d1bb38	Update license headers ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	6 years ago
Robin Appelman	834db3af2c	add method to get bucket name from s3 storage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	7 years ago
S. Cat	e3142a91b2	Bucket name - Alert in debug mode ... Alert in debug mode only when trying to mount non compatible DNS bucket name (in order to not flood the logs) Signed-off-by: Sébastien Cat <sebastien.cat@inra.fr>	7 years ago
S. Cat	381ae44d38	Correct code indent ... Just correct code indent. Signed-off-by: Sébastien Cat <sebastien.cat@inra.fr>	7 years ago
S. Cat	77473b0228	Warning on S3 not compatible DNS bucket name ... The new created bucket should respect the DNS compatibility, nevertheless, Nextcloud should accept to mount "old created" buckets that does not respect DNS compatibility (Backward compatibility, or compatibility with CEPH). Signed-off-by: Sébastien Cat <sebastien.cat@inra.fr>	7 years ago
Sebastien Cat	59c3d8d85f	Dont check Bucket Name in Nextcloud ... Signed-off-by: Sebastien Cat <sparrow.jack63@gmail.com> Signed-off-by: Sébastien Cat <sebastien.cat@inra.fr>	7 years ago
Robin Appelman	47fd3499a3	Fix listing s3 objects when using google cloud aws compatibility ... Signed-off-by: Robin Appelman <robin@icewind.nl>	8 years ago
Arthur Schiwon	38a90130ce	move log constants to ILogger ... Signed-off-by: Arthur Schiwon <blizzz@arthur-schiwon.de>	8 years ago