84 Commits (appStoreDisabledOcc)

Author	SHA1	Message	Date
Robin Appelman	6cf66f95ce	fix: get object size from stream where possible ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
provokateurin	0de4843b73	refactor(Storage): Align all Storage constructors ... Signed-off-by: provokateurin <kate@provokateurin.de>	1 year ago
provokateurin	f28e74b7a8	refactor(Storage): Make all parameter types strong types ... Signed-off-by: provokateurin <kate@provokateurin.de>	1 year ago
Robin Appelman	3e12e1e789	fix: rework move into object store to better preserve fileids ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	888d06dff9	fix: preserve fileid when moving from objectstore to non-objectstore ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	da21acfb3f	fix: ensure source folder is removed from cache when moving to objectstore ... otherwise this causes confusion down the line as it's contents will be moved to the new cache Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
provokateurin	7cdccd058f	fix(Storage): Fix IStorage return types ... Signed-off-by: provokateurin <kate@provokateurin.de>	1 year ago
Robin Appelman	47d281865e	perf: reuse cache info we already have when moving to object store ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
provokateurin	9836e9b164	chore(deps): Update nextcloud/coding-standard to v1.3.1 ... Signed-off-by: provokateurin <kate@provokateurin.de>	1 year ago
Robin Appelman	3c0c81bb94	fix: ensure parent folder exists when writing a file to object storage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	60f6347c97	fix: cleanup objectstore file_put_content ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	3e94ee391f	fix: create intermediate directories for objectstore moveFromStorage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Robin Appelman	879fcc4253	fix: get source file before moving the cache item in objectstore moveFromStorage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
provokateurin	d2d1e3284d	fix(Storage): Fix method docs inheritance ... Signed-off-by: provokateurin <kate@provokateurin.de>	1 year ago
Côme Chilliet	492e6997d8	chore: Fix psalm issues, put back private versions of getter in private Storage interface ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	1 year ago
Christoph Fiehe	9597072ada	perf(ObjectStoreStorage): Improve (slow) move on same object bucket ... This commit fixes the issue #47856. When you upload a file into a group folder and when you use a single S3 bucket as primary storage, the final move operation hangs for a long time. In the background, Nextcloud initiates a copy-delete sequence from the bucket into the bucket, with causes a lot unnecessary overhead. Nextcloud thinks that the file must be imported to another storage and does not recognize that everything is done on the same object bucket. In that case, the import step can be completely skipped, which saves time, network bandwidth and reduces the load on the object storage. The behavior improves a lot with https://github.com/nextcloud/server/pull/46013. However, there are still some put messages that are being sent to the object storage when you use an object storage as primary storage and upload files into a group folder. Co-authored-by: Kate <26026535+provokateurin@users.noreply.github.com> Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>	1 year ago
Daniel Kesselberg	af6de04e9e	style: update codestyle for coding-standard 1.2.3 ... Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>	1 year ago
Robin Appelman	bd740ac0b0	fix: write object to the correct urn when moving from another storage to object store ... Signed-off-by: Robin Appelman <robin@icewind.nl>	1 year ago
Andy Scherzinger	dae7c159f7	chore: Add SPDX header ... Signed-off-by: Andy Scherzinger <info@andy-scherzinger.de>	2 years ago
Côme Chilliet	ec5133b739	fix: Apply new coding standard to all files ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	2 years ago
Joas Schilling	951c330d39	Revert "don't perform an explicit setup when using the file cache"	2 years ago
Robin Appelman	4fba4cd14c	fix: fix user folder init ... Signed-off-by: Robin Appelman <robin@icewind.nl>	2 years ago
Côme Chilliet	c0ce272e9c	chore: Migrate away from OC::$server->getLogger ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	2 years ago
Thomas Citharel	30798eb6c2	refactor(objectstorage): cleanup types ... Signed-off-by: Thomas Citharel <tcit@tcit.fr>	2 years ago
Thomas Citharel	3be3dbdb3b	refactor(objectstorage): move $user property from ObjectStoreStorage class to HomeObjectStoreStorage ... Signed-off-by: Thomas Citharel <tcit@tcit.fr>	2 years ago
Ferdinand Thiessen	5172baaf8b	fix(ObjectStore): Make copying behavior consistent with local storage ... Drop file permissions on copy like we do on local storage. Signed-off-by: Ferdinand Thiessen <opensource@fthiessen.de>	2 years ago
Julius Härtl	88a96e4db7	fix: Only store unencrypted_size if path should be encrypted ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	2 years ago
Robin Appelman	de85610385	use source cache when listing folder during recursive copy ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	cc0ad25c98	don't always check if we need to setup the object store root ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	2ea41dab93	repair -1 folder sizes for object store background scan ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	c6be96d04f	additional logging when mkdir fails for object storage ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Robin Appelman	d63fa2d991	improve objectstore rmdir handling ... remove folder entries as they are cleared instead of in one go afterwards otherwise they stick around if some of the child entries can't be removed Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Julius Härtl	e23aa8883e	feat(s3): Use multipart upload for chunked uploading ... This allows to stream file chunks directly to S3 during upload. Signed-off-by: Julius Härtl <jus@bitgrid.net>	3 years ago
Côme Chilliet	f5c361cf44	composer run cs:fix ... Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>	3 years ago
Maxence Lange	cc639a8877	compare cached filesize on download ... Signed-off-by: Maxence Lange <maxence@artificial-owl.com>	3 years ago
Robin Appelman	a5036a973c	allow disabling object store write check ... Signed-off-by: Robin Appelman <robin@icewind.nl>	3 years ago
Carl Schwan	a5ea677370	Rename file1 and file2 to source and target in Storage abstraction ... Signed-off-by: Carl Schwan <carl@carlschwan.eu>	3 years ago
Julius Härtl	0f0e74a78c	Cleanup temporary files after finishing the write to object storage ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	4 years ago
Carl Schwan	bfa60aaf27	Fix permissions when copying from ObjectStorage ... Make sure that when a user copy a file from a directory they don't have all permissions to a directory where they have more permissions, the permissions are correctly set to the one from the parent taget folder. This was caused by the ObjectStoreStorage::copyFromStorage using the jailed storage and cache entry instead of the unjailed one like other storages (the local one). Steps to reproduce + Use object storage + Create a groupfolder with one group having full permission and another one who can just read files. + With an user who is in the second group, copy a file from the groupfolder to the home folder of this user. + The file in the home folder of the user will be read only and can't be deleted even though it is in their home folder and they are the owner. In oc_filecache, the permissions stored for this file are 1 (READ) Signed-off-by: Carl Schwan <carl@carlschwan.eu>	4 years ago
Julius Härtl	21db463bc9	Reset checksum when writing files to object store ... Signed-off-by: Julius Härtl <jus@bitgrid.net>	5 years ago
John Molakvoæ (skjnldsv)	215aef3cbd	Update php licenses ... Signed-off-by: John Molakvoæ (skjnldsv) <skjnldsv@protonmail.com>	5 years ago
Robin Appelman	ef6f2e68f0	explicitly close source stream on object store upload even if count wrapper isn't needed ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	effb7dc8ba	set mimetype for objects uploaded to object storages ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	ad636ae12d	use returned file id for object store copy ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Robin Appelman	c87b1a50d9	apply object store copy optimization when 'cross storage' copy is within the same object store ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Christoph Wurst	9ce3ea3368	Update license headers ... Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>	5 years ago
Tigran Mkrtchyan	4f2dc18f58	storage: update IStorage#file_put_contents docs to match usage ... The current phpdoc of IStorage#file_put_contents doesnt corresponds to it's actual usage in code, e.g. Signed-off-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>	5 years ago
Robin Appelman	9d4848e863	use in objectstore copy ... Signed-off-by: Robin Appelman <robin@icewind.nl>	5 years ago
Roeland Jago Douma	bb06b6cce4	Fix reading empty files from objectstorage ... Since we try to do range requests this will fail hard. However since empty files are not that interesting to read anyways we just read from an emptry memory stream. Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>	5 years ago
Roeland Jago Douma	9fdeed8cc0	Run stat less often for objectstorages ... When we want to get the permissions we now do stat at least 5 times for each entry. Which is a bit much. Especially since the permssions are all just in the database already. Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>	5 years ago