summaryrefslogtreecommitdiffstats
path: root/lib/private/Files/ObjectStore
Commit message (Collapse)AuthorAgeFilesLines
* feat: add option to enable s3 accelerationRobin Appelman2024-04-261-1/+16
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* fix: disable the internal s3sdk multi part copy logicRobin Appelman2024-04-181-1/+2
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* also updated parent etags when a changed etag is detected during scanningRobin Appelman2024-01-311-1/+1
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* fix(s3): Add config option to disable multipart copy for certain s3 providersJulius Härtl2023-12-292-1/+4
| | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* only do a multipart s3 copy when above the regular copy limitRobin Appelman2023-12-292-11/+23
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* fix(s3): support SSE-C headers for the MultipartCopy callTobias Zimmerer2023-11-151-1/+7
| | | | Signed-off-by: Tobias Zimmerer <3228193+ir0nhide@users.noreply.github.com>
* Merge pull request #40577 from nextcloud/s3-multipart-copy-27Julius Härtl2023-10-101-4/+12
|\
| * use multipart copy for s3Robin Appelman2023-09-221-4/+12
| | | | | | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* | Store size in int|float for 32bit supportCôme Chilliet2023-09-251-1/+1
|/ | | | Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
* fix: Only store unencrypted_size if path should be encryptedJulius Härtl2023-09-121-0/+2
| | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* Merge pull request #40231 from nextcloud/sharing-mask-wrapper-27Arthur Schiwon2023-09-061-1/+2
|\ | | | | [27] move share permission logic to storage wrapper
| * more share permission logic to storage wrapperRobin Appelman2023-09-041-1/+2
| | | | | | | | | | | | this way we only have to determine the share permissions once Signed-off-by: Robin Appelman <robin@icewind.nl>
* | fix(s3): fix handling verify_bucket_exists parameterThomas Citharel2023-08-311-1/+1
|/ | | | | | | | If 'verify_bucket_exists' is set to false in the config.php s3 configuration, it's supposed to avoid verifying that the bucket exists. However empty(falsy) will always return true, so this condition would not work. Signed-off-by: Thomas Citharel <tcit@tcit.fr>
* Merge pull request #39642 from nextcloud/backport/39629/stable27Julius Härtl2023-08-031-1/+1
|\
| * fix(s3): add SSE-C parameters to headObject callTobias Zimmerer2023-07-311-1/+1
| | | | | | | | Signed-off-by: Tobias Zimmerer <3228193+ir0nhide@users.noreply.github.com>
* | fix(s3): Pass SSE-C parameters for multipart uploadJulius Härtl2023-07-201-5/+5
|/ | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* add utility command for object store objectsRobin Appelman2023-07-041-1/+5
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* file scanner performance improvementsRobin Appelman2023-06-261-1/+1
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* use source cache when listing folder during recursive copyRobin Appelman2023-06-191-5/+6
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* don't always check if we need to setup the object store rootRobin Appelman2023-05-241-6/+18
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* repair -1 folder sizes for object store background scanRobin Appelman2023-05-103-83/+100
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* Merge pull request #37534 from Rsplwe/masterSimon L2023-04-181-7/+18
|\ | | | | Adjust the value of the "max-parts" parameter of the object storage 'ListPart' interface to 1000
| * Update lib/private/Files/ObjectStore/S3.phpRsplwe2023-04-031-1/+1
| | | | | | | | Co-authored-by: Côme Chilliet <91878298+come-nc@users.noreply.github.com> Signed-off-by: Rsplwe <i@rsplwe.com>
| * s3: get remaining truncation partRsplwe2023-04-011-7/+18
| | | | | | Signed-off-by: Rsplwe <i@rsplwe.com>
| * Adjust the value of 'maxparts' to 1000Rsplwe2023-04-011-1/+1
| | | | | | Signed-off-by: Rsplwe <i@rsplwe.com>
* | Merge pull request #32314 from nextcloud/object-mkdir-loggingSimon L2023-04-171-0/+3
|\ \ | | | | | | additional logging when mkdir fails for object storage
| * | additional logging when mkdir fails for object storageRobin Appelman2023-04-051-0/+3
| |/ | | | | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* / improve objectstore rmdir handlingRobin Appelman2023-04-031-36/+50
|/ | | | | | | | remove folder entries as they are cleared instead of in one go afterwards otherwise they stick around if some of the child entries can't be removed Signed-off-by: Robin Appelman <robin@icewind.nl>
* feat(s3): Use multipart upload for chunked uploadingJulius Härtl2023-03-082-3/+133
| | | | | | This allows to stream file chunks directly to S3 during upload. Signed-off-by: Julius Härtl <jus@bitgrid.net>
* feat(s3): Add option to specify an SSE-C customer provided keyJulius Härtl2023-01-242-5/+38
| | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* composer run cs:fixCôme Chilliet2023-01-203-3/+1
| | | | Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
* Manage s3 storage class in objectstoreFrançois Ménabé2023-01-122-1/+7
| | | | Signed-off-by: François Ménabé <francois.menabe@gmail.com>
* compare cached filesize on downloadMaxence Lange2022-12-012-3/+15
| | | Signed-off-by: Maxence Lange <maxence@artificial-owl.com>
* allow disabling object store write checkRobin Appelman2022-10-261-1/+7
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* Rename file1 and file2 to source and target in Storage abstractionCarl Schwan2022-10-181-5/+5
| | | | Signed-off-by: Carl Schwan <carl@carlschwan.eu>
* Avoid allocating too much memory for the bufferJulius Härtl2022-10-111-1/+1
| | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* Merge pull request #32740 from jasperweyne/patch-2Carl Schwan2022-09-191-0/+2
|\ | | | | Fix open_basedir issues by AWS SDK
| * Merge branch 'master' into patch-2Jasper Weyne2022-08-112-13/+28
| |\
| * | Disable ~/.aws/config access by S3ConnectionTraitJasper Weyne2022-06-071-0/+2
| | | | | | | | | | | | | | | This commit sets the 'use_aws_shared_config_files' option to false, in order to disable configuration loading from ~/.aws/config by the AWS SDK, specifically the S3Client. It is a continuation of #27040, as that PR only changed the behaviour of the CredentialsProvider; this change affects the ConfigurationProvider as well. Signed-off-by: Jasper Weyne <jasperweyne@gmail.com>
* | | don't update the folder size if we know it hasn't changedRobin Appelman2022-08-161-1/+1
| |/ |/| | | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* | don't set `null` as a bundle pathRobin Appelman2022-07-271-3/+6
| | | | | | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* | only use nextcloud bundle when explicitly enabledRobin Appelman2022-07-052-10/+15
| | | | | | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* | also use nextcloud certificate bundle when downloading from s3Robin Appelman2022-07-052-10/+17
|/ | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* Cleanup temporary files after finishing the write to object storageJulius Härtl2022-06-021-0/+2
| | | | Signed-off-by: Julius Härtl <jus@bitgrid.net>
* Migrate more classes of lib/private to LoggerInterfaceCôme Chilliet2022-04-261-6/+5
| | | | Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
* Add a metadata service to store file metadataCarl Schwan2022-04-131-1/+1
| | | | Signed-off-by: Carl Schwan <carl@carlschwan.eu>
* Adapt more code to migration to LoggerInterfaceCôme Chilliet2022-03-241-1/+2
| | | | Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
* Migrate from ILogger to LoggerInterface in lib/privateCôme Chilliet2022-03-241-5/+5
| | | | Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
* don't try to get custom certs for s3 primary storageRobin Appelman2022-03-152-3/+10
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>
* use the nextcloud certificate bundle for s3Robin Appelman2022-03-141-1/+6
| | | | Signed-off-by: Robin Appelman <robin@icewind.nl>