Contrib.social

Slow file uploads when used with S3FS

Open on Drupal.org →
Created on 17 October 2024, 3 months ago

Problem/Motivation

File uploads can be slow when resumable uploads are used with an S3 file system, see 📌 Support non-locking (ie remote) file systems Needs review . The probleem seems to be the way S3 handles appends to existing files, which is done a lot when a file is uploaded in chunks during a resumable upload.

Steps to reproduce

Use File Resumable Uploads module together with the S3FS module and upload a very large file through the resumable upload widget for a file field that is configured to store the files using the s3:// stream wrapper.

Proposed resolution

Add the option to upload files to the temporary files folder first and move them to S3 when upload is complete.

Remaining tasks

- Create MR
- Review MR
- Merge MR

User interface changes

Optionally, we could supply a configuration to switch between direct upload to the stream wrapper for the file field or upload via the temporary files folder.

API changes

N/A

Data model changes

N/A

✨ Feature request
Status

Active

Version

2.0

Component

Code

Created by

🇳🇱Netherlands ricovandevin

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024