Supporting file uploads of 1 GB using Flysystem S3

Additional environment information:
Drupal 9.5.7, PHP 8.1.16

Really good question! Does flysystem have multi-part upload capability?

I am uploading over 100GB movies to Amazon S3 and that would solve all my problems 🤩

Most appreciate any guidance, thank you.

Changing to 2.1.x-dev branch

At this time, to my knowledge Flysystem does not support multi-part uploads. That is on the roadmap for version 3.0.x, provided we can factor out the current third party libraries and factor in support for this library: https://async-aws.com/clients/s3.html

Oh lhridley, that would be tremendous, yes please 🙏

Currently Filmmakers are uploading over 100GB films to Amazon S3 via CORS file upload, but as the upload takes a day or more, it gets abandoned and user cannot come back to continue uploading, but start again.

A multi-part upload file system would be absolutely amazing, would appreciate any advance on this, thank you 🌷

Amazon PHP SDK does support multipart uploads for large files: https://docs.aws.amazon.com/sdk-for-php/v3/developer-guide/s3-multipart-...

This module is currently in the process of a major refactoring effort to implement the Flysystem V3 Library, with the goal of releasing a Drupal 10 compatible version in the not-too-distant future. Since the current interation of the AWS SDK PHP library supports large file uploads by implementing async upload processes, this would be a welcome additon.

Please stay posted as the base refactoring progresses, because once that working model is ready for testing we'll move rapidly into implementing the adaptors for the different remote object services, the most important one will be the S3 service. Hopefully this will include support for large file uploads.

Follow along on progress for the refactoring effort at https://www.drupal.org/project/flysystem/issues/3378738 🌱 Planning for Release 3.0.0, Drupal 10.1+ Compatibility, Flysystem v3.1 Compatibility Needs work , and (main subissue) https://www.drupal.org/project/flysystem/issues/3195832 🌱 Implement 3.x version based on Flysystem v2 API changes Needs review .