Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 95: Use multipart upload API #129

Merged
merged 4 commits into from
Dec 12, 2020
Merged

Conversation

ptirador
Copy link
Contributor

@ptirador ptirador commented Dec 8, 2020

Pull Request Description

This pull request closes #95.

The multipart upload API has been integrated. It's is designed to improve the upload experience for larger objects. You can upload an object in parts. These object parts can be uploaded independently, in any order, and in parallel. You can use a multipart upload for objects from 5 MB to 5 TB in size (according to Amazon S3 multipart upload limits).

  • S3OutputStream uses multipart uploads to transfer data to S3 without storing it on local disk first.
  • FileSystemProvider returns this implementation for new OutputStreams instead of S3SeekableByteChannel if possible.

Acceptance Test

  • Building the code with mvn clean install -Pintegration-tests still works.

Questions

  • Does this pull request break backward compatibility?

    • Yes
    • No
  • Does this pull request require other pull requests to be merged first?

    • Yes, please see #...
    • No
  • Does this require an update of the documentation?

    • Yes, please see [provide details here]
    • No

@ptirador ptirador marked this pull request as ready for review December 8, 2020 18:53
@carlspring carlspring changed the title Issue 95: Use multipart upload API. Issue 95: Use multipart upload API Dec 12, 2020
@carlspring
Copy link
Owner

Thanks for all your help! :)

@carlspring carlspring merged commit 0bd48a7 into carlspring:master Dec 12, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use Multipart upload API to upload files larger than 5 GB
2 participants