5
edits
Rclone: Difference between revisions
no edit summary
mNo edit summary |
No edit summary |
||
| Line 85: | Line 85: | ||
== No problems, only solutions == | == No problems, only solutions == | ||
=== I cannot upload a file larger than 48GB. === | |||
In some situations, rclone is not able to guess the size of the file to upload and use the default value of <code>--s3-chunk-size 5M</code> to spit and upload the file to the bucket. But since the server has a 10,000 chunk limit, the upload crashes. | |||
You can solve that by setting a larger value: | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
rclone copy --s3-chunk-size 50M my-large-file.cram my-project:test | |||
</syntaxhighlight> | </syntaxhighlight> | ||
Another way is to lower the maximum number of parts in a multipart upload using [https://rclone.org/s3/#s3-max-upload-parts --s3-max-upload-parts], for example: <code>--s3-max-upload-parts 1000</code>. | |||
Note that you need the ram of your computer to be larger that chunks. | Note that you need the ram of your computer to be larger that chunks. | ||