rclone

Commit Graph

Author	SHA1	Message	Date
Nick Craig-Wood	e953598987	build: fix lint errors when re-enabling revive exported & package-comments	2023-08-29 13:03:13 +01:00
Nick Craig-Wood	967fc6d7f4	lib/multipart: fix accounting for multipart transfers This change makes sure the accouting is done when bytes are taken out of the buffer rather than put in. See: https://forum.rclone.org/t/improve-transfer-stats-calculation-for-multipart-uploads/41172	2023-08-27 23:10:58 +01:00
Nick Craig-Wood	4c76fac594	s3: factor generic multipart upload into lib/multipart #7056 This makes the memory controls of the s3 backend inoperative and replaced with the global ones. --s3-memory-pool-flush-time --s3-memory-pool-use-mmap By using the buffered reader this fixes excessive memory use when uploading large files as it will share memory pages between all readers. Fixes #7141	2023-08-24 12:39:27 +01:00

Author

SHA1

Message

Date

Nick Craig-Wood

e953598987

build: fix lint errors when re-enabling revive exported & package-comments

2023-08-29 13:03:13 +01:00

Nick Craig-Wood

967fc6d7f4

lib/multipart: fix accounting for multipart transfers

This change makes sure the accouting is done when bytes are taken out
of the buffer rather than put in.

See: https://forum.rclone.org/t/improve-transfer-stats-calculation-for-multipart-uploads/41172

2023-08-27 23:10:58 +01:00

Nick Craig-Wood

4c76fac594

s3: factor generic multipart upload into lib/multipart #7056

This makes the memory controls of the s3 backend inoperative and
replaced with the global ones.

    --s3-memory-pool-flush-time
    --s3-memory-pool-use-mmap

By using the buffered reader this fixes excessive memory use when
uploading large files as it will share memory pages between all
readers.

Fixes #7141

2023-08-24 12:39:27 +01:00

3 Commits