MirrorSave
/
rclone
mirror of https://github.com/rclone/rclone.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,154 Commits 180 Branches 116 Tags 382 MiB
Commit Graph

8154 Commits

Author SHA1 Message Date
Fornax 3b3625037c
Add pixeldrain backend 
This commit adds support for pixeldrain's experimental filesystem API.
 2024-08-12 13:35:44 +01:00
kapitainsky bfa3278f30
docs: add comment how to reduce rclone binary size (#8000) 
See #7998
 2024-08-10 17:52:32 +01:00
albertony e334366345 Make listremotes long output backwards compatible - fixes #7995 
The format was changed to include the source attribute in #7404, but that is now
reverted and the source information is only shown in json output.
 2024-08-09 17:39:00 +01:00
Nick Craig-Wood 642d4082ac test_backend_sizes.py calculates space in the binary each backend uses #7998 2024-08-09 12:13:24 +01:00
albertony 024ff6ed15 listremotes: added options for filtering, ordering and json output 2024-08-08 13:41:31 +01:00
albertony d6b0743cf4 config: make getting config values more consistent 2024-08-08 13:41:31 +01:00
albertony e4749cf0d0 config: make listing of remotes more consistent 2024-08-08 13:41:31 +01:00
albertony 8d2907d8f5 config: avoid remote with empty name from environment 2024-08-08 13:41:31 +01:00
albertony 1720d3e11c help: global flags help command extended filtering 2024-08-08 13:41:31 +01:00
albertony c6352231e4 help: global flags help command now takes glob filter 2024-08-08 13:41:31 +01:00
albertony 731947f3ca filter: add options for glob to regexp without anchors and special path rules 2024-08-08 13:41:31 +01:00
albertony 16d642825d docs: remove old genautocomplete command docs and add as alias from the newer completion command 2024-08-08 13:34:10 +01:00
albertony 50aebcf403 docs: replace references to genautocomplete with the new name completion 2024-08-08 13:34:10 +01:00
Nick Craig-Wood c8555d1b16 serve s3: update to AWS SDKv2 by updating github.com/rclone/gofakes3 
This is the last dependency for the SDKv1 and this commit removes it
from go.mod also.
 2024-08-07 16:35:39 +01:00
Nick Craig-Wood 3ec0ff5d8f s3: fix SSE-C after SDKv2 change 
The new SDK apparently keeds the customer key to be base64 encoded
where the old one did that for you automatically.

See: https://github.com/aws/aws-sdk-go-v2/issues/2736
See: https://forum.rclone.org/t/new-s3-backend-help-testing-needed/47139/3
 2024-08-07 12:13:13 +01:00
wiserain 746516511d pikpak: update to using AWS SDK v2 #4989 2024-08-07 12:13:13 +01:00
Nick Craig-Wood 8aef1de695 s3: fix Cloudflare R2 integration tests after SDKv2 update #4989 
Cloudflare will normally automatically decompress files with
`Content-Encoding: gzip` when downloaded. This is not what AWS S3 does
and it breaks the integration tests.

This fudges the integration tests to upload the test file with
`Cache-Control: no-transform` on Cloudflare R2 and puts a note in the
docs about this problem.
 2024-08-07 12:13:13 +01:00
Nick Craig-Wood cb611b8330 s3: add --s3-sdk-log-mode to control SDK debugging 2024-08-07 12:13:13 +01:00
Nick Craig-Wood 66ae050a8b s3: fix GCS provider after SDKv2 update #4989 
This also adds GCS via S3 to the integration tester.
 2024-08-07 12:13:13 +01:00
Nick Craig-Wood fd9049c83d s3: update to using AWS SDK v2 - fixes #4989 
SDK v2 conversion

Changes

  - `--s3-sts-endpoint` is no longer supported
  - `--s3-use-unsigned-payload` to control use of trailer checksums (needed for non AWS)
 2024-08-07 12:13:13 +01:00
Nick Craig-Wood a1f52bcf50 fstest: implement method to skip ChunkedCopy tests 2024-08-06 12:45:07 +01:00
Nick Craig-Wood 0470450583 build: disable wasm/js build due to go bug 
Rclone is too big for js/wasm until
https://github.com/golang/go/issues/64856 is fixed
 2024-08-04 12:18:34 +01:00
Nick Craig-Wood 1901bae4eb Add @dmcardle as gitannex maintainer 2024-08-01 17:48:39 +01:00
Nick Craig-Wood 9866d1c636 docs: s3: add section on using too much memory #7974 2024-08-01 16:33:09 +01:00
Nick Craig-Wood c5c7bcdd45 docs: link the workaround for big directory syncs in the FAQ #7974 2024-08-01 16:33:09 +01:00
Nick Craig-Wood d5c7b55ba5 Add David Seifert to contributors 2024-08-01 16:33:09 +01:00
Nick Craig-Wood feafbfca52 Add Will Miles to contributors 2024-08-01 16:33:09 +01:00
Nick Craig-Wood abe01179ae Add Ernie Hershey to contributors 2024-08-01 16:33:09 +01:00
David Seifert 612c717ea0
docs: rc: fix correct _path to _root in on the fly backend docs 2024-07-30 10:19:47 +01:00
Saleh Dindar f26d2c6ba8 fs/http: reload client certificates on expiry 
In corporate environments, client certificates have short life times
for added security, and they get renewed automatically. This means
that client certificate can expire in the middle of long running
command such as `mount`.

This commit attempts to reload the client certificates 30s before they
expire.

This will be active for all backends which use HTTP.
 2024-07-24 15:02:32 +01:00
Will Miles dcecb0ede4 docs: clarify hasher operation 
Add a line to the "other operations" block to indicate that the hasher overlay will apply auto-size and other checks for all commands.
 2024-07-24 11:07:52 +01:00
Ernie Hershey 47588a7fd0 docs: fix typo in batcher docs for dropbox and googlephotos 2024-07-24 10:58:22 +01:00
Nick Craig-Wood ba381f8721 b2: update versions documentation - fixes #7878 2024-07-24 10:52:05 +01:00
Nick Craig-Wood 8f0ddcca4e s3: document need to set force_path_style for buckets with invalid DNS names 
Fixes #6110
 2024-07-23 11:34:08 +01:00
Nick Craig-Wood 404ef80025 ncdu: document that excludes are not shown - fixes #6087 2024-07-23 11:29:07 +01:00
Nick Craig-Wood 13fa583368 sftp: clarify the docs for key_pem - fixes #7921 2024-07-23 10:07:44 +01:00
Nick Craig-Wood e111ffba9e serve ftp: fix failed startup due to config changes 
See: https://forum.rclone.org/t/failed-to-ftp-failed-to-parse-host-port/46959
 2024-07-22 14:54:32 +01:00
Nick Craig-Wood 30ba7542ff docs: add Route4Me as a sponsor 2024-07-22 14:48:41 +01:00
wiserain 31fabb3402
pikpak: correct file transfer progress for uploads by hash 
Pikpak can accelerate file uploads by leveraging existing content 
in its storage (identified by a custom hash called gcid). 
Previously, file transfer statistics were incorrect for uploads 
without outbound traffic as the input stream remained unchanged.

This commit addresses the issue by:

* Removing unnecessary unwrapping/wrapping of accountings 
before/after gcid calculation, leading immediate AccountRead() on buffering.
* Correctly tracking file transfer statistics for uploads 
with no incoming/outgoing traffic by marking them as Server Side Copies.

This change ensures correct statistics tracking and improves overall user experience.
 2024-07-20 21:50:08 +09:00
Nick Craig-Wood b3edc9d360 fs: fix --use-json-log and -vv after config reorganization 2024-07-20 12:49:08 +01:00
Nick Craig-Wood 04f35fc3ac Add Tobias Markus to contributors 2024-07-20 12:49:08 +01:00
Tobias Markus 8e5dd79e4d
ulozto: fix upload of > 2GB files on 32 bit platforms - fixes #7960 2024-07-20 11:29:34 +01:00
Nick Craig-Wood b809e71d6f lib/mmap: fix lint error on deprecated reflect.SliceHeader 
reflect.SliceHeader is deprecated, however the replacement gives a go
vet warning so this disables the lint warning in one use of
reflect.SliceHeader and replaces it in the other.
 2024-07-20 10:54:47 +01:00
Nick Craig-Wood d149d1ec3e lib/http: fix tests after go1.23 update 
go1.22 output the Content-Length on a bad Range request on a file but
go1.23 doesn't - adapt the tests accordingly.
 2024-07-20 10:54:47 +01:00
Nick Craig-Wood 3b51ad24b2 rc: fix tests after go1.23 upgrade 
go1.23 adds a doctype to the HTML output when serving file listings.
This adapts the tests for that.
 2024-07-20 10:54:47 +01:00
Nick Craig-Wood 485aa90d13 build: use go1.22 for the linter to fix excess memory usage 
golangci-lint seems to have a bug which uses excess memory under go1.23

See: https://github.com/golangci/golangci-lint/issues/4874
 2024-07-20 10:54:47 +01:00
Nick Craig-Wood 8958d06456 build: update all dependencies 2024-07-20 10:54:47 +01:00
Nick Craig-Wood ca24447090 build: update to go1.23rc1 and make go1.21 the minimum required version 2024-07-20 10:54:47 +01:00
Nick Craig-Wood d008381e59 Add AThePeanut4 to contributors 2024-07-20 10:54:47 +01:00
AThePeanut4 14629c66f9 systemd: prevent unmount rc command from sending a STOPPING=1 sd-notify message 
This prevents an `rclone rcd` server from prematurely going into the
'deactivating' state, which was causing systemd to kill it with a
SIGABRT after the stop timeout.

Fixes #7540
 2024-07-19 10:32:34 +01:00