Go to file
nielash 3b49fd24d4 bisync: fix listings missing concurrent modifications - fixes #8359
Before this change, there was a bug affecting listing files when:

- a given bisync run had changes in the 2to1 direction
AND
- the run had NO changes in the 1to2 direction
AND
- at least one of the changed files changed AGAIN during the run
(specifically, after the initial march and before the transfers.)

In this situation, the listings on one side would still retain the prior version
of the changed file, potentially causing conflicts or errors.

This change fixes the issue by making sure that if we're updating the listings
on one side, we must also update the other. (We previously tried to skip it for
efficiency, but this failed to account for the possibility that a changed file
could change again during the run.)
2025-02-11 11:21:02 +00:00
.github Added parallel docker builds and caching for go build in the container 2025-02-11 10:17:50 +00:00
backend smb: improve connection pooling efficiency 2025-02-04 12:35:19 +00:00
bin docs: fix typos found by codespell in docs and code comments 2025-01-16 10:39:01 +01:00
cmd bisync: fix listings missing concurrent modifications - fixes #8359 2025-02-11 11:21:02 +00:00
cmdtest docs: fix function name in comment 2024-10-29 09:26:37 +01:00
contrib docker volume plugin: add missing fuse3 dependency #6844 2023-03-15 15:57:53 +00:00
docs bisync: fix listings missing concurrent modifications - fixes #8359 2025-02-11 11:21:02 +00:00
fs cmd/config(update remote): introduce --no-output option 2025-01-24 17:22:58 +00:00
fstest fstest: add integration tests objects with // on bucket based backends #5858 2025-01-22 11:56:05 +00:00
graphics Version v1.66.0 2024-03-10 11:22:43 +00:00
lib lib/oauthutil: fix redirect URL mismatch errors - fixes #8351 2025-02-03 12:15:54 +00:00
librclone docs/librclone: the newer and recommended ucrt64 subsystem of msys2 can now be used for building on windows 2024-01-01 21:56:45 +01:00
vfs vfs: close the change notify channel on Shutdown 2025-01-17 15:38:09 +00:00
.gitattributes Add go mod and sum to gitattributes for consistent line endings 2024-04-13 11:16:42 +02:00
.gitignore docs: tidy .gitignore for docs 2024-06-15 13:08:20 +01:00
.golangci.yml build: enable custom linting rules with ruleguard via gocritic 2024-09-06 17:04:18 +01:00
CONTRIBUTING.md docs: add note to CONTRIBUTING that the overview needs editing in 2 places 2024-09-25 17:56:33 +01:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile Added parallel docker builds and caching for go build in the container 2025-02-11 10:17:50 +00:00
MAINTAINERS.md chore: add childish-sambino as filescom maintainer 2024-08-15 22:00:26 +01:00
MANUAL.html Version v1.69.0 2025-01-12 15:09:13 +00:00
MANUAL.md Version v1.69.0 2025-01-12 15:09:13 +00:00
MANUAL.txt Version v1.69.0 2025-01-12 15:09:13 +00:00
Makefile Makefile: Fail when doc recipes create dir named '$HOME' 2024-09-24 10:38:25 +01:00
README.md s3: add Selectel as a provider 2024-10-22 19:54:33 +01:00
RELEASE.md build: update all dependencies 2025-01-14 15:25:10 +00:00
VERSION Start v1.70.0-DEV development 2025-01-12 16:31:12 +00:00
go.mod smb: improve connection pooling efficiency 2025-02-04 12:35:19 +00:00
go.sum smb: improve connection pooling efficiency 2025-02-04 12:35:19 +00:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 Version v1.69.0 2025-01-12 15:09:13 +00:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00

README.md


rclone logo rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

  • 1Fichier 📄
  • Akamai Netstorage 📄
  • Alibaba Cloud (Aliyun) Object Storage System (OSS) 📄
  • Amazon S3 📄
  • ArvanCloud Object Storage (AOS) 📄
  • Backblaze B2 📄
  • Box 📄
  • Ceph 📄
  • China Mobile Ecloud Elastic Object Storage (EOS) 📄
  • Cloudflare R2 📄
  • Citrix ShareFile 📄
  • DigitalOcean Spaces 📄
  • Digi Storage 📄
  • Dreamhost 📄
  • Dropbox 📄
  • Enterprise File Fabric 📄
  • Fastmail Files 📄
  • Files.com 📄
  • FTP 📄
  • GoFile 📄
  • Google Cloud Storage 📄
  • Google Drive 📄
  • Google Photos 📄
  • HDFS (Hadoop Distributed Filesystem) 📄
  • Hetzner Storage Box 📄
  • HiDrive 📄
  • HTTP 📄
  • Huawei Cloud Object Storage Service(OBS) 📄
  • iCloud Drive 📄
  • ImageKit 📄
  • Internet Archive 📄
  • Jottacloud 📄
  • IBM COS S3 📄
  • IONOS Cloud 📄
  • Koofr 📄
  • Leviia Object Storage 📄
  • Liara Object Storage 📄
  • Linkbox 📄
  • Linode Object Storage 📄
  • Magalu Object Storage 📄
  • Mail.ru Cloud 📄
  • Memset Memstore 📄
  • Mega 📄
  • Memory 📄
  • Microsoft Azure Blob Storage 📄
  • Microsoft Azure Files Storage 📄
  • Microsoft OneDrive 📄
  • Minio 📄
  • Nextcloud 📄
  • OVH 📄
  • Blomp Cloud Storage 📄
  • OpenDrive 📄
  • OpenStack Swift 📄
  • Oracle Cloud Storage 📄
  • Oracle Object Storage 📄
  • Outscale 📄
  • ownCloud 📄
  • pCloud 📄
  • Petabox 📄
  • PikPak 📄
  • Pixeldrain 📄
  • premiumize.me 📄
  • put.io 📄
  • Proton Drive 📄
  • QingStor 📄
  • Qiniu Cloud Object Storage (Kodo) 📄
  • Quatrix 📄
  • Rackspace Cloud Files 📄
  • RackCorp Object Storage 📄
  • rsync.net 📄
  • Scaleway 📄
  • Seafile 📄
  • SeaweedFS 📄
  • Selectel Object Storage 📄
  • SFTP 📄
  • SMB / CIFS 📄
  • StackPath 📄
  • Storj 📄
  • SugarSync 📄
  • Synology C2 Object Storage 📄
  • Tencent Cloud Object Storage (COS) 📄
  • Uloz.to 📄
  • Wasabi 📄
  • WebDAV 📄
  • Yandex Disk 📄
  • Zoho WorkDrive 📄
  • The local filesystem 📄

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Bisync (two way) to keep two directories in sync bidirectionally
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDAV/FTP/SFTP/DLNA

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of the MIT license (check the COPYING file included in this package).