Syncing files between computers?

Question

I have three computers (2x OS X and 1x Ubuntu) and Android tablet. I'm trying to find a tool to automatically sync files between the computers and the tablet. Backups are handled separately, so there's no need for versioning.

Over 100GB of files should be synced between computers and a few gigabytes between computers and tablet. Therefore, services like Dropbox, Google Drive or OneDrive are not really practical, as the price is relatively high. Additionally, I don't need or want cloud syncing, as syncing that amount of data over internet takes quite bit of time (and money, depending on location).

Answer 1

Bittorrent Sync (wikipedia) seems to fit rather well. It automatically syncs files between devices whenever a connection is available, handles collisions if those happen, and is compatible with Linux, Android, OS X and Windows, among others. It does not require a central server (or specific laptop) to be available.

On the negative side, it's still beta, and might be discontinued. However, recent news says that its userbase is already over 2M, so discontinuation is probably not the biggest risk.

---

My experiences so far:

• Seems to work surprisingly well.
• Syncing to a phone is not always working without manually starting the app. This might also be just my impatience.
• Actively syncing (adding new files) on phone consumes quite a bit of battery. However, this is expected, as it rather resources intensive (preventing sleep, writing to flash, and keeping wifi active). This was the only problem during initial sync (adding 10GB of photographs).
• Performance over LAN/wifi is good. Easily, and constantly saturates the network. There're options to limit both upload and download rates.
• Clocks must be synced (relatively well, +-5min is tolerable), otherwise Sync refuses to work.
• Setting up shared folders is easy, but there's no way to exclude some of the contents (for example, temp files).
• In addition to syncing home computers and phone, I am now using Sync to publish files to my server. When sharing something, I save/export it to synced folder, and it's automatically downloaded to the server. Easier/faster than running sftp manually.

Answer 2

You could sync your devices via SSH:

• on the Linux and MacOS machines, using rsync, and schedule it via Cron
• on Android, there's e.g. FolderSync, which can deal with SSH (and several other protocols, including FTP and a couple of cloud services, so it could serve other purposes as well). It brings its own scheduler, but with its paid version can also be controlled via Tasker.

---

^{FolderSync Screenshots: Main page, define folder pairs, defined folder pairs (source: Google Play; click images for larger variants)}

---

My personal experiences

I'm using FolderSync on all of my Android devices e.g. to have my (Titanium Backup / AppMonster) backups stored on my PC, and also keep my work-logger data in sync. Initially, I encountered some problems with the one-way sync of the latter (don't remember the details exactly); but switching to two-way seems to have solved those as well. The integrated scheduler wakes the device all 5 minutes to check whether there's something to do, even if you have only one daily event scheduled – which is why I turned that off, and use Tasker to trigger the syncs. Once set up, I sometimes even forget it's there: works smoothly, and whenever I need to access my data from the PC, it's simply there and up-to-date (e.g. when preparing the timesheet based on data created on the Android device).

No need to talk about the reliability of Cron (never failed me). I'm using rsync on my Linux machines for a lot of stuff – but mostly uni-directional; so I cannot share experience from bi-di syncs. For what I sync with it (and that's a lot), I'm very pleased with it. Command-line might need a little learning concerning the parameters and which to use when; I've setup my own scripts for dedicated purposes, so I don't have to remember all the options.

Answer 3

With git-annex and git-annex-assistant you can synchronise files between all of these (and more), even tell it things like “for this subset of files, ensure it's always on at least two computers but at most one tablet” and other virtually arbitrary rules. The git-annex-assistant is the “user-friendly” side to the command-line git-extending git-annex utility, including Android, Web and other interfaces. While it may not yet be fully stable in all versions, joeyh is actively working on it, so it will get even better over time, especially as more people will use/test it.

(I linked to the kickstarter page, even though the assistant is already funded and over a year in development, because it has lots of links and amazing detail.)

I’ve used it myself (git-annex, not the assistent yet), and it’s a useful tool, but sometimes you need to think around the corner to use it to its fullest (but then, you can do things with it even the author didn’t think of; such as, an OwnCloud replacement that worked even better). No issues with compatibility, only with the one or other rare bug. Regressions did happen, but even more rarely, and were usually quickly fixed. The developer is very approachable.

Answer 4

Unison is a file synchronizer. It's good at synchronizing files between two machines, where the files can be modified on either of the two machines. If your requirements are “rsync, only two ways”, then Unison is exactly what you're after.

With more than two machines, use a star pattern: one central machine that which all other machines synchronize with.

I've been using Unison in this way since its early days (on Linux and the occasional Windows), and haven't seen an alternative come up that seemed to solve the same problem. Distributed version control systems (Mercurial, Bazaar, Git, …) can also do file synchronization as a side effect, but they're a lot more heavyweight: they're useful if you're going to do serious work on the files on each machine.

Unison can be used both from the command line and with a simple GUI. It works on Linux, OSX, and other Unix variants as well as on Windows. To synchronize with the Android tablet, you can use the native Android port (which comes with an SSH server) with optional GUI.

Answer 5

I used GoodSync (wiki) it to sync huge directories between two Windows desktops and one Ubuntu. Mac and Android support is also declared, of cause. What I personally liked:

• a lot of scheduling / including/excluding direcories/patterns / conflict strategies / hieraric jobs / whatever settings/configurations.

• nice visualization of the sync progress

• it works (already not very bad for syncing software)

However, this is commercial software, and not cheap (40$ for Mac after 30-day trial period).

Answer 6

I've used Chronosync for a few years now at work to keep my OS X computers in sync and overall it works well. It is currently available for the OS X Platform. A full feature list can be found here. You could certainly use it to also synchronize your files on Ubuntu if you set up access to it from the OS X machines.

Some of the basic features it provides are manual or automated syncing, filtering, special file handling, file deletion synchronization, and many other features. And it's surprisingly cheap at $40 for a single license.

I do not own an Android phone so I"m not certain how you connect your Android phone to your OS X computer, but if it is mounted as a disk drive, there is no reason why you couldn't then use this software to synchronize the data, but I wanted to at least share this program with you in case it helps you accomplish what you are looking for. Cheers.