The pushme package

[Tags:bsd3, program]

Script I use for synchronizing my data among machines.


[Skip to Readme]

Properties

Versions 0.2.0, 1.0.0, 1.0.1, 1.1.0, 1.4.0, 1.5.0, 2.0.1, 2.0.2
Dependencies aeson (>=0.7 && <0.12), base (>=4.7 && <5.0), bytestring (==0.10.*), containers (==0.5.*), foldl, io-storage (==0.3.*), lens (>=4.9 && <5.0), logging (==3.0.*), monad-logger (==0.3.*), old-locale (==1.0.*), optparse-applicative (>=0.10 && <1.0), parallel-io (==0.3.*), pipes, pipes-group, pipes-safe, pipes-text, regex-posix (>=0.95 && <1.0), safe (==0.3.*), shelly (==1.6.*), system-fileio (==0.3.*), system-filepath (==0.4.*), temporary (==1.2.*), text (==1.2.*), text-format (==0.3.*), time (>=1.4 && <1.7), transformers (>=0.3 && <0.6), unix (>=2.6 && <2.8), unordered-containers (==0.2.*), yaml (==0.8.*) [details]
License BSD3
Author John Wiegley
Maintainer John Wiegley <johnw@newartisans.com>
Stability Unknown
Category Development
Home page https://github.com/jwiegley/pushme
Source repository head: git clone https://github.com/jwiegley/pushme
Uploaded Thu Sep 29 19:14:07 UTC 2016 by JohnWiegley
Distributions NixOS:2.0.2
Downloads 1249 total (18 in the last 30 days)
Votes
0 []
Status Docs not available [build log]
All reported builds failed as of 2016-11-19 [all 3 reports]

Downloads

Maintainer's Corner

For package maintainers and hackage trustees

Readme for pushme

Readme for pushme-2.0.2

This is the script I use for synchronizing data between my machines (and also to directories on the same machine, externally connected drives, and to and between ZFS filesystems).

Each "fileset" you wish to synchronize is defined in a YAML file within ~/.pushme/conf.d, for example this recipe I use for synchronizing my

Name:     'Desktop'
Priority: 12
Class:    'quick,main,sync'

Stores:
  hermes:
    Path: /Users/johnw/Desktop
  
  maia:
    Path: /Users/johnw/Desktop
  
  vulcan:
    Path: /Users/johnw/Desktop
  
Options:
  Rsync:
    Filters:
      - '- /annex/'

Filters may also be specified for a specific computer only:

Name:     'Desktop'
Priority: 12
Class:    'quick,main,sync'

Stores:
  hermes:
    Rsync:
      Path: /tank/Archives
      Filters:
        - '- /annex/'
  
  maia:
    Path: /Users/johnw/Desktop
  
  vulcan:
    Path: /Users/johnw/Desktop

There are three backends supported for file transfer Rsync (the default, if none is specified), Zfs, and Annex. When two backends mismatch for a given machine, Rsync is used, otherwise the most optimal method for synchronizing that particular fileset type is attempted.

Note that recently I have only been using the Rsync method, so the other backends are not well tested, and should not be used except on trial data at this time. If you wish to help support them, I am available for assistance.

Pushme is invoked as follows (--from can be omitted, if hostname returns the same string):

pushme --from thisMachine thatMachine

This command will synchronize every fileset that contains a backend definition for both thisMachine and thatMachine. Here is example output from such a command, assuming two filesets home and local:

foo $ pushme thatMachine
15:18:44 - [NOTICE] Synchronizing ThisMachine -> ThatMachine
15:18:44 - [NOTICE] Sending ThisMachine/home → ThatMachine
15:18:52 - [NOTICE] Sent 151.0M in 131 files (out of 1.37G in 12,418)
15:20:26 - [NOTICE] Sending ThisMachine/local → ThatMachine
15:21:02 - [NOTICE] Sent 0b in 0 files (out of 6.45G in 207,453)

Some common options include:

$ pushme -c quick bar       # only sync filesets with the "quick" class
$ pushme -f home bar        # only sync the "home" fileset
$ pushme -n bar             # don't do anything, just scan
$ pushme -N bar             # don't even scan
$ pushme -v bar             # show commands being executed
$ pushme -D bar             # show more info than you want to see