Open main menu

Synchronization

Revision as of 08:53, 29 December 2018 by 127.0.0.1 (talk) (This changes nothing)

Rsync

rsync wp:Rsync is an awesome tool that you can use to synchronize files between hosts. Fast and efficient, it's the tool of choice for deploying content, or doing service migrations from one host to another.

Lsyncd

Lsyncd watches a local directory trees event monitor interface (inotify or fsevents). It aggregates and combines events for a few seconds and then spawns one (or more) process(es) to synchronize the changes. By default this is rsync. Lsyncd is thus a light-weight live mirror solution that is comparatively easy to install not requiring new filesystems or block devices and does not hamper local filesystem performance.

Lsyncd uses SSH and rsync; and can be scripted in Lua. It's most useful on a directory tree with a low profile of expected changes. Example use cases are to provide a remote mirror, or a scripted backup.

DRBD

drbd-in-kernel.png
DRBD's position within the Linux I/O stack

DRBD The Distributed Replicated Block Device (DRBD) is a software-based, shared-nothing, replicated storage solution mirroring the content of block devices (hard disks, partitions, logical volumes etc.) between hosts.

DRBD mirrors data

  • in real time - Replication occurs continuously while applications modify the data on the device.
  • transparently - Applications need not be aware that the data is stored on multiple hosts.
  • synchronously or asynchronously - With synchronous mirroring, applications are notified of write completions after the writes have been carried out on all hosts. With asynchronous mirroring, applications are notified of write completions when the writes have completed locally, which usually is before they have propagated to the other hosts.


Filesystems

Gluster

Gluster is a software-defined scalable, distributed, file system.

MooseFS

MooseFS wp:Moose File System is another distributed file system that is partly GPL (there is also a "Pro" version) See wp:Comparison of distributed file systems