[kwlug-disc] Transferring large backup files over the network

[Michael Sudnick]

If you can soften the NTFS requirements and need to move a lot of data fast
you could look at http://moo.nac.uci.edu/~hjm/parsync/

Parsync parallelizes rsync. May be overkill for your scenario though.

-Michael

On Thu, 23 May 2019 at 16:35, Chris Craig <kwlug.org at ciotog.net> wrote:

> I've used Unison on occasion, and it handles bidirectional updates so
> single direction is even more trivial.
>
> https://www.cis.upenn.edu/~bcpierce/unison/
>
> On Thu, 23 May 2019 at 15:20, Paul Nijjar via kwlug-disc <
> kwlug-disc at kwlug.org> wrote:
>
>> Say I have a big (multi-terabyte) collection of backup files (which
>> tend to be large, in the tens of gigabytes) sitting on some server A.
>>
>> I have a LAN connection (maybe gigabit, maybe 100MBit) available and
>> another server B in a different building. I want to regularly transfer
>> the collection of files from server A to server B each evening.
>>
>> Maybe the filesystem on server A is NTFS, but this is a soft
>> requirement that I would try to work around if I could.
>>
>> What FLOSS tools would be best for this use case and why?
>> If you know of good solutions that would play with NTFS, that is a
>> bonus. (rsync is not in that category, especially if Server A has to
>> run Windows.) But even if we soften the NTFS requirement, I am not
>> sure whether rsync is still the best solution here.
>>
>> - Paul
>>
>> --
>> Sign Up for the WatCamp Newsletter: https://da.gd/wtcmp-news
>> (Also http://pnijjar.freeshell.org still exists)
>>
>> _______________________________________________
>> kwlug-disc mailing list
>> kwlug-disc at kwlug.org
>> http://kwlug.org/mailman/listinfo/kwlug-disc_kwlug.org
>>
> _______________________________________________
> kwlug-disc mailing list
> kwlug-disc at kwlug.org
> http://kwlug.org/mailman/listinfo/kwlug-disc_kwlug.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://kwlug.org/pipermail/kwlug-disc_kwlug.org/attachments/20190523/bad1ef16/attachment.htm>