[Dirvish] Large amount of data

[Jason Boxman]

On Thursday 08 December 2005 02:00, Steve Ramage wrote:
<snip>
> One (I believe /other/foo) is NFS mounted. The idea is to have a backup
> of /foo somewhere else on the network. /foo has a large amount of data (
> I don't know if they are a few HUGE files, or alot of just big files, or
> a plethora of really small files) but they total to about 105 or 135 GB
> iirc. He said he had no luck with rsync and that it pukes, but my
> understanding is that dirvish locally (over NFS mount anyway) doesn't
> actually use rsync and so I was curious how well dirvish would preform
> in these cases. I assume that if its just a few HUGE files it would be
> okay, but any changes would result in HUGE overhead. But I don't think
> rsync would puke over a few HUGE files. How well can dirvish handle
> millions of files (lets say).

`rsync` is used for both local and remote targets.  The principle difference 
is there is no best effort to reduce bandwidth usage during copying locally 
since it's faster to just copy the each whole file instead of calculating 
differences.

-- 

Jason Boxman
http://edseek.com/ - Linux and FOSS stuff