[Dirvish] Dirvish-runall in parallel mode?

[Eric Searcy]

On Jun 15, 2008, at 3:28 AM, Arjan Schrijver wrote:

> Hi people,
>
> Is it already possible to let dirvish-runall backup multiple vaults in
> parallel? By searching Google I have found several user submitted
> patches to do exactly that, but I can't find anything about it on the
> official Dirvish website or documentation.
> Please tell me how I can do this. If it is not possible, please tell  
> me
> how you reduce the time needed to backup a lot of servers (3 hours  
> for 8
> servers at the moment).
>
> Thanks,
> Arjan

Sorry, I've been meaning to do something about that to get it into the  
stable version but haven't.  Note that this is still a development  
branch, but at

http://dirvish.org/svn/dirvish_1_2_1_ems/

you can get a version of dirvish-runall to do this.  Simply download  
the 1.2.1 tarball from the home page, extract it, then replace dirvish- 
runall.pl with the one from the above directory before running the  
install.

As for documentation, you may add the option

concurrent: value (Single)

With a value >= 1.  This only works in /etc/dirvish.conf or /etc/ 
dirvish/master.conf.  It will not work in the vault default.confs  
because it only affects runall, not the individual dirvish run.

What value you choose depends on your system.  Presumably your  
limiting factor is the remote drive or the network.  Once you get to  
concurrent: 3 or higher, you may find that the local disk becomes the  
limiting factor and further parallelization doesn't have any benefit  
(and, due to context switching on the dirvish master, is actually  
worse).

Please let me know, on-list is fine, if you have any problems with  
this.  We've been running this branch in production (we use  
concurrent: 2) for over a year now without issue at the OSL.

-- 
Eric Searcy
OSU Open Source Lab

-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 194 bytes
Desc: This is a digitally signed message part
URL: <http://lists.dirvish.org/pipermail/dirvish/attachments/20080616/04607cc2/attachment.sig>