[gpfsug-discuss] searching for mmcp or mmcopy - optimized bulk copy for spectrum scale?

Brian Marshall mimarsh2 at vt.edu
Mon Dec 5 14:09:56 GMT 2016


All,

I am in the same boat.  I'd like to copy ~500 TB from one filesystem to
another.  Both are being served by the same NSD servers.

We've done the multiple rsync script method in the past (and yes it's a bit
of a pain).  Would love to have an easier utility.

Best,
Brian Marshall

On Mon, Dec 5, 2016 at 5:26 AM, Heiner Billich <Heiner.Billich at psi.ch>
wrote:

> Hello,
>
> I heard about some gpfs optimized bulk(?) copy command  named 'mmcp' or
> 'mmcopy' but couldn't find it in either /user/lpp/mmfs/samples/ or by
> asking google. Can please somebody point me to the source? I wonder whether
> it  allows incremental copies as rsync does.
>
> We need to copy a few 100TB of data and simple rsync provides just about
> 100MB/s. I know about the possible workarounds - write a wrapper script,
> run several rsyncs in parallel, distribute the rsync jobs on several nodes,
> use a special rsync versions that knows about gpfs ACLs, ... or try mmfind,
> which requires me to write a custom wrapper for cp ....
>
> I really would prefer some ready-to-use script or program.
>
> Thank you and kind regards,
> Heiner Billich
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20161205/d37c4a02/attachment.htm>


More information about the gpfsug-discuss mailing list