[gpfsug-discuss] Migrating billions of files? mmfind ... mmxcp
Marc A Kaplan
makaplan at us.ibm.com
Wed Mar 6 15:01:57 GMT 2019
mmxcp may be in samples/ilm if not, perhaps we can put it on an approved
file sharing service ...
+ mmxcp script, for use with mmfind ... -xargs mmxcp ...
Which makes parallelized file copy relatively easy and super fast!
Usage: /gh/bin/mmxcp -t target -p strip_count source_pathname1
source_pathname2 ...
Run "cp" in a mmfind ... -xarg ... pipeline, e.g.
mmfind -polFlags '-N all -g /gpfs/tmp' /gpfs/source -gpfsWeight
DIRECTORY_HASH -xargs mmxcp -t /target -p 2
Options:
-t target_path : Copy files to this path.
-p strip_count : Remove this many directory names from the pathnames of
the source files.
-a : pass -a to cp
-v : pass -v to cp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190306/0361a3dd/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 21994 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190306/0361a3dd/attachment.gif>
More information about the gpfsug-discuss
mailing list