[gpfsug-discuss] Using AFM to migrate files
Radhika A Parameswaran
radhika.p at in.ibm.com
Tue Oct 25 08:24:56 BST 2016
Bill,
The issues/limitation with preparing a listfile with >2M files in the file
list has been fixed in 4.2.1. It has also been internally checked with 45M
file list.
Peter,
The 4.2.1 man pages and prefetch section has added some examples of policy
and listfile options for prefetch. Please take a look at them and let us
know if those help.
Loic,
We will add about removing .ptrash to the migration usecase documentation.
Can you please share some details about your dataset and performance for
migrating the 100M (time for listfile processing and actual transfer) ?
Thanks and Regards
Radhika
From: gpfsug-discuss-request at spectrumscale.org
To: gpfsug-discuss at spectrumscale.org
Date: 10/24/2016 11:33 PM
Subject: gpfsug-discuss Digest, Vol 57, Issue 61
Sent by: gpfsug-discuss-bounces at spectrumscale.org
Send gpfsug-discuss mailing list submissions to
gpfsug-discuss at spectrumscale.org
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
gpfsug-discuss-request at spectrumscale.org
You can reach the person managing the list at
gpfsug-discuss-owner at spectrumscale.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: Using AFM to migrate files. (Bill Pappas to Loric
Totay
(Bill Pappas)
----------------------------------------------------------------------
Message: 1
Date: Mon, 24 Oct 2016 18:03:07 +0000
From: Bill Pappas <bpappas at dstonline.com>
To: "gpfsug-discuss at spectrumscale.org"
<gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Using AFM to migrate files. (Bill Pappas
to Loric Totay
Message-ID:
<CY4PR06MB2486242447FAE6FF24B9B8DFB8A90 at CY4PR06MB2486.namprd06.prod.outlook.com>
Content-Type: text/plain; charset="iso-8859-1"
>>For the record, I have completed today my AFM migration of a filesystem
with 100 million files. Users are now accessing the new filesystem.
Loric-> Hi. I was wondering, what version of GPFS where you running on
the home and cache clusters? I take it you broke up the prefetch list
into smaller (for example <2 million) file lists? If not, how? How much
capacity did you migfrate over and how long did this process take? Thanks.
Bill Pappas
901-619-0585
bpappas at dstonline.com
[1466780990050_DSTlogo.png]
[http://www.prweb.com/releases/2016/06/prweb13504050.htm]
http://www.prweb.com/releases/2016/06/prweb13504050.htm
________________________________
From: gpfsug-discuss-bounces at spectrumscale.org
<gpfsug-discuss-bounces at spectrumscale.org> on behalf of
gpfsug-discuss-request at spectrumscale.org
<gpfsug-discuss-request at spectrumscale.org>
Sent: Monday, October 24, 2016 12:05 PM
To: gpfsug-discuss at spectrumscale.org
Subject: gpfsug-discuss Digest, Vol 57, Issue 60
Send gpfsug-discuss mailing list submissions to
gpfsug-discuss at spectrumscale.org
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
gpfsug-discuss-request at spectrumscale.org
You can reach the person managing the list at
gpfsug-discuss-owner at spectrumscale.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Using AFM to migrate within the same cluster (Eric Horst)
2. Re: Using AFM to migrate files. (Peter Childs) (Peter Childs)
- URL encoding for pathnames (Loic Tortay)
3. Re: Using AFM to migrate within the same cluster (Scott Fadden)
4. Re: Using AFM to migrate files. (Peter Childs) (Peter Childs)
- URL encoding for pathnames (Yaron Daniel)
----------------------------------------------------------------------
Message: 1
Date: Mon, 24 Oct 2016 09:16:56 -0700
From: Eric Horst <erich at uw.edu>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: [gpfsug-discuss] Using AFM to migrate within the same cluster
Message-ID:
<CAF-To-2_BQSXKY1Qv2gs6BnxOC2RU=ywfiL9McW5CRehZvDpiw at mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
The recent conversation about AFM has been interesting. I've read the
documentation several times and this is my question. Can AFM be used
to migrate between two filesystems in the same cluster? There are
examples of moving between clusters with NFS or native protocol but
I've got a simple situation of needing to transparently move 100M
files between two existing filesystems.
Thanks,
-Eric
--
Eric Horst
University of Washington
------------------------------
Message: 2
Date: Mon, 24 Oct 2016 18:50:51 +0200
From: Loic Tortay <tortay at cc.in2p3.fr>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Using AFM to migrate files. (Peter
Childs) (Peter Childs) - URL encoding for pathnames
Message-ID: <f6d09494-e9c9-cb08-3ab5-5d26371aacbc at cc.in2p3.fr>
Content-Type: text/plain; charset=utf-8
On 10/24/2016 11:44 AM, Venkateswara R Puvvada wrote:
>
> mmafmctl prefecth expects encoded list file, and it is not documented
> correctly. Issues like memory leak, file descriptor leak, and fileset
> going into Unmounted state were fixed in later releases (4.2.1/4.2.2).
All
> your points are correct with respect to AFM migration. There is manual
> intervention required. Also prefetch does not give list of files which
> were failed during data read. Users need to run policy to find all
> uncached files today.
>
Hello,
For the record, I have completed today my AFM migration of a filesystem
with 100 million files. Users are now accessing the new filesystem.
After disabling user access and a last "prefetch", the AFM filesets were
converted to independent filesets.
Less than 600 files were then found to be different between the "home"
and the "cache" filesystems with a metadata comparison (I just copied
the files from the old filesystem to the new one).
I have compared the MD5 of a few thousand randomly selected files and
found no differences between the "home" and the "cache" filesystems.
I expect the users to let us know if they find something different (they
have been instructed to do so). We'll keep the "home" filesystem around
for some time, just in case there is a problem.
Maybe something else that should be mentionned in the documentation is
what to do with the ".ptrash" directories after the AFM filesets have
been converted. I removed them since they contained files that had
clearly been deleted by the users.
Lo?c.
--
| Lo?c Tortay <tortay at cc.in2p3.fr> - IN2P3 Computing Centre |
------------------------------
Message: 3
Date: Mon, 24 Oct 2016 09:57:33 -0700
From: "Scott Fadden" <sfadden at us.ibm.com>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Using AFM to migrate within the same
cluster
Message-ID:
<OF42D09886.A30A7C7B-ON88258056.005D0734-88258056.005D2900 at notes.na.collabserv.com>
Content-Type: text/plain; charset="us-ascii"
Yes you can use AFM to move data within a cluster. If you are using the
NSD protocol the target needs to be a separate file system, if you are
using NFS it needs to be an NFS export.
Scott Fadden
Spectrum Scale - Technical Marketing
Phone: (503) 880-5833
sfadden at us.ibm.com
http://www.ibm.com/systems/storage/spectrum/scale
From: Eric Horst <erich at uw.edu>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: 10/24/2016 09:17 AM
Subject: [gpfsug-discuss] Using AFM to migrate within the same
cluster
Sent by: gpfsug-discuss-bounces at spectrumscale.org
The recent conversation about AFM has been interesting. I've read the
documentation several times and this is my question. Can AFM be used
to migrate between two filesystems in the same cluster? There are
examples of moving between clusters with NFS or native protocol but
I've got a simple situation of needing to transparently move 100M
files between two existing filesystems.
Thanks,
-Eric
--
Eric Horst
University of Washington
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/866c55cf/attachment-0001.html
>
------------------------------
Message: 4
Date: Mon, 24 Oct 2016 20:05:00 +0300
From: "Yaron Daniel" <YARD at il.ibm.com>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Using AFM to migrate files. (Peter
Childs) (Peter Childs) - URL encoding for pathnames
Message-ID:
<OFBC94A30E.47D6D231-ONC2258056.005DCCB6-C2258056.005DD821 at notes.na.collabserv.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi
Maybe worth also to check if there are any orphan files in the NEW fs ?
Regards
Yaron Daniel
94 Em Ha'Moshavot Rd
Server, Storage and Data Services - Team Leader
Petach Tiqva, 49527
Global Technology Services
Israel
Phone:
+972-3-916-5672
Fax:
+972-3-916-5672
Mobile:
+972-52-8395593
e-mail:
yard at il.ibm.com
IBM Israel
From: Loic Tortay <tortay at cc.in2p3.fr>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: 10/24/2016 07:50 PM
Subject: Re: [gpfsug-discuss] Using AFM to migrate files. (Peter
Childs) (Peter Childs) - URL encoding for pathnames
Sent by: gpfsug-discuss-bounces at spectrumscale.org
On 10/24/2016 11:44 AM, Venkateswara R Puvvada wrote:
>
> mmafmctl prefecth expects encoded list file, and it is not documented
> correctly. Issues like memory leak, file descriptor leak, and fileset
> going into Unmounted state were fixed in later releases (4.2.1/4.2.2).
All
> your points are correct with respect to AFM migration. There is manual
> intervention required. Also prefetch does not give list of files which
> were failed during data read. Users need to run policy to find all
> uncached files today.
>
Hello,
For the record, I have completed today my AFM migration of a filesystem
with 100 million files. Users are now accessing the new filesystem.
After disabling user access and a last "prefetch", the AFM filesets were
converted to independent filesets.
Less than 600 files were then found to be different between the "home"
and the "cache" filesystems with a metadata comparison (I just copied
the files from the old filesystem to the new one).
I have compared the MD5 of a few thousand randomly selected files and
found no differences between the "home" and the "cache" filesystems.
I expect the users to let us know if they find something different (they
have been instructed to do so). We'll keep the "home" filesystem around
for some time, just in case there is a problem.
Maybe something else that should be mentionned in the documentation is
what to do with the ".ptrash" directories after the AFM filesets have
been converted. I removed them since they contained files that had
clearly been deleted by the users.
Lo?c.
--
| Lo?c Tortay <tortay at cc.in2p3.fr> - IN2P3 Computing Centre |
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/449a0cf1/attachment.html
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/449a0cf1/attachment.gif
>
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 57, Issue 60
**********************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/fff3f370/attachment.html
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OutlookEmoji-1466780990050_DSTlogo.png.png
Type: image/png
Size: 6282 bytes
Desc: OutlookEmoji-1466780990050_DSTlogo.png.png
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/fff3f370/attachment.png
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name:
OutlookEmoji-http://www.prweb.com/releases/2016/06/prweb13504050.htm.jpg
Type: image/jpeg
Size: 14887 bytes
Desc:
OutlookEmoji-http://www.prweb.com/releases/2016/06/prweb13504050.htm.jpg
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20161024/fff3f370/attachment.jpg
>
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 57, Issue 61
**********************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20161025/55a52590/attachment.htm>
More information about the gpfsug-discuss
mailing list