[gpfsug-discuss] AFM OpenFiles

[Venkateswara R Puvvada]

What is the version of GPFS ? There was an issue fixed in Spectrum Scale 
4.2.2 for file count(file_nr) leak. This issue mostly happens on Linux 
kernel version >= 3.6.

~Venkat (vpuvvada at in.ibm.com)



From:   Peter Childs <p.childs at qmul.ac.uk>
To:     gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:   02/09/2017 08:00 PM
Subject:        [gpfsug-discuss] AFM OpenFiles
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



We are trying to preform a file migration from our old GPFS cluster to our 
New GPFS Cluster using AFM.

Currently we have 142 AFM Filesets setup one for each fileset on the old 
cluster, and are attempting to prefetch the files. in batched of 100,000 
files with "mmafmctl home prefetch -j $fileset --list-file=$curfile 
--home-fs-path=/data/$fileset 2>&1"

I'm doing this on a separate gateway node from our main gpfs servers and 
its work quiet well, 

However there seams to be a leak in AFM with file handles and after a 
couple of days of prefetch the gateway will run out of file handles and 
need rebooting before we can continue.

We thought to begin with this was improved by not doing --metadata-only on 
the prefetch but in fact (As we where attempting to get the metadata 
before getting the main data) but in truth the machine was just lasting a 
little longer.

Does anyone know of any setting that may help this or what is wrong?

Thanks

Peter Childs
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170209/aadd2eb1/attachment.htm>