[gpfsug-discuss] AFM OpenFiles

[Peter Childs]

4.2.1.1 or CentOs 7. So that might account for it.

Thanks

Peter Childs

________________________________________
From: gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> on behalf of Venkateswara R Puvvada <vpuvvada at in.ibm.com>
Sent: Thursday, February 9, 2017 3:10:58 PM
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] AFM OpenFiles

What is the version of GPFS ? There was an issue fixed in Spectrum Scale 4.2.2 for file count(file_nr) leak. This issue mostly happens on Linux kernel version >= 3.6.

~Venkat (vpuvvada at in.ibm.com)



From:        Peter Childs <p.childs at qmul.ac.uk>
To:        gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:        02/09/2017 08:00 PM
Subject:        [gpfsug-discuss] AFM OpenFiles
Sent by:        gpfsug-discuss-bounces at spectrumscale.org
________________________________



We are trying to preform a file migration from our old GPFS cluster to our New GPFS Cluster using AFM.

Currently we have 142 AFM Filesets setup one for each fileset on the old cluster, and are attempting to prefetch the files. in batched of 100,000 files with "mmafmctl home prefetch -j $fileset --list-file=$curfile --home-fs-path=/data/$fileset 2>&1"

I'm doing this on a separate gateway node from our main gpfs servers and its work quiet well,

However there seams to be a leak in AFM with file handles and after a couple of days of prefetch the gateway will run out of file handles and need rebooting before we can continue.

We thought to begin with this was improved by not doing --metadata-only on the prefetch but in fact (As we where attempting to get the metadata before getting the main data) but in truth the machine was just lasting a little longer.

Does anyone know of any setting that may help this or what is wrong?

Thanks

Peter Childs
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss