[gpfsug-discuss] Those users.... millions of files per directory - not necessarily a mistake

[Marc A Kaplan]

Even with nfs or samba export you're probably okay as long as the 
application does not attempt to list the directory.  Just probe it with 
stat/open/create/unlink. 




From:   david_johnson at brown.edu
To:     gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:   08/23/2018 11:34 AM
Subject:        Re: [gpfsug-discuss] Those users.... millions of files per 
directory - not necessarily a mistake
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



But heaven help you if you export the gpfs on nfs or cifs. 

  -- ddj
Dave Johnson

On Aug 23, 2018, at 11:23 AM, Marc A Kaplan <makaplan at us.ibm.com> wrote:

Millions of files per directory, may well be a mistake... 

BUT there are some very smart use cases that might take advantage of GPFS 
having good performance with large directories --
because GPFS uses extensible hashing -- it is better to store millions of 
files in a single GPFS directory than artificially scatter them among 
directories based on the mistaken notion that large directories are bad. 
(Yeah, they are in most implementations, but not in GPFS.)

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180823/3d278318/attachment.htm>