[gpfsug-discuss] Those users.... millions of files per directory - not necessarily a mistake

david_johnson at brown.edu david_johnson at brown.edu
Thu Aug 23 16:32:24 BST 2018


But heaven help you if you export the gpfs on nfs or cifs. 

  -- ddj
Dave Johnson

> On Aug 23, 2018, at 11:23 AM, Marc A Kaplan <makaplan at us.ibm.com> wrote:
> 
> Millions of files per directory, may well be a mistake... 
> 
> BUT there are some very smart use cases that might take advantage of GPFS having good performance with large directories --
> because GPFS uses extensible hashing -- it is better to store millions of files in a single GPFS directory than artificially scatter them among directories based on the mistaken notion that large directories are bad.  (Yeah, they are in most implementations, but not in GPFS.)
> 
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180823/13810d4f/attachment.htm>


More information about the gpfsug-discuss mailing list