[gpfsug-discuss] FIle system vs Database

Skylar Thompson skylar2 at u.washington.edu
Thu Nov 30 18:41:52 GMT 2017


On Thu, Nov 30, 2017 at 01:34:05PM -0500, Marc A Kaplan wrote:
> It would be interesting to know how well Spectrum Scale large directory 
> and small file features work in these sort of DB-ish applications.
> 
> You might want to optimize by creating a file system provisioned and tuned 
> for such application...
> 
> Regardless of file system,  `ls -1 | grep ...` in a huge directory is not 
> going to be a good idea.  But stats and/or opens on a huge directory to 
> look for a particular file should work pretty well...

I've wondered if it would be worthwhile having POSIX look-alike commands
like ls and find that plug into the GPFS API rather than making VFS calls.
That's of course a project for my Copious Free Time...

-- 
-- Skylar Thompson (skylar2 at u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine



More information about the gpfsug-discuss mailing list