[gpfsug-discuss] big difference between output of 'mmlsquota' and'du'?

Yuri L Volobuev volobuev at us.ibm.com
Mon Sep 12 22:59:36 BST 2016


'du' tallies up 'blocks allocated', not file sizes.  So it shouldn't matter
whether any sparse files are present.  GPFS doesn't charge quota for data
in snapshots (whether it should is a separate question).  The observed
discrepancy has two plausible causes:

1) Inaccuracy in quota accounting (more likely)
2) Artefacts of data replication (less likely)

Running mmcheckquota in this situation would be a good idea.

yuri



From:	Alex Chekholko <chekh at stanford.edu>
To:	gpfsug-discuss at spectrumscale.org,
Date:	09/12/2016 12:04 PM
Subject:	[gpfsug-discuss] big difference between output of 'mmlsquota'
            and	'du'?
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Hi,

For a fileset with a quota on it, we have mmlsquota reporting 39TB
utilization (out of 50TB quota), with 0 in_doubt.

Running a 'du' on the same directory (where the fileset is junctioned)
shows 21TB usage.

I looked for sparse files (files that report different size via ls vs
du).  I looked at 'du --apparent-size ...'

https://en.wikipedia.org/wiki/Sparse_file

What else could it be?

Is there some attribute I can scan for inside GPFS?
Maybe where FILE_SIZE does not equal KB_ALLOCATED?
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm



[root at scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*
3977		 /srv/gsfs0/projects/gbsc/Backups
1		 /srv/gsfs0/projects/gbsc/benchmark
13109		 /srv/gsfs0/projects/gbsc/Billing
198719		 /srv/gsfs0/projects/gbsc/Clinical
1		 /srv/gsfs0/projects/gbsc/Clinical_Vendors
1206523		 /srv/gsfs0/projects/gbsc/Data
1		 /srv/gsfs0/projects/gbsc/iPoP
123165		 /srv/gsfs0/projects/gbsc/Macrogen
58676		 /srv/gsfs0/projects/gbsc/Misc
6625890		 /srv/gsfs0/projects/gbsc/mva
1		 /srv/gsfs0/projects/gbsc/Proj
17		 /srv/gsfs0/projects/gbsc/Projects
3290502		 /srv/gsfs0/projects/gbsc/Resources
1		 /srv/gsfs0/projects/gbsc/SeqCenter
1		 /srv/gsfs0/projects/gbsc/share
514041		 /srv/gsfs0/projects/gbsc/SNAP_Scoring
1		 /srv/gsfs0/projects/gbsc/TCGA_Variants
267873		 /srv/gsfs0/projects/gbsc/tools
9597797		 /srv/gsfs0/projects/gbsc/workspace

(adds up to about 21TB)

[root at scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0
                          Block Limits
  |     File Limits
Filesystem type             GB      quota      limit   in_doubt    grace
|    files   quota    limit in_doubt    grace  Remarks
gsfs0      FILESET       39889      51200      51200          0     none
|  1663212       0        0        4     none


[root at scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc
projects.gbsc            Linked    /srv/gsfs0/projects/gbsc

Regards,
--
Alex Chekholko chekh at stanford.edu

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20160912/b0e584c4/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20160912/b0e584c4/attachment-0002.gif>


More information about the gpfsug-discuss mailing list