[gpfsug-discuss] GPFS nodes crashing during policy scan

[Frederick Stock]

Hopefully you are aware that GPFS 3.5 has been out of service since April 
2017 unless you are on extended service.  Might be a good time to consider 
upgrading.

Fred
__________________________________________________
Fred Stock | IBM Pittsburgh Lab | 720-430-8821
stockf at us.ibm.com



From:   "Ratliff, John" <jdratlif at iu.edu>
To:     "gpfsug-discuss at spectrumscale.org" 
<gpfsug-discuss at spectrumscale.org>
Date:   12/06/2018 11:53 AM
Subject:        [gpfsug-discuss] GPFS nodes crashing during policy scan
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



We’re trying to run a policy scan to get a list of all the files in one of 
our filesets. There are approximately 600 million inodes in this space. 
We’re running GPFS 3.5. Every time we run the policy scan, the node that 
is running it ends up crashing. It makes it through a quarter of the 
inodes before crashing (i.e. kernel panic and system reboot). Nothing in 
the GPFS logs shows anything. It just notes that the node rebooted.
 
In the crash logs of all the systems we’ve tried this on, we see the same 
line.
 
<1>BUG: unable to handle kernel NULL pointer dereference at 
00000000000000d8
<1>IP: [<ffffffffa03fb7b2>] 
_ZN6Direct5dreadEP15KernelOperationRK7FileUIDxiiiPvPFiS5_PKcixyS5_EPx+0xf2/0x590 
[mmfs26]
 
Our policy scan rule is pretty simple:
 
RULE 'list-homedirs'
    LIST 'list-homedirs'
 
mmapplypolicy /gs/home -A 607 -g /gpfs/tmp -f /gpfs/policy/output -N 
gpfs1,gpfs2,gpfs3,gpfs4 -P /tmp/homedirs.policy -I defer -L 1
 
Has anyone experienced something like this or have any suggestions on what 
to do to avoid it?
 
Thanks.
 
John Ratliff | Pervasive Technology Institute | UITS | Research Storage – 
Indiana University | http://pti.iu.edu
 [attachment "smime.p7s" deleted by Frederick Stock/Pittsburgh/IBM] 
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20181206/f18dd5f1/attachment.htm>