[gpfsug-discuss] gpfs and device number

[Lukas Hejtmanek]

Hi,

I use fsid=0 (having one export). It seems there is some incompatibility
between gpfs and redhat 3.10.0-957. We have gpfs 5.0.2-1, I can see that
5.0.2-2 is tested. So maybe it is fixed in later gpfs versions.

On Sat, Apr 27, 2019 at 10:37:48PM +0300, Tomer Perry wrote:
> Hi,
> 
> Please use the fsid option in /etc/exports ( man exports and: 
> https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.3/com.ibm.spectrum.scale.v5r03.doc/bl1adm_nfslin.htm 
> )
> Also check 
> https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.3/com.ibm.spectrum.scale.v5r03.doc/bl1adv_cnfs.htm 
>  in case you want HA with kernel NFS.
> 
> 
> 
> Regards,
> 
> Tomer Perry
> Scalable I/O Development (Spectrum Scale)
> email: tomp at il.ibm.com
> 1 Azrieli Center, Tel Aviv 67021, Israel
> Global Tel:    +1 720 3422758
> Israel Tel:      +972 3 9188625
> Mobile:         +972 52 2554625
> 
> 
> 
> 
> From:   Lukas Hejtmanek <xhejtman at ics.muni.cz>
> To:     gpfsug-discuss at spectrumscale.org
> Date:   26/04/2019 15:37
> Subject:        [gpfsug-discuss] gpfs and device number
> Sent by:        gpfsug-discuss-bounces at spectrumscale.org
> 
> 
> 
> Hello,
> 
> I noticed that from time to time, device id of a gpfs volume is not same
> across whole gpfs cluster.
> 
> [root at kat1 ~]# stat /gpfs/vol1/
>   File: ?/gpfs/vol1/?
>   Size: 262144                   Blocks: 512        IO Block: 262144 
> directory
> Device: 28h/40d          Inode: 3 
> 
> [root at kat2 ~]# stat /gpfs/vol1/
>   File: ?/gpfs/vol1/?
>   Size: 262144                   Blocks: 512        IO Block: 262144 
> directory
> Device: 2bh/43d          Inode: 3 
> 
> [root at kat3 ~]#  stat /gpfs/vol1/
>   File: ?/gpfs/vol1/?
>   Size: 262144                   Blocks: 512        IO Block: 262144 
> directory
> Device: 2ah/42d          Inode: 3
> 
> this is really bad for kernel NFS as it uses device id for file handles 
> thus
> NFS failover leads to nfs stale handle error. 
> 
> Is there a way to force a device number?
> 
> -- 
> Luká? Hejtmánek
> 
> Linux Administrator only because
>   Full Time Multitasking Ninja 
>   is not an official job title
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=F4TfIKrFl9BVdEAYxZLWlFF-zF-irdwcP9LnGpgiZrs&s=Ice-yo0p955RcTDGPEGwJ-wIwN9F6PvWOpUvR6RMd4M&e=
> 
> 
> 
> 
> 
> 

> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-- 
Lukáš Hejtmánek

Linux Administrator only because
  Full Time Multitasking Ninja 
  is not an official job title