[gpfsug-discuss] GNR/GSS/ESS pdisk location

[atmane khiredine]

Hi sannaik

after doing some research in the Cluster I find
the pdisk e3d3s06 is must be in Enclosure 3 Drawer 3 slot 6
but now is in the Enclosure 2 Drawer 3 Slot 11 is supose to be for e2d3s11
I use the  old drive of pdisk e2d3s11 to pdisk e3d3s06
now the pdisk e3d3s06 is in the wrong location SV30708502-3-11

----
mmlspdisk e3d3s06
name = "e3d3s06"
device = "/dev/sdfa,/dev/sdir"
location = "SV30708502-3-11"
userLocation = "Rack ess1 U11-14, Enclosure 1818-80E-SV30708502 Drawer 3 Slot 11"
----
and the pdisk e2d3s11 is without location
mmlspdisk e2d3s11
name = "e2d3s11"
device = " "
location = ""
userLocation = ""
---
if i use the script replace-at-location for e3d3s06 SV25304899-3-6

replace-at-location BB1RGL e3d3s06 SV25304899-3-6
replace-at-location: error: pdisk e3d3s06 of RG BB1RGL is
in location SV30708502-3-11, not SV25304899-3-6.  Check the pdisk name and location code before continuing.

if i use the script replace-at-location for e3d3s06 SV30708502-3-11
replace-at-location BB1RGL e3d3s06 SV30708502-3-11
location SV30708502-3-11 has a location
if i use replace-at-location BB1RGR e2d3s11 SV30708502-3-11
Disk descriptor for /dev/sdfc,/dev/sdiq refers to an existing pdisk.

the pdisk e3d3s06 is must be in Enclosure 3 Drawer 3 slot 6
but now is in the Enclosure 2 Drawer 3 Slot 11 is supose to be for e2d3s11
the disk found in location SV30708502-3-11 is not a blank disk because is a lready used by e3d3s06
why e3d3s06 is take the place of e2d3s11 and is stil working

Thanks

Atmane Khiredine
HPC System Administrator | Office National de la Météorologie
Tél : +213 21 50 73 93 # 303 | Fax : +213 21 50 79 40 | E-mail : a.khiredine at meteo.dz

________________________________________
De : Sandeep Naik1 [sannaik2 at in.ibm.com]
Envoyé : dimanche 22 avril 2018 17:01
À : atmane khiredine
Cc : gpfsug main discussion list
Objet : Re: [gpfsug-discuss] GNR/GSS/ESS pdisk location

Hi Atmane,

Can you include the o/p of command tslsenclslot -a from both the nodes ?
Any thing in the logs related to this pdisk ?

Thanks,

Sandeep Naik
Elastic Storage server / GPFS Test
ETZ-B, Hinjewadi Pune India
(+91) 8600994314



From:        atmane khiredine <a.khiredine at meteo.dz>
To:        "gpfsug-discuss at spectrumscale.org" <gpfsug-discuss at spectrumscale.org>
Date:        17/04/2018 02:09 PM
Subject:        [gpfsug-discuss] GNR/GSS/ESS pdisk location
Sent by:        gpfsug-discuss-bounces at spectrumscale.org
________________________________



dear all,

I want to understand how GNR/GSS/ESS stores information about the pdisk location
I looked in the configuration file

/var/mmfs/gen/mmfsNodeData
/var/mmfs/gen/mmsdrfs
/var/mmfs/gen/mmfs.cfg

but no location of pdisk

this is real scenario of unknown location
this is the output from GNR/GSS/ESS
-----------------------------------
[root at ess1 ~]# mmlspdisk BB1RGR --not-ok
pdisk:
replacementPriority = 2.00
name = "e2d3s11"
device = ""
recoveryGroup = "BB1RGR"
declusteredArray = "DA2"
state = "missing/noPath/systemDrain/noRGD/noVCD/noData"
capacity  = 3000034656256
freeSpace = 2997887172608
location = ""
WWN = "naa.5000C50056717727"
server = "ess1-ib0"
reads = 106800946
writes = 10414075
IOErrors = 1216
IOTimeouts = 18
mediaErrors = 0
checksumErrors = 0
pathErrors = 0
relativePerformance = 1.000
userLocation = ""
userCondition = "replaceable"
hardware = "   "
hardwareType = Rotating 7200
nPaths = 0 active 0 total
nsdFormatVersion = Unknown
paxosAreaOffset = Unknown
paxosAreaSize = Unknown
logicalBlockSize = 512
-----------------------------------
I begin change the Hard disk
mmchcarrier BB1RGR --release --pdisk "e2d3s11"
I have this error
Location of pdisk e2d3s11 of recovery group BB1RGR is not known.
i know the location of the Hard disk
i know the location of the Hard disk from old mmlspdisk file
mmchcarrier BB1RGR --release --pdisk "e2d3s11" --location "SV30708502-3-11"

Location of pdisk e2d3s11 of recovery group BB1RGR is not known.
I read in the official documentation
6027-3001 [E] Location of pdisk pdiskName of recovery
group recoveryGroupName is not known.
Explanation: IBM Spectrum Scale is unable to find the
location of the given pdisk.
User response: Check the disk enclosure hardware.


Atmane Khiredine
HPC System Administrator | Office National de la Météorologie
Tél : +213 21 50 73 93 # 303 | Fax : +213 21 50 79 40 | E-mail : a.khiredine at meteo.dz
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwIFAw&c=jf_iaSHvJObTbx-siA1ZOg&r=DXkezTwrVXsEOfvoqY7_DLS86P5FtQszjm9zok6upRU&m=dtQxM0x58-X-aWHl-3gNSQq_YWWdIMi_GcStOMr9Tt0&s=SJIGLOxE4hu-R8p5at9i6BvxDkyPQn4J6LiJjaQE180&e=