[gpfsug-discuss] Analyse steps if disk are down after reboot

IBM Spectrum Scale scale at us.ibm.com
Thu Jul 12 12:33:39 BST 2018


Just to follow up on the question about where to learn why a NSD is marked 
down you should see a message in the GPFS log, /var/adm/ras/mmfs.log.*

Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479
. 

If your query concerns a potential software error in Spectrum Scale (GPFS) 
and you have an IBM software maintenance contract please contact 
1-800-237-5511 in the United States or your local IBM Service Center in 
other countries. 

The forum is informally monitored as time permits and should not be used 
for priority messages to the Spectrum Scale (GPFS) team.



From:   "Grunenberg, Renar" <Renar.Grunenberg at huk-coburg.de>
To:     'gpfsug main discussion list' <gpfsug-discuss at spectrumscale.org>
Date:   07/12/2018 06:01 AM
Subject:        Re: [gpfsug-discuss] Analyse steps if disk are down after 
reboot
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



Hallo Achim, hallo Simon,
first thanks for your answers. I think Achims answers map these at best. 
The nsd-servers (only 2) for these disk were mistakenly restart in a same 
time window. 
 
Renar Grunenberg
Abteilung Informatik – Betrieb

HUK-COBURG
Bahnhofsplatz
96444 Coburg
Telefon:
09561 96-44110
Telefax:
09561 96-44104
E-Mail:
Renar.Grunenberg at huk-coburg.de
Internet:
www.huk.de
HUK-COBURG Haftpflicht-Unterstützungs-Kasse kraftfahrender Beamter 
Deutschlands a. G. in Coburg
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.
Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav 
Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.
Diese Nachricht enthält vertrauliche und/oder rechtlich geschützte 
Informationen.
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich 
erhalten haben,
informieren Sie bitte sofort den Absender und vernichten Sie diese 
Nachricht.
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht 
ist nicht gestattet.

This information may contain confidential and/or privileged information.
If you are not the intended recipient (or have received this information 
in error) please notify the
sender immediately and destroy this information.
Any unauthorized copying, disclosure or distribution of the material in 
this information is strictly forbidden.

Von: gpfsug-discuss-bounces at spectrumscale.org [
mailto:gpfsug-discuss-bounces at spectrumscale.org] Im Auftrag von Achim 
Rehor
Gesendet: Donnerstag, 12. Juli 2018 11:47
An: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Betreff: Re: [gpfsug-discuss] Analyse steps if disk are down after reboot
 
Hi Renar, 

whenever an access to a NSD happens, there is a potential that the node 
cannot access the disk, so if the (only) NSD server is down, there will be 
no chance to access the disk, and the disk will be set down.
If you have twintailed disks, the 'second' (or possibly some more) NSD 
server will be asked, switching to networked access, and in that case only 
if that also fails, the disk will be set to down as well. 

Not sure how your setup is, but if you reboot 2 NSD servers, and some 
client possibly did IO to a file served by just these 2, then the 'down' 
state would be explainable. 

Rebooting of an NSD server should never set a disk to down, except, he was 
the only one serving that NSD.


Mit freundlichen Grüßen / Kind regards
Achim Rehor


 
Software Technical Support Specialist AIX/ Emea HPC Support

IBM Certified Advanced Technical Expert - Power Systems with AIX
TSCC Software Service, Dept. 7922
Global Technology Services 

Phone:
+49-7034-274-7862
 IBM Deutschland
E-Mail:
Achim.Rehor at de.ibm.com
 Am Weiher 24
 
 
 65451 Kelsterbach
 
 
 Germany
 
 
 

 
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter 
Geschäftsführung: Martin Hartmann (Vorsitzender), Norbert Janzen, Stefan 
Lutz, Nicole Reimer, Dr. Klaus Seifert, Wolfgang Wendt 
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, 
HRB 14562 WEEE-Reg.-Nr. DE 99369940 
 
 



From:        "Grunenberg, Renar" <Renar.Grunenberg at huk-coburg.de>
To:        "'gpfsug-discuss at spectrumscale.org'" <
gpfsug-discuss at spectrumscale.org>
Date:        12/07/2018 10:17
Subject:        [gpfsug-discuss] Analyse steps if disk are down after 
reboot
Sent by:        gpfsug-discuss-bounces at spectrumscale.org




Hallo All,
 
we see after a reboot of two NSD-Servers some disks in different 
filesystems are down and we don’t see why. 
The logs (messages, dmesg, kern,..) are saying nothing. We are on Rhel7.4 
and SS 5.0.1.1.
The question now, there are any log, structures in the gpfs deamon that 
log these situation? What was the reason why the deamon hast no access to 
the disks at that startup phase.
Any hints are appreciated. 
Renar Grunenberg
Abteilung Informatik – Betrieb

HUK-COBURG
Bahnhofsplatz
96444 Coburg

Telefon:
09561 96-44110
Telefax:
09561 96-44104
E-Mail:
Renar.Grunenberg at huk-coburg.de
Internet:
www.huk.de

HUK-COBURG Haftpflicht-Unterstützungs-Kasse kraftfahrender Beamter 
Deutschlands a. G. in Coburg
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.
Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav 
Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.

Diese Nachricht enthält vertrauliche und/oder rechtlich geschützte 
Informationen.
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich 
erhalten haben,
informieren Sie bitte sofort den Absender und vernichten Sie diese 
Nachricht.
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht 
ist nicht gestattet.

This information may contain confidential and/or privileged information.
If you are not the intended recipient (or have received this information 
in error) please notify the
sender immediately and destroy this information.
Any unauthorized copying, disclosure or distribution of the material in 
this information is strictly forbidden.

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
 _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180712/066a63cc/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 7182 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180712/066a63cc/attachment.gif>


More information about the gpfsug-discuss mailing list