[gpfsug-discuss] Changing ip on spectrum scale cluster with every node down and not connected to the network

Truong Vu truongv at us.ibm.com
Wed Oct 11 17:14:21 BST 2017 

What you can do is create network alias to the old IP.  Run mmchnode to
change hostname/IP for non-quorum nodes first.  Make one (or more) of the
nodes you just change a quorum node.  Change all of the quorum nodes that
still on old IPs to non-quorum.  Then change IPs on them.

Thanks,
Tru.



From:	gpfsug-discuss-request at spectrumscale.org
To:	gpfsug-discuss at spectrumscale.org
Date:	10/11/2017 04:53 AM
Subject:	gpfsug-discuss Digest, Vol 69, Issue 26
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Send gpfsug-discuss mailing list submissions to
		 gpfsug-discuss at spectrumscale.org

To subscribe or unsubscribe via the World Wide Web, visit

https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=3xds8LVU2TdfiaqkM91LA06caiYHJleBqSwOZ6ff81M&s=21OH1KjxVbfDBz9Kdr0USitreLsyXEbP9rHC7Vxmhw0&e=

or, via email, send a message with subject or body 'help' to
		 gpfsug-discuss-request at spectrumscale.org

You can reach the person managing the list at
		 gpfsug-discuss-owner at spectrumscale.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."


Today's Topics:

   1. Changing ip on spectrum scale cluster with every node down
      and not connected to network. (Andi Rhod Christiansen)
   2. Re: Changing ip on spectrum scale cluster with every node
      down and not connected to network. (Jonathan Buzzard)
   3. Re: Changing ip on spectrum scale cluster with every node
      down and not connected to network. (Andi Rhod Christiansen)
   4. Re: Changing ip on spectrum scale cluster with every node
      down and not connected to network.
      (Simon Thompson (IT Research Support))
   5. Checking a file-system for errors
      (Simon Thompson (IT Research Support))
   6. Re: Changing ip on spectrum scale cluster with every node
      down and not connected to network. (Jonathan Buzzard)


----------------------------------------------------------------------

Message: 1
Date: Wed, 11 Oct 2017 07:46:03 +0000
From: Andi Rhod Christiansen <arc at b4restore.com>
To: "gpfsug-discuss at spectrumscale.org"
		 <gpfsug-discuss at spectrumscale.org>
Subject: [gpfsug-discuss] Changing ip on spectrum scale cluster with
		 every node down and not connected to network.
Message-ID:

<3e6e1727224143ac9b8488d16f40fcb3 at B4RWEX01.internal.b4restore.com>
Content-Type: text/plain; charset="us-ascii"

Hi,

Does anyone know how to change the ips on all the nodes within a cluster
when gpfs and interfaces are down?
Right now the cluster has been shutdown and all ports disconnected(ports
has been shut down on new switch)

The problem is that when I try to execute any mmchnode command(as the ibm
documentation states) the command fails, and that makes sense as the ip on
the interface has been changed without the deamon knowing.. But is there a
way to do it manually within the configuration files so that the gpfs
daemon updates the ips of all nodes within the cluster or does anyone know
of a hack around to do it without having network access.

It is not possible to turn on the switch ports as the cluster has the same
ips right now as another cluster on the new switch.

Hope you understand, relatively new to gpfs/spectrum scale

Venlig hilsen / Best Regards

Andi R. Christiansen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_pipermail_gpfsug-2Ddiscuss_attachments_20171011_820adb01_attachment-2D0001.html&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=3xds8LVU2TdfiaqkM91LA06caiYHJleBqSwOZ6ff81M&s=NrezaW_ayd5u-bE6ppJ6p3FBluuDTtv6KHqb4TwaGsY&e=
>

------------------------------

Message: 2
Date: Wed, 11 Oct 2017 09:01:47 +0100
From: Jonathan Buzzard <jonathan.buzzard at strath.ac.uk>
To: gpfsug-discuss at spectrumscale.org
Subject: Re: [gpfsug-discuss] Changing ip on spectrum scale cluster
		 with every node down and not connected to network.
Message-ID: <8b9180bf-0bef-4e42-020b-28a9610012a1 at strath.ac.uk>
Content-Type: text/plain; charset=windows-1252; format=flowed

On 11/10/17 08:46, Andi Rhod Christiansen wrote:

[SNIP]

> It is not possible to turn on the switch ports as the cluster has the
> same ips right now as another cluster on the new switch.
>

Er, yes it is. Spin up a new temporary VLAN, drop all the ports for the
cluster in the new temporary VLAN and then bring them up. Basically any
switch on which you can remotely down the ports is going to support
VLAN's. Even the crappy 16 port GbE switch I have at home supports them.

JAB.

--
Jonathan A. Buzzard                         Tel: +44141-5483420
HPC System Administrator, ARCHIE-WeSt.
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG


------------------------------

Message: 3
Date: Wed, 11 Oct 2017 08:18:01 +0000
From: Andi Rhod Christiansen <arc at b4restore.com>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Changing ip on spectrum scale cluster
		 with every node down and not connected to network.
Message-ID:

<9fcbdf3fa2df4df5bd25f4e93d2a3e79 at B4RWEX01.internal.b4restore.com>
Content-Type: text/plain; charset="us-ascii"

Hi Jonathan,

Yes I thought about that but the system is located at a customer site and
they are not willing to do that, unfortunately.

That's why I was hoping there was a way around it

Andi R. Christiansen


-----Original Message-----
From: gpfsug-discuss-bounces at spectrumscale.org [
mailto:gpfsug-discuss-bounces at spectrumscale.org] On Behalf Of Jonathan
Buzzard
Sent: 11. oktober 2017 10:02
To: gpfsug-discuss at spectrumscale.org
Subject: Re: [gpfsug-discuss] Changing ip on spectrum scale cluster with
every node down and not connected to network.

On 11/10/17 08:46, Andi Rhod Christiansen wrote:

[SNIP]

> It is not possible to turn on the switch ports as the cluster has the
> same ips right now as another cluster on the new switch.
>

Er, yes it is. Spin up a new temporary VLAN, drop all the ports for the
cluster in the new temporary VLAN and then bring them up. Basically any
switch on which you can remotely down the ports is going to support VLAN's.
Even the crappy 16 port GbE switch I have at home supports them.

JAB.

--
Jonathan A. Buzzard                         Tel: +44141-5483420
HPC System Administrator, ARCHIE-WeSt.
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=3xds8LVU2TdfiaqkM91LA06caiYHJleBqSwOZ6ff81M&s=21OH1KjxVbfDBz9Kdr0USitreLsyXEbP9rHC7Vxmhw0&e=



------------------------------

Message: 4
Date: Wed, 11 Oct 2017 08:32:37 +0000
From: "Simon Thompson (IT Research Support)" <S.J.Thompson at bham.ac.uk>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] Changing ip on spectrum scale cluster
		 with every node down and not connected to network.
Message-ID: <D60392F9.62536%s.j.thompson at bham.ac.uk>
Content-Type: text/plain; charset="us-ascii"

I think you really want a PMR for this. There are some files you could
potentially edit and copy around, but given its cluster configuration, I
wouldn't be doing this on a cluster I cared about with explicit instruction
from IBM support.

So I suggest log a ticket with IBM.

Simon

From: <gpfsug-discuss-bounces at spectrumscale.org<
mailto:gpfsug-discuss-bounces at spectrumscale.org>> on behalf of
"arc at b4restore.com<mailto:arc at b4restore.com>" <arc at b4restore.com<
mailto:arc at b4restore.com>>
Reply-To: "gpfsug-discuss at spectrumscale.org<
mailto:gpfsug-discuss at spectrumscale.org>"
<gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>>
Date: Wednesday, 11 October 2017 at 08:46
To: "gpfsug-discuss at spectrumscale.org<
mailto:gpfsug-discuss at spectrumscale.org>"
<gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>>
Subject: [gpfsug-discuss] Changing ip on spectrum scale cluster with every
node down and not connected to network.

Hi,

Does anyone know how to change the ips on all the nodes within a cluster
when gpfs and interfaces are down?
Right now the cluster has been shutdown and all ports disconnected(ports
has been shut down on new switch)

The problem is that when I try to execute any mmchnode command(as the ibm
documentation states) the command fails, and that makes sense as the ip on
the interface has been changed without the deamon knowing.. But is there a
way to do it manually within the configuration files so that the gpfs
daemon updates the ips of all nodes within the cluster or does anyone know
of a hack around to do it without having network access.

It is not possible to turn on the switch ports as the cluster has the same
ips right now as another cluster on the new switch.

Hope you understand, relatively new to gpfs/spectrum scale

Venlig hilsen / Best Regards

Andi R. Christiansen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_pipermail_gpfsug-2Ddiscuss_attachments_20171011_cd962e6b_attachment-2D0001.html&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=3xds8LVU2TdfiaqkM91LA06caiYHJleBqSwOZ6ff81M&s=Iy6NQR-GJD1Hkc0A0C96Jkesrs6h-6HpOnnw3MOQmi4&e=
>

------------------------------

Message: 5
Date: Wed, 11 Oct 2017 08:46:46 +0000
From: "Simon Thompson (IT Research Support)" <S.J.Thompson at bham.ac.uk>
To: "gpfsug-discuss at spectrumscale.org"
		 <gpfsug-discuss at spectrumscale.org>
Subject: [gpfsug-discuss] Checking a file-system for errors
Message-ID: <D6039904.6256F%s.j.thompson at bham.ac.uk>
Content-Type: text/plain; charset="us-ascii"

I'm just wondering if anyone could share any views on checking a
file-system for errors.

For example, we could use mmfsck in online and offline mode. Does online
mode detect errors (but not fix) things that would be found in offline
mode?

And then were does mmrestripefs -c fit into this?

"-c
                  Scans the file system and compares replicas of
                  metadata and data for conflicts. When conflicts
                  are found, the -c option attempts to fix
                  the replicas.
"

Which sorta sounds like fix things in the file-system, so how does that
intersect (if at all) with mmfsck?

Thanks

Simon



------------------------------

Message: 6
Date: Wed, 11 Oct 2017 09:53:34 +0100
From: Jonathan Buzzard <jonathan.buzzard at strath.ac.uk>
To: gpfsug-discuss at spectrumscale.org
Subject: Re: [gpfsug-discuss] Changing ip on spectrum scale cluster
		 with every node down and not connected to network.
Message-ID: <1507712014.9906.5.camel at strath.ac.uk>
Content-Type: text/plain; charset="UTF-8"

On Wed, 2017-10-11 at 08:18 +0000, Andi Rhod Christiansen wrote:
> Hi Jonathan,
>
> Yes I thought about that but the system is located at a customer site
> and they are not willing to do that, unfortunately.
>
> That's why I was hoping there was a way around it
>

I would go back to them saying it's either a temporary VLAN, we have to
down the other cluster to make the change, or re-cable it to a new
unconnected switch. If the customer continues to be completely
unreasonable then it's their lookout.

JAB.

--
Jonathan A. Buzzard                         Tel: +44141-5483420
HPC System Administrator, ARCHIE-WeSt.
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG



------------------------------

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=3xds8LVU2TdfiaqkM91LA06caiYHJleBqSwOZ6ff81M&s=21OH1KjxVbfDBz9Kdr0USitreLsyXEbP9rHC7Vxmhw0&e=



End of gpfsug-discuss Digest, Vol 69, Issue 26
**********************************************



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171011/ed34cc86/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171011/ed34cc86/attachment.gif>

More information about the gpfsug-discuss mailing list