[gpfsug-discuss] FW: Spectrum Scale 5.0 now available on Fix Central

Oesterlin, Robert Robert.Oesterlin at nuance.com
Mon Dec 18 19:43:35 GMT 2017


The Scale 5.0 fix level is now up on Fix Central.

You need to be at Scale 4.2.3 (cluster level) to do a rolling upgrade to this level.


Bob Oesterlin
Sr Principal Storage Engineer, Nuance

From: "dW-notify at us.ibm.com" <dW-notify at us.ibm.com>
Reply-To: "dW-notify at us.ibm.com" <dW-notify at us.ibm.com>
Date: Monday, December 18, 2017 at 1:27 PM
Subject: [EXTERNAL] [Forums] 'gpfs at us.ibm.com' replied to the 'IBM Spectrum Scale V5.0 announcements' topic thread in the 'General Parallel File System - Announce (GPFS - Announce)' forum.

[cid:forums.png] gpfs at us.ibm.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_developerworks_community_profiles_html_profileView.do-3Fuserid-3D060000T9GF&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=YIpO2jniMJVXI1EqifZ-k4fMI36-_p1K5LqWeOadBT8&e=> replied to the IBM Spectrum Scale V5.0 announcements<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_developerworks_community_forums_html_topic-3Fid-3D2ad27846-2D6a54-2D46ba-2D96f4-2D5d6afa0df3ab&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=05bRl_SHFZieId6ukqofk_XzwZ2TSg3u-cqcGNRtobg&e=> topic thread in the General Parallel File System - Announce (GPFS - Announce)<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_developerworks_community_forums_html_forum-3Fid-3D11111111-2D0000-2D0000-2D0000-2D000000001606&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=zTY2WRO7GKP5fnLAU4K3cXg1K1VGjYOzoIDeei4xr_U&e=> forum.

IBM Spectrum Scale 5.0.0.0 is now available from IBM Fix Central:

http://www-933.ibm.com/support/fixcentral<https://urldefense.proofpoint.com/v2/url?u=http-3A__www-2D933.ibm.com_support_fixcentral&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=iHlfdUOajEj49dqjhXGjZLG-1gZmSCZX2ZaKXFzn7n4&e=>

This topic summarizes changes to the IBM Spectrum Scale licensed
program and the IBM Spectrum Scale library.

Summary of changes
for IBM Spectrum Scale version 5 release 0.0
as updated, April 2017

Changes to this release of the IBM Spectrum Scale licensed
program and the IBM Spectrum Scale library include the following:

Added DMPs for TIP events

       A topic is added listing the directed maintenance procedures for TIP events.
       The DMPs help users resolve issues caused due to TIP events.

AFM and AFM DR

       - Compression and snapshot ILM policy supported.
       - A general recommendation added for the Gateway node.
       - Configuration parameters added - afmMaxParallelRecoveries, afmAsyncOpWaitTimeout,
           afmSyncOpWaitTimeout, and afmRevalOpWaitTimeout.
       - Configuration parameters modified - afmRPO and afmHashVersion.

Authentication: Authentication packages

       Updated the authentication page to include packages specific to Ubuntu.

Authentication: AD-based authentication

       New information is added on NFS with server-side group
       lookup and Active Directory authentication.

Authentication: Primary group selection configurable for AD + RFC2307 based authentication

       Ability to choose primary group as set in "UNIX attributes" of a user on
       Active Directory introduced with AD + RFC2307 based authentication scheme.
       Earlier, Windows primary group was by default selected as the primary group.

Big data and analytics
       - The GPFS Ambari integration package is now called the IBM Spectrum
         Scale Ambari management pack (in short, management pack or MPack).
       - IBM Spectrum Scale Ambari management pack version 2.4.2.1 with
         HDFS Transparency version 2.7.3.1 supports BI 4.2/BI 4.2.5 IOP migration
         to HDP 2.6.2.
       - Supports the remote mount configuration in Ambari.
       - Supports the multiple file systems configuration. In management
         pack version 2.4.2.1, the current limit is two file systems.
       - The Short circuit write is supported for better performance.
       - In HDFS Transparency, the Ranger performance is enhanced.

Changes to IBM Spectrum Scale management API

   Added the following new commands:

       GET /perfmon/data
       GET /filesystems/{filesystemName}/afm/state
       DELETE /nodes/{name}
       POST /nodes
       GET /nodeclasses
       POST /nodeclasses
       DELETE /nodeclasses/{nodeclassName}
       GET /nodeclasses/{nodeclassName}
       PUT /nodeclasses/{nodeclassName}
       DELETE /jobs/jobId
       POST /filesystems/{filesystemName}/filesets/{filesetName}/psnaps
       DELETE /filesystems/{filesystemName}/filesets/{filesetName}/psnaps/{snapshotName}
       GET /thresholds
       GET /thresholds/{name}
       POST /thresholds
       DELETE /thresholds/{name}

IBM Spectrum Scale GUI changes

   - Added new Networks page to monitor the performance, configuration, and
      adapters of network configurations in the cluster. You can monitor the
      network performance with respect to the IP and RDMA interfaces used in the configuration.
    - Added new Monitoring > Thresholds page to create and monitor the threshold rules
      that are defined in the system.
    - Added Access > Remote Connections page to enable the GUI node of the
      local cluster to monitor the remote cluster by establishing a connection
      with the GUI node of the remote cluster.
    - Added Settings > Call Home page to configure call home. Configuring
      the call home feature helps the IBM® Support to monitor the system.
      Configuring call home also helps to reduce the response time of the
      IBM Support to resolve any issues.
      The diagnostic data that is downloaded through the Settings > Diagnostic Data
      can be uploaded to a problem management record (PMR) by using
      the call home feature in the backend. To upload the diagnostic data, right-click
      the relevant data set from the Previously Collected Diagnostic Data, and
      select Upload to PMR.
    - Added file system creation capabilities in GUI. Use the Files > File Systems > Create File System
      option to launch the Create File System wizard. In the Create File System wizard, you can specify
      the following details of the file system:
         - File system name
         - Storage pools
         - NSDs for the file systems
         - Failure groups
         - NSD order for data writes
         - Maximum number of Spectrum Scale clients
         - Maximum number of inodes of the root fileset
         - Whether to enable quota and scope for the quota definition
         - Whether to enable DMAPI
         - Mount point and automatic mount mode
    - Added the aggregation levels Access Point and Filesets and removed Account
      for the resource type Transparent Cloud Tiering in the Monitoring > Statisitics page.
    - The Files > Transparent Cloud Tiering page now displays the file systems
      and filesets that are mapped with the cloud service. It also shows the
      connection of such a container pair configuration to a cloud account and
      the corresponding CSAP that is configured for the cloud account.
    - Changes to capacity monitoring in the GUI
         - Moved the Capacity page from Monitoring to Files menu in the navigation
           and renamed the GUI page to User Capacity.
         - Only the file data user capacity can be viewed from the Files > User Capacity page.
           Removed the pools, filesets, file system capacity monitoring options from the Files > User Capacity page.
           You can monitor the capacity of these components from the respective GUI pages.
         - Replaced the GPFSPoolCap sensor with the GPFSPool sensor and separate data and metadata
           level capacity monitoring are introduced in the performance charts available in the

           Files > File Systems and Storage > Pools pages.
         - New GPFSPool-based data and metadata performance monitoring metrics are available
           for selection in the Files > Statistics > Edit > Capacity section.
           You need to select the aggregation level as Pool to view these metrics.
    - AFM monitoring changes in the GUI
         - Provides the number of AFM filesets and the corresponding export server maps.
           Each export map establishes a mapping between the gateway node and the NFS
           host name to allow parallel data transfers from cache to home.
         - By using the Request Access option available in the Files > Active File Management
           or Access > Remote Connection page in the GUI, you can now establish connection with remote clusters.
           After establishing the connection, you can monitor the following AFM and AFM DR
           configuration details across clusters:
              * On home and secondary, you can see the AFM relationships configuration,
                health status, and performance values of the Cache and Disaster Recovery grids.
              * On the Overview tab of the detailed view, the available home and secondary inodes are available.
              * On the Overview tab of the detailed view, the details such as NFS throughput,
                IOPs, and latency details are available, if the protocol is NFS.
    - New option to create AFM peer snapshots through GUI. Use the Create Peer Snapshot option
      in the Files > Snapshots page to create peer snapshots. You can view and delete these peer snapshots from
      the Snapshots page and also from the detailed view of the Files > Active File Management page.

Encryption: GSKit V8 improves cryptographic performance on IBM POWER8

   The IBM Global Security Kit (GSKit) Version 8 and later improves cryptographic performance
   on IBM POWER8 hardware. The version of GSKit that is shipped with IBM Spectrum Scale v5.0.0
   offers better performance on POWER8, compared with the versions shipped with earlier releases.

File compression: The lz4 library provides fast access to compressed data

   File compression supports the lz4 compression library. Lz4 is intended primarily for active data and
   favors read-access speed over maximized space saving.

File data: Block and subblock sizes improve I/O performance and reduce fragmentation

   The default block size is larger, 4 MiB instead of 256 KiB, and the sizes of subblocks relative to blocks
   s are smaller, for example, 8 KiB subblocks in a 4 MiB block. A larger block size improves the
   file system performance and a smaller subblock size reduces the amount of unused space. For many business
   applications, the default value of 4 MiB provides the best balance of improved performance
   and reduced fragmentation.

File encryption: AES-XTS encryption is faster on x86 in non-FIPS mode

    On x86 architecture in non-FIPS mode, file encryption with the AES algorithm in XTS mode
    is faster than it was.

File systems: File system rebalancing is faster

    Rebalancing is implemented by a lenient round-robin method that typically runs faster than the
    previously used method of strict round robin. The strict round robin method is available as an option.

installation toolkit changes

    - The installation toolkit has added support for the installation and the deployment
      of IBM Spectrum Scale in a cluster containing Elastic Storage Server (ESS).
    - The installation toolkit has added support for enabling and configuring call home.
    - The installation toolkit has added support for enabling and configuring file audit logging.
    - The installation toolkit has added support for the installation and the
      deployment of IBM Spectrum Scale on Ubuntu 16.04 LTS nodes.
    - The installation toolkit has added verification of passwordless SSH during
      prechecks before installation, deployment, or upgrade.
    - The installation toolkit has added support for cumulative object upgrade.

mmafmctl command

    The --outband parameter is deprecated.

mmcallhome command: Enhancements

    - Addition of -Y option
        * The -Y displays the command output in a parseable format with a colon (:) as a field delimiter.
    - Addition of --pmr option
        * The --pmr option allows you to upload data to existing PMRs using the
          mmcallhome run SendFile command.

mmchconfig command: Enhancements

    - Encrypted files can be copied into an LROC device
        * With the lrocEnableStoringClearText attribute, you can control whether file
          data from encrypted files, which is held in memory as cleartext, is
          copied into a local read-only cache (LROC) device.
    - InfiniBand addresses can be specified for RDMA transfers
        * In the verbsPorts attribute, you can specify InfiniBand addresses
          for RDMA transfers between an NSD client and server.

mmchnsd command: Change NSDs without unmounting the file system

    When you add or remove NSDs or do other operations with mmchnsd,
    you do not need to unmount the file system.

mmcrfs command: Enhancements

     - The default data block size is 4 MiB with an 8 KiB subblock size
         * If no block size is specified, a file system is created with a 4 MiB block size and an
           8 KiB subblock size. The minimum release level (minReleaseLevel) of the
           cluster must be 5.0.0 or greater when the file system is created.
     - The default log file size depends on block size and metadata size
         * If the block size is 512 KiB or larger and the metadata block size 256 KiB or larger,
           then the default log file size is 32 MiB. Otherwise, the default log file
           size is 4 MiB or the metadata block size, whichever is larger.
     - The default method for updating atime is relatime
         * If the minimum release level (minReleaseLevel) of the cluster is 5.0.0 or greater
           when the file system is created, the default method for updating atime is relatime.

mmdsh command: Several options are no longer supported

     The --ignoreSignal, -I, and -d options are no longer supported.
     Do not use these options unless instructed to by IBM support personnel.

mmfsck command: Display an interim status report at any time

     While a long-running instance of mmfsck is in progress, you can start another instance
     of mmfsck with the --status-report parameter to display current
     status information from all the nodes that are participating in the mmfsck run.

mmgetstate command: Display the unresponsive state

     The command returns the unresponsive state when the GPFS
     daemon is running but is not responding.

mmhealth command: Addition to measurement options

     Measurement options for filesystem, SMB node, and NFS node
     has been added to the mmhealth command.

mmkeyserv command: The simplified method supports certificate chains from a certificate authority.

     In the simplified method, with the --kmip-cert parameter, you can set up encryption with IBM®
     Security Key Lifecycle Manager (SKLM) as the key management server and with a certificate signed
     by a certificate authority (CA) on the KMIP port of the SKLM server.

mmnetverify command: Enhancements

     - Verify the network operation of nodes in a subnet
         * With the --subnets parameters, you can specify the subnet
           addresses of the nodes that you want to verify.
     - Verify that nodes can handle a new MTU size
         * With the ping-packet-size parameter, you can specify the size
           of the ICMP echo request packets that are sent between local node and the target
           node during the ping test.

mmtracectl command: Display the tracing status

     The --status parameter displays the tracing status of the specified nodes.

New feature for threshold monitoring

      Starting from IBM Spectrum Scale version 5.0.0, if multiple thresholds rules
      have overlapping entities for the same metrics, only one of the concurrent rules is
      made actively eligible.

NFS: Dynamic export changes

      You can dynamically change the export configuration without restarting the NFS service.

Object

      - Support for Ubuntu
      - Support for sudo wrapper for Object on Ubuntu
      - Support for cumulative upgrades from older versions
      - Object snap enhancement to contain keystore logs

Protocol support: Enhanced

      Protocol support is extended to Ubuntu 10.04

Setting up a system for storing crash files for Ubuntu

      A topic is added to describe how to set up a system for storing crash files for Ubuntu.

SMB: DFS redirects for SMB shares

      New option to configure DFS redirects for SMB shares.

SMB: SMB server upgrade changes

      Two events on CTDB version match/mismatch are added to the RAS events.

Sudo wrappers: Root-level processes can call administration commands directly

      Root-level background processes, such as cron and callback programs, can
      successfully call administration commands directly rather than through sudo
      when sudo wrappers are enabled.

Supported clients for NFS

      A topic is added listing the clients that are supported by NFS protocol.

Transparent cloud tiering

      - Support for multiple cloud storage accounts
      - Support for multiple file systems or filesets per node group
      - Enhanced support for large file systems provided by container spillover
      - Support for associating file sets with containers for enhanced granularity
      - Multiple URL and region support at the node level
      - Support for creating a cloud service separately for tiering and sharing operations.
      - Unique encryption key per cloud container
      - Support for remotely mounted clients.
      - Support for Amazon S3 regions requiring Sigv4 security support,
        including the US government cloud region.
      - Ability to enable or disable transparent recall for files for a given file
        system instantly, without having to rewrite a policy.
      - Support for backing up and restoring the Cloud services configuration in case of any disaster.
      - Support for backing up the Cloud services database to the cloud.
      - Support for restoring Transparent cloud tiering service on an identical backup cluster.
      - Support for checking the integrity of the Cloud services
        database after any system crash or outage.
      - Support for auditing events relating to each operation performed in Cloud services.

New commands

      mmaudit mmmsgqueue

Changed commands

      mmafmctl mmadddisk mmcallhome mmchattr mmchcluster mmchconfig mmchfs mmchnsd
      mmcloudgateway mmcrcluster mmcrfs mmdeldisk mmdsh mmfsck mmgetstate
      mmkeyserv mmnetverify mmnfs mmrestripefile mmrestripefs mmsmb mmtracectl
      mmuserauth

Deleted commands

      mmrest

New messages

      6027-1264, 6027-1757, 6027-2394, 6027-2395, 6027-2396, 6027-2397
      6027-2398, 6027-2399, 6027-2400, 6027-2401, 6027-3259, 6027-3408
      6027-3597, 6027-3598, 6027-3599, 6027-3600, 6027-3601, 6027-3602
      6027-3603, 6027-3604, 6027-3730, 6027-3921, 6027-3922, 6027-3923
      6027-3924, 6027-3925, 6027-3926, 6027-3927, 6027-3928
      6027-3929, 6027-3930, 6027-3931, 6027-4019

Changed messages

      6027-928


     Open this item<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_developerworks_community_forums_html_topic-3Fid-3D2ad27846-2D6a54-2D46ba-2D96f4-2D5d6afa0df3ab-234019da9b-2D248a-2D49ec-2D9503-2De612becd953e&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=Q6E0fg8sor2mORS3ugkurXkuV2ZUDqRd_C6_jpYXVVM&e=>


Posting Date:

Monday, December 18, 2017 at 2:26:38 PM EST



To unsubscribe or change settings, please go to your developerWorks community Settings.<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_developerworks_community_news&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=5C4z0hhuaas4Ghs1g4YfFTCE0eyNYJVmLPYrGPCuE7Q&e=>
This is a notification sent from developerWorks community.

The information contained in this e-mail message is intended only for the use of the named recipients and is subject to the IBM Online Privacy Statement<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ibm.com_privacy_details_us_en_&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=NhoaaeH3JplrJ1i1QspT5guZgy9z5td9aMxzwKGQHXk&s=7gE9uoypP_yHb1jMMSjdCN_xyJ7UU2Ifrx1TchwMkQA&e=>. If you have received this e-mail in error, please contact the sender to report the error and then delete this message from your system.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171218/9c66dc47/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 289 bytes
Desc: image001.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171218/9c66dc47/attachment.png>


More information about the gpfsug-discuss mailing list