[gpfsug-discuss] IO prioritisation / throttling?

[John Hearns]

Thankyou to Kumaran and Aaaron for your help.


From: gpfsug-discuss-bounces at spectrumscale.org [mailto:gpfsug-discuss-bounces at spectrumscale.org] On Behalf Of Kumaran Rajaram
Sent: Friday, June 23, 2017 3:37 PM
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] IO prioritisation / throttling?

Hi John,

>>We have a GPFS Setup using Fujitsu filers and Mellanox infiniband.
>>The desire it to set up an environment for test and development where if IO ‘runs wild’ it will not bring down
>>the production storage.

You may use the Spectrum Scale Quality of Service for I/O "mmchqos" command (details in link below) to define IOPS limits for the "others" as well as the "maintenance" class for the Dev/Test file-system "pools" (for e.g., mmchqos tds_fs --enable  pool=*,other=10000IOPS, maintenance=5000IOPS).  This way, the Test and Dev file-system/storage-pools IOPS can be limited/controlled to specified IOPS , giving higher priority to the production GPFS file-system/storage (with production_fs pool=* other=unlimited,maintenance=unlimited - which is the default).

https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.3/com.ibm.spectrum.scale.v4r23.doc/bl1adm_mmchqos.htm<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fsupport%2Fknowledgecenter%2FSTXKQY_4.2.3%2Fcom.ibm.spectrum.scale.v4r23.doc%2Fbl1adm_mmchqos.htm&data=01%7C01%7Cjohn.hearns%40asml.com%7C6921f7ac19a74a9c8e5908d4ba3ce6ae%7Caf73baa8f5944eb2a39d93e96cad61fc%7C1&sdata=BV0oxuDzdXu%2FGEyS1LmjsQqEf5T2vwT81ClWFZS1ReY%3D&reserved=0>
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.3/com.ibm.spectrum.scale.v4r23.doc/bl1adm_qosio_describe.htm#qosio_describe<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fsupport%2Fknowledgecenter%2FSTXKQY_4.2.3%2Fcom.ibm.spectrum.scale.v4r23.doc%2Fbl1adm_qosio_describe.htm%23qosio_describe&data=01%7C01%7Cjohn.hearns%40asml.com%7C6921f7ac19a74a9c8e5908d4ba3ce6ae%7Caf73baa8f5944eb2a39d93e96cad61fc%7C1&sdata=%2BnCF31KD1iuOmtSNWRW%2FnHBSPyiOsEMBd6zBUzU3588%3D&reserved=0>

My two cents.

Regards,
-Kums





From:        John Hearns <john.hearns at asml.com<mailto:john.hearns at asml.com>>
To:        gpfsug main discussion list <gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>>
Date:        06/23/2017 04:14 AM
Subject:        [gpfsug-discuss] IO prioritisation / throttling?
Sent by:        gpfsug-discuss-bounces at spectrumscale.org<mailto:gpfsug-discuss-bounces at spectrumscale.org>
________________________________



I guess this is a rather ill-defined question, and I realise it will be open to a lot of interpretations.
We have a GPFS Setup using Fujitsu filers and Mellanox infiniband.
The desire it to set up an environment for test and development where if IO ‘runs wild’ it will not bring down
the production storage. If anyone has a setup like this I would be interested in chatting with you.
Is it feasible to create filesets which have higher/lower priority than others?

Thankyou for any insights or feedback
John Hearns

-- The information contained in this communication and any attachments is confidential and may be privileged, and is for the sole use of the intended recipient(s). Any unauthorized review, use, disclosure or distribution is prohibited. Unless explicitly stated otherwise in the body of this communication or the attachment thereto (if any), the information is provided on an AS-IS basis without any express or implied warranties or liabilities. To the extent you are relying on this information, you are doing so at your own risk. If you are not the intended recipient, please notify the sender immediately by replying to this message and destroy all copies of this message and any attachments. Neither the sender nor the company/group of companies he or she represents shall be liable for the proper and complete transmission of the information contained in this communication, or for any delay in its receipt. _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=01%7C01%7Cjohn.hearns%40asml.com%7C6921f7ac19a74a9c8e5908d4ba3ce6ae%7Caf73baa8f5944eb2a39d93e96cad61fc%7C1&sdata=K2YE6ufXyT5nLTNtF1g7%2FFN4IsgIv%2FSIgRFx36MoIUQ%3D&reserved=0>



-- The information contained in this communication and any attachments is confidential and may be privileged, and is for the sole use of the intended recipient(s). Any unauthorized review, use, disclosure or distribution is prohibited. Unless explicitly stated otherwise in the body of this communication or the attachment thereto (if any), the information is provided on an AS-IS basis without any express or implied warranties or liabilities. To the extent you are relying on this information, you are doing so at your own risk. If you are not the intended recipient, please notify the sender immediately by replying to this message and destroy all copies of this message and any attachments. Neither the sender nor the company/group of companies he or she represents shall be liable for the proper and complete transmission of the information contained in this communication, or for any delay in its receipt.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170623/48cde0fe/attachment.htm>