[gpfsug-discuss] Maximum Number of filesets on GPFS v5?
Jaime Pinto
pinto at scinet.utoronto.ca
Mon Feb 5 15:02:17 GMT 2018
We are considering moving from user/group based quotas to path based
quotas with nested filesets. We also facing challenges to traverse
'Dependent Filesets' for daily TSM backups of projects and for purging
scratch area.
We're about to deploy a new GPFS storage cluster, some 12-15PB, 13K+
users and 5K+ groups as the baseline, with expected substantial
scaling up within the next 3-5 years in all dimmensions. Therefore,
decisions we make now under GPFS v4.x trough v5.x will have
consequences in the very near future, if they are not the proper ones.
Thanks
Jaime
Quoting "Daniel Kidger" <daniel.kidger at uk.ibm.com>:
> Jamie, I believe at least one of those limits is 'maximum supported'
> rather than an architectural limit. Is your use case one which
> would push these boundaries? If so care to describe what you would
> wish to do? Daniel
>
> [1]
>
> DR DANIEL KIDGER
> IBM Technical Sales Specialist
> Software Defined Solution Sales
>
> +44-(0)7818 522 266
> daniel.kidger at uk.ibm.com
>
>
> ----- Original message -----
> From: "Jaime Pinto" <pinto at scinet.utoronto.ca>
> Sent by: gpfsug-discuss-bounces at spectrumscale.org
> To: "gpfsug main discussion list" <gpfsug-discuss at spectrumscale.org>,
> "Truong Vu" <truongv at us.ibm.com>
> Cc: gpfsug-discuss at spectrumscale.org
> Subject: Re: [gpfsug-discuss] Maximum Number of filesets on GPFS v5?
> Date: Mon, Feb 5, 2018 2:56 PM
> Thanks Truong
> Jaime
>
> Quoting "Truong Vu" <truongv at us.ibm.com>:
>
>>
>> Hi Jamie,
>>
>> The limits are the same in 5.0.0. We'll look into the FAQ.
>>
>> Thanks,
>> Tru.
>>
>>
>>
>>
>> From: gpfsug-discuss-request at spectrumscale.org
>> To: gpfsug-discuss at spectrumscale.org
>> Date: 02/05/2018 07:00 AM
>> Subject: gpfsug-discuss Digest, Vol 73, Issue 9
>> Sent by: gpfsug-discuss-bounces at spectrumscale.org
>>
>>
>>
>> Send gpfsug-discuss mailing list submissions to
>> gpfsug-discuss at spectrumscale.org
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>>
>>
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=doLWvSNAkaAwsGv0OWEMdk4umwTUPj5qHjnchKlkNE4&s=ptDCYhJK4ltkJaYKCaTThZHUXCFrHGIIPVCgBD-VH8s&e=[2]
>>
>> or, via email, send a message with subject or body 'help' to
>> gpfsug-discuss-request at spectrumscale.org
>>
>> You can reach the person managing the list at
>> gpfsug-discuss-owner at spectrumscale.org
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of gpfsug-discuss digest..."
>>
>>
>> Today's Topics:
>>
>> 1. Maximum Number of filesets on GPFS v5? (Jaime Pinto)
>>
>>
>>
> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Sun, 04 Feb 2018 14:58:39 -0500
>> From: "Jaime Pinto" <pinto at scinet.utoronto.ca>
>> To: "gpfsug main discussion list"
> <gpfsug-discuss at spectrumscale.org>
>> Subject: [gpfsug-discuss] Maximum Number of filesets on GPFS v5?
>> Message-ID:
>> <20180204145839.77101pngtlr3qacv at support.scinet.utoronto.ca>
>> Content-Type: text/plain; charset=ISO-8859-1;
>> DelSp="Yes";
>> format="flowed"
>>
>> Here is what I found for versions 4 & 3.5:
>> * Maximum Number of Dependent Filesets: 10,000
>> * Maximum Number of Independent Filesets: 1,000
>>
>>
> https://www.ibm.com/support/knowledgecenter/en/STXKQY/gpfsclustersfaq.html#filesets[3]
>>
>>
>>
>> I'm having some difficulty finding published documentation on
>> limitations for version 5:
>>
>>
> https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/6027-2699.htm[4]
>>
>>
>>
> https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1pdg_increasefilesetspace.htm[5]
>>
>>
>> Any hints?
>>
>> Thanks
>> Jaime
>>
>>
>> ---
>> Jaime Pinto
>> SciNet HPC Consortium - Compute/Calcul Canada
>> www.scinet.utoronto.ca - www.computecanada.ca
>> University of Toronto
>>
>>
>> ----------------------------------------------------------------
>> This message was sent using IMP at SciNet Consortium, University of
>> Toronto.
>>
>>
>>
>>
>> ------------------------------
>>
>> _______________________________________________
>> gpfsug-discuss mailing list
>> gpfsug-discuss at spectrumscale.org
>>
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=doLWvSNAkaAwsGv0OWEMdk4umwTUPj5qHjnchKlkNE4&s=ptDCYhJK4ltkJaYKCaTThZHUXCFrHGIIPVCgBD-VH8s&e=[6]
>>
>>
>>
>> End of gpfsug-discuss Digest, Vol 73, Issue 9
>> *********************************************
>>
>>
>>
>>
>
> ************************************
> TELL US ABOUT YOUR SUCCESS STORIES
>
> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=xnPNZO_v81jNbr_IcbbyLPUpPdAFjKIzptnqTnmqaFQ&s=Dln7axLq9ej2KttpKZJwLKuvxfSDkPErDQI5KCAQcg4&e=[7]
> ************************************
> ---
> Jaime Pinto
> SciNet HPC Consortium - Compute/Calcul Canada
> www.scinet.utoronto.ca - www.computecanada.ca
> University of Toronto
> 661 University Ave. (MaRS), Suite 1140
> Toronto, ON, M5G1M1
> P: 416-978-2755
> C: 416-505-1477
>
> ----------------------------------------------------------------
> This message was sent using IMP at SciNet Consortium, University of
> Toronto.
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=xnPNZO_v81jNbr_IcbbyLPUpPdAFjKIzptnqTnmqaFQ&s=ZMGxi-PBv5-WEGj5RFm1QV0K8azswe9Z-C6rE1ey-UQ&e=[8]
> Unless stated otherwise above:
> IBM United Kingdom Limited - Registered in England and Wales with
> number 741598.
> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire
> PO6 3AU
>
>
>
> Links:
> ------
> [1] https://www.youracclaim.com/user/danel-kidger
> [2]
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=doLWvSNAkaAwsGv0OWEMdk4umwTUPj5qHjnchKlkNE4&s=ptDCYhJK4ltkJaYKCaTThZHUXCFrHGIIPVCgBD-VH8s&e=
> [3]
> https://www.ibm.com/support/knowledgecenter/en/STXKQY/gpfsclustersfaq.html#filesets
> [4]
> https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/6027-2699.htm
> [5]
> https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1pdg_increasefilesetspace.htm
> [6]
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HQmkdQWQHoc1Nu6Mg_g8NVugim3OiUUy5n0QgLQcbkM&m=doLWvSNAkaAwsGv0OWEMdk4umwTUPj5qHjnchKlkNE4&s=ptDCYhJK4ltkJaYKCaTThZHUXCFrHGIIPVCgBD-VH8s&e=
> [7]
> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=xnPNZO_v81jNbr_IcbbyLPUpPdAFjKIzptnqTnmqaFQ&s=Dln7axLq9ej2KttpKZJwLKuvxfSDkPErDQI5KCAQcg4&e=
> [8]
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=xnPNZO_v81jNbr_IcbbyLPUpPdAFjKIzptnqTnmqaFQ&s=ZMGxi-PBv5-WEGj5RFm1QV0K8azswe9Z-C6rE1ey-UQ&e=
>
************************************
TELL US ABOUT YOUR SUCCESS STORIES
http://www.scinethpc.ca/testimonials
************************************
---
Jaime Pinto
SciNet HPC Consortium - Compute/Calcul Canada
www.scinet.utoronto.ca - www.computecanada.ca
University of Toronto
661 University Ave. (MaRS), Suite 1140
Toronto, ON, M5G1M1
P: 416-978-2755
C: 416-505-1477
----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of Toronto.
More information about the gpfsug-discuss
mailing list