[gpfsug-discuss] AMD Rome support?

[Peinkofer, Stephan]

Dear Jon,

we run a bunch of AMD EPYC Naples Dual Socket servers with GPFS in our TSM Server Cluster. From what I can say it runs stable, but IO performance in general and GPFS performance in particular - even compared to an Xeon E5 v3 system -  is rather poor. So to put that into perspective on the Xeon Systems with two EDR IB Links, we get 20GB/s read and write performance to GPFS using iozone very easily. On the AMD systems - with all AMD EPYC tuning suggestions applied you can find in the internet - we get around 15GB/s write but only 6GB/s read. We also opened a ticket at IBM for this but never found out anything. Probably because not many are running GPFS on AMD EPYC right now? The answer from AMD basically was that the bad IO performance is expected in Dual Socket systems because the Socket Interconnect is the bottleneck. (See also the IB tests DELL did https://www.dell.com/support/article/de/de/debsdt1/sln313856/amd-epyc-stream-hpl-infiniband-and-wrf-performance-study?lang=en as soon as you have to cross the socket border you get only half of the IB performance)

Of course with ROME everything get’s better (that’s what AMD told us through our vendor) but if you have the chance then I would recommend to benchmark AMD vs. XEON with your particular IO workloads before buying.

Best Regards,
Stephan Peinkofer
--
Stephan Peinkofer
Dipl. Inf. (FH), M. Sc. (TUM)

Leibniz Supercomputing Centre
Data and Storage Division
Boltzmannstraße 1, 85748 Garching b. München
URL: http://www.lrz.de

On 22. Oct 2019, at 11:12, Jon Diprose <jon at well.ox.ac.uk<mailto:jon at well.ox.ac.uk>> wrote:

Dear GPFSUG,

I see the faq says Spectrum Scale is supported on "AMD Opteron based servers".

Does anyone know if/when support will be officially extended to cover AMD Epyc, especially the new 7002 (Rome) series?

Does anyone have any experience of running Spectrum Scale on Rome they could share, in particular for protocol nodes and for plain clients?

Thanks,

Jon

--
Dr. Jonathan Diprose <jon at well.ox.ac.uk<mailto:jon at well.ox.ac.uk>>             Tel: 01865 287837
Research Computing Manager
Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org<http://spectrumscale.org>
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20191023/bceeb0e2/attachment-0002.htm>