[gpfsug-discuss] backup and disaster recovery solutions

Jaime Pinto pinto at scinet.utoronto.ca
Mon Apr 11 15:34:54 BST 2016


Do you want backups or periodic frozen snapshots of the file system?

Backups can entail some level of version control, so that you or  
end-users can get files back on certain points in time, in case of  
accidental deletions. Besides 1.5PB is a lot of material, so you may  
not want to take full snapshots that often. In that case, a  
combination of daily incremental backups using TSM with GPFS's  
mmbackup can be a good option. TSM also does a very good job at  
controlling how material is distributed across multiple tapes, and  
that is something that requires a lot of micro-management if you want  
a home grown solution of rsync+LTFS.

On the other hand, you could use gpfs built-in tools such a  
mmapplypolicy to identify candidates for incremental backup, and send  
them to LTFS. Just more micro management, and you may have to come up  
with your own tool to let end-users restore their stuff, or you'll  
have to act on their behalf.

Jaime




Quoting Damir Krstic <damir.krstic at gmail.com>:

> We have implemented 1.5PB ESS solution recently in our HPC environment.
> Today we are kicking of backup and disaster recovery discussions so I was
> wondering what everyone else is using for their backup?
>
> In our old storage environment we simply rsync-ed home and software
> directories and projects were not backed up.
>
> With ESS we are looking for more of a GPFS based backup solution -
> something to tape possibly and also something that will have life cycle
> feature - so if the file is not touched for number of days, it's moved to a
> tape (something like LTFS).
>
> Thanks in advance.
>
> DAmir
>






          ************************************
           TELL US ABOUT YOUR SUCCESS STORIES
          http://www.scinethpc.ca/testimonials
          ************************************
---
Jaime Pinto
SciNet HPC Consortium  - Compute/Calcul Canada
www.scinet.utoronto.ca - www.computecanada.org
University of Toronto
256 McCaul Street, Room 235
Toronto, ON, M5T1W5
P: 416-978-2755
C: 416-505-1477

----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of Toronto.





More information about the gpfsug-discuss mailing list