[gpfsug-discuss] backup and disaster recovery solutions
Jaime Pinto
pinto at scinet.utoronto.ca
Mon Apr 11 15:34:54 BST 2016
Do you want backups or periodic frozen snapshots of the file system?
Backups can entail some level of version control, so that you or
end-users can get files back on certain points in time, in case of
accidental deletions. Besides 1.5PB is a lot of material, so you may
not want to take full snapshots that often. In that case, a
combination of daily incremental backups using TSM with GPFS's
mmbackup can be a good option. TSM also does a very good job at
controlling how material is distributed across multiple tapes, and
that is something that requires a lot of micro-management if you want
a home grown solution of rsync+LTFS.
On the other hand, you could use gpfs built-in tools such a
mmapplypolicy to identify candidates for incremental backup, and send
them to LTFS. Just more micro management, and you may have to come up
with your own tool to let end-users restore their stuff, or you'll
have to act on their behalf.
Jaime
Quoting Damir Krstic <damir.krstic at gmail.com>:
> We have implemented 1.5PB ESS solution recently in our HPC environment.
> Today we are kicking of backup and disaster recovery discussions so I was
> wondering what everyone else is using for their backup?
>
> In our old storage environment we simply rsync-ed home and software
> directories and projects were not backed up.
>
> With ESS we are looking for more of a GPFS based backup solution -
> something to tape possibly and also something that will have life cycle
> feature - so if the file is not touched for number of days, it's moved to a
> tape (something like LTFS).
>
> Thanks in advance.
>
> DAmir
>
************************************
TELL US ABOUT YOUR SUCCESS STORIES
http://www.scinethpc.ca/testimonials
************************************
---
Jaime Pinto
SciNet HPC Consortium - Compute/Calcul Canada
www.scinet.utoronto.ca - www.computecanada.org
University of Toronto
256 McCaul Street, Room 235
Toronto, ON, M5T1W5
P: 416-978-2755
C: 416-505-1477
----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of Toronto.
More information about the gpfsug-discuss
mailing list