SAC:Backups

= Backups =

backup.osgeo.org
This the OSUOSL VM used for backups starting in 2010/04. It is used for rsync backups of various things (download.osgeo.org, osgeo1, ...), and backula backups of OSU OSL VMs.
 * Admins: Frank Warmerdam (rsync), Martin Spott (backula)
 * access is via SAC shell group.
 * download.osgeo.org rsync mirroring runs nightly and is externally available at download2.osgeo.org.
 * /backup/bacula/ contains the Bacula storage device
 * /backup/rsync/ is for rsync backups
 * /backup/longterm/ is for long term backups of static material (ie conference web sites)
 * /backup/pgdump/ contains PostgreSQL dumps of the Bacula director database

Bacula
Configuration as of June, 2011

A Full copy is made every Sat. with incremental backups nightly.

This consists of the following directories: File = /boot File = /etc File = /var/www File = /osgeo File = /var/lib/mysql File = /var/lib/postgresql File = /var/lib/dpkg File = /var/lib/aptitude/pkgstates From each of the following machines:
 * wiki,secure,web,webextra,backup,qgis,projects,adhoc

trac currently gets trac_backup.zip which is generated on demand

Administration
General configuration is managed in /etc/bacula/bacula-dir.conf.

To review the backups and perform a restore you can use the bconsole application: sudo bconsole

Specific configuration of the file/tape storage is in the Storage director /etc/bacula/bacula-sd.conf
 * Bacula uses the hard drive as a series of Tape drives.
 * Each Volume is a predetermined size (~500MB currently), when a volume fills bacula makes the next one.
 * Volumes older than a certain date or when volume increments have reach a configured maximum can be recycled into the available disk pool.

Recovery
Job { Name = "RestoreFiles" Type = Restore Client = backup.osgeo.osuosl.org-fd FileSet = "Full Set" Storage = File Pool = Default Messages = Standard Where = /tmp/bacula-restores } sudo bconsole *restore Then follow the prompts, using the above linked guide to help find the files you want.
 * If you use bconsole to recover data bacula does the work of finding the files you want and pulling them out of the various volumes.
 * Directory for recovered files is set in the bacula-dir.conf under:
 * Directions for how to restore

current cron jobs for backups
/etc/cron.d/backup.cron

# 05 2 * * * root /root/scripts/daily.sh 45 */3 * * * root /root/scripts/backup_svn_incremental.sh 39 * * * * root /root/scripts/drupal_cron.sh
 * 1) Backup cron jobs
 * 2) min hour day month dayofweek user command
 * 1) 2am: Daily rsync to /home/back
 * 1) Every 3 hours
 * 2) /etc/mysql-zrm
 * 3) 33 */3 * * * root /usr/bin/rsync -a --delete /etc/mysql-zrm/ /home/back/etc/mysql-zrm/
 * 4) /var/lib/mysql-zrm
 * 5) 34 */3 * * * root /usr/bin/rsync -a --delete /var/lib/mysql-zrm/ /home/back/mysql-zrm/
 * 6) call backup_trac_svn.sh to backup
 * 7) subversion /var/www/svn/repos
 * 8) trac /var/www/trac
 * 1) 45 */3 * * * root /root/scripts/trac_backup.pl
 * 2) 45 */3 * * * root /root/scripts/backup_trac_svn.sh
 * 3) Thisdoes some hourly drupal/mysql optimization

backup script are in /root/scripts

osgeo3 & osgeo4
See: Infrastructure Transition Plan 2010

download.osgeo.org
As noted in Download Server the contents of download.osgeo.org are rsync'ed to osgeo2.

ProjectsVM
Bacula - we need details.

??? How does it work?

svn.osgeo.org
As noted in Subversion the subversion repository is mirrored using svn mirroring and does not need to be backed up otherwise.