SAC:Backups

= Backups =

osgeo1 (primary peer1 host)
TODO: add in which time zone cron is running - Atlanta EST? WISH: please don't run heavy backups during European day, but preferably during Pacific Ocean day  (optimize backup time)

current cron jobs for backups
/etc/cron.d/backup.cron

# 05 2 * * * root /root/scripts/daily.sh 45 */3 * * * root /root/scripts/backup_svn_incremental.sh 39 * * * * root /root/scripts/drupal_cron.sh
 * 1) Backup cron jobs
 * 2) min hour day month dayofweek user command
 * 1) 2am: Daily rsync to /home/back
 * 1) Every 3 hours
 * 2) /etc/mysql-zrm
 * 3) 33 */3 * * * root /usr/bin/rsync -a --delete /etc/mysql-zrm/ /home/back/etc/mysql-zrm/
 * 4) /var/lib/mysql-zrm
 * 5) 34 */3 * * * root /usr/bin/rsync -a --delete /var/lib/mysql-zrm/ /home/back/mysql-zrm/
 * 6) call backup_trac_svn.sh to backup
 * 7) subversion /var/www/svn/repos
 * 8) trac /var/www/trac
 * 1) 45 */3 * * * root /root/scripts/trac_backup.pl
 * 2) 45 */3 * * * root /root/scripts/backup_trac_svn.sh
 * 3) Thisdoes some hourly drupal/mysql optimization

backup script are in /root/scripts

backup_svn_incremental.sh runs every 3 hours and only dumps what has changed in the repository in the last three hours to /home/back/svn_backup/project/incremental

backup-svn_full.sh runs once a day at 1 am and does a 'svnadmin hotcopy' of the repository in /home/back/svn_backup/project/full. 14 copies of the repository are kept.

When adding a new svn repository, make sure to edit both the _full and _incremental scripts to add backups for your projects. You will also have to create the /home/back/svn_backup/project/{full,incremental} directories or the scripts will not work. rsync_back rsyncs www.osgeo.org/home/back with test.osgeo.net/home/back (the second PEER1 server)

Daily PEER1 Backup
PEER1 hosting service is doing daily tape backup of entire system using their SANS infrastructure.
 * This is a service we pay for on both osgeo1 and osgeo2. Do we need it on both?
 * At present it is backing up the complete file systems on both servers. We must provide them some direction as to the folders to include or exclude, so we maintain a reasonable sized backup.  We then send them the list through their support ticket system.

Backup Folders / Files
Please list locations to be backed up here, preferably the same on both servers. Unless we feel we can drop the service on one of them. running total: < 9GB
 * 1) /etc - 10MB
 * 2) /var/www/trac - 550MB
 * 3) /root - 3MB
 * 4) /home/back/mailman - 1370MB
 * 5) /var/lib/mysql-zrm/daily - 401MB
 * 6) /usr/local/awstats/data - 52MB
 * 7) /var/www/- 6GB (SVN 7GB excluded, below)

Exclude

 * 1) /var/www/svn - 7GB

Mysql
MySQL is being backed up using MySQL-zrm
 * Daily recovery files saved at: /var/lib/mysql-zrm/daily - other files needed?

LDAP

 * Anything needed for this? i.e. /var/lib/ldap ?

osgeo2 (test.osgeo.net)

 * Daily PEER1 Backup above also applies

download.osgeo.org
As noted in Download Server the contents of download.osgeo.org are rsync'ed to osgeo2.

xblade14-2 (buildbot | upload | GDAL | GRASS | remotesensing.org | QGIS | GeoTools)
??? How does it work?