Difference between revisions of "SAC:Backups"

From OSGeo
Jump to: navigation, search
m (current cron jobs for backups)
m (added some more file locations and sizes)
Line 51: Line 51:
 
# /root - 3MB
 
# /root - 3MB
 
# /home/back/mailman - 1370MB
 
# /home/back/mailman - 1370MB
 +
# /var/lib/mysql-zrm/daily - 401MB
 +
# /usr/local/awstats/data - 52MB
 +
# /var/www/- 6GB (SVN 7GB excluded, below)
 +
'''running total: < 9GB'''
 +
 +
===== Exclude =====
 +
# /var/www/svn - 7GB
  
 
=== Mysql ===
 
=== Mysql ===
 
MySQL is being backed up using [http://mysqlbackup.zmanda.com MySQL-zrm]
 
MySQL is being backed up using [http://mysqlbackup.zmanda.com MySQL-zrm]
 +
* Daily recovery files saved at: /var/lib/mysql-zrm/daily - other files needed?
 +
 +
=== LDAP ===
 +
* Anything needed for this?  i.e. /var/lib/ldap ?
  
 
== osgeo2 (test.osgeo.net) ==
 
== osgeo2 (test.osgeo.net) ==

Revision as of 23:24, 30 December 2007

Backups

osgeo1 (primary peer1 host)

    TODO: add in which time zone cron is running - Atlanta EST? 
     
     WISH: please don't run heavy backups during European day, but preferably 
     during Pacific Ocean day   (optimize backup time)


current cron jobs for backups

/etc/cron.d/backup.cron

#### Backup cron jobs 
# min hour day month dayofweek user command
#
# 2am: Daily rsync to /home/back
05 2 * * * root /root/scripts/daily.sh
# Every 3 hours 
# /etc/mysql-zrm
#33 */3 * * * root /usr/bin/rsync -a --delete /etc/mysql-zrm/ /home/back/etc/mysql-zrm/
# /var/lib/mysql-zrm
#34 */3 * * * root /usr/bin/rsync -a --delete /var/lib/mysql-zrm/ /home/back/mysql-zrm/
# call backup_trac_svn.sh to backup 
# subversion /var/www/svn/repos
# trac /var/www/trac
45 */3 * * * root /root/scripts/backup_svn_incremental.sh
#45 */3 * * * root /root/scripts/trac_backup.pl
#45 */3 * * * root /root/scripts/backup_trac_svn.sh
# Thisdoes some hourly drupal/mysql optimization
39 * * * * root /root/scripts/drupal_cron.sh

backup script are in /root/scripts

backup_svn_incremental.sh runs every 3 hours and only dumps what has changed in the repository in the last three hours to /home/back/svn_backup/project/incremental

backup-svn_full.sh runs once a day at 1 am and does a 'svnadmin hotcopy' of the repository in /home/back/svn_backup/project/full. 14 copies of the repository are kept.

When adding a new svn repository, make sure to edit both the _full and _incremental scripts to add backups for your projects. You will also have to create the /home/back/svn_backup/project/{full,incremental} directories or the scripts will not work. rsync_back rsyncs www.osgeo.org/home/back with test.osgeo.net/home/back (the second PEER1 server)

Daily PEER1 Backup

PEER1 hosting service is doing daily tape backup of entire system using their SANS infrastructure.

  • This is a service we pay for on both osgeo1 and osgeo2. Do we need it on both?
  • At present it is backing up the complete file systems on both servers. We must provide them some direction as to the folders to include or exclude, so we maintain a reasonable sized backup. We then send them the list through their support ticket system.

Backup Folders / Files

Please list locations to be backed up here, preferably the same on both servers. Unless we feel we can drop the service on one of them.

  1. /etc - 10MB
  2. /var/www/trac - 550MB
  3. /root - 3MB
  4. /home/back/mailman - 1370MB
  5. /var/lib/mysql-zrm/daily - 401MB
  6. /usr/local/awstats/data - 52MB
  7. /var/www/- 6GB (SVN 7GB excluded, below)

running total: < 9GB

Exclude
  1. /var/www/svn - 7GB

Mysql

MySQL is being backed up using MySQL-zrm

  • Daily recovery files saved at: /var/lib/mysql-zrm/daily - other files needed?

LDAP

  • Anything needed for this? i.e. /var/lib/ldap ?

osgeo2 (test.osgeo.net)

  • Daily PEER1 Backup above also applies

download.osgeo.org

As noted in Download Server the contents of download.osgeo.org are rsync'ed to osgeo2.