SAC:Backups
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
Backups
backup.osgeo.org (aka osgeo5, mirror)
This was the OSUOSL VM used for backups starting in 2010/04 and is now upgraded to dedicated hardware (very) early in 2014. It is used for Bacula backups of OSU OSL VMs and Rsync backups of the public space at "download.osgeo.org".
- Admins: Frank Warmerdam (rsync), Martin Spott (bacula), Sandro Santilli (bacula)
- access is via SAC shell group.
- download.osgeo.org rsync mirroring runs nightly and is externally available at download2.osgeo.org.
- /backup/bacula/ contains the Bacula storage device
- /backup/rsync/ is for rsync backups
- /backup/longterm/ is for long term backups of static material (ie conference web sites)
- /backup/pgdump/ contains PostgreSQL dumps of the Bacula director database
- /etc/bacula contains Bacula configuration, is under local git repo
Hardware
CPU: Intel Xeon E3-1220v2, 3.1GHz (4-Core, 8MB Cache, 69W) 22nm RAM: 16GB (2 x 8GB DDR3-1600 ECC Unbuffered 2R DIMMs) Operating at 1600 MT/s Max NIC: Two Gigabit Ethernet Controllers (Intel 82574L) - Integrated Management: Integrated IPMI 2.0 & KVM with Dedicated LAN Controller: 2 Ports 6Gb/s SATA, and 4 Ports 3Gb/s SATA via Intel C216 Chipset PCIe 3.0 x16: No Item Selected PCIe 2.0 x4 (x8): No Item Selected NOTE: Drives will be connected to onboard SATA controller unless otherwise specified Hot-Swap Drive - 1: 3TB Seagate Constellation ES.3 (6Gb/s, 7.2K RPM, 128MB Cache) 3.5-inch SATA Hot-Swap Drive - 2: 3TB Seagate Constellation ES.3 (6Gb/s, 7.2K RPM, 128MB Cache) 3.5-inch SATA Hot-Swap Drive - 3: 3TB Seagate Constellation ES.3 (6Gb/s, 7.2K RPM, 128MB Cache) 3.5-inch SATA Hot-Swap Drive - 4: 3TB Seagate Constellation ES.3 (6Gb/s, 7.2K RPM, 128MB Cache) 3.5-inch SATA Optical Drive: Blanking Panel, No Optical Drive Front Input: Blanking Panel - No Front Inputs Power Supply: Redundant 500W Power Supply with PMBus - 80 PLUS Platinum Certified Rail Kit: 1U Sliding Rail Kit OS: No Item Selected Warranty: Standard 3-Year Warranty Notes: New quote with redundant power supply. Can I get a 2.5 inch spinning disk instead of SSD in the Front Input slot (500 GB Seagate Constellation 6 GB/s 2.5")?
OS installation
- Create an empty partition at the beginning of every hard drive, use "Reserved BIOS boot area" on GPT-partitioned disks (typical with 2 GByte disks or bigger) or just "Unused" on DOS-type partition tables. By tradition I reserve 10 MByte on each disk, maybe 1 MByte would be sufficient as well, but these 9 MByte of difference don't cost that much and you're on the safe side ....
- Create a second partition on every disk - for use by MD - allocating all the remaining disk space
- Create an MD RAID5 over all the 'second' partitions for use by LVM
- Create a LVM volume group on top of the MD physical volume
- Create volumes "boot" (256 MByte, Ext2, /boot/), "root" (20 GByte, XFS, /root/), "swap" (8 GByte), "var" (20 GByte, XFS, /var/)
- Install the base operating system, don't forget to set up SSH ;-)
- Add volumes "backup" (2 TByte, XFS, /backup/), "mirror" (1 TByte, XFS, /mirror/)
Bacula
See SAC:Bacula
osgeo1 (primary peer1 host)
current cron jobs for backups
/etc/cron.d/backup.cron
#### Backup cron jobs # min hour day month dayofweek user command # # 2am: Daily rsync to /home/back 05 2 * * * root /root/scripts/daily.sh # Every 3 hours # /etc/mysql-zrm #33 */3 * * * root /usr/bin/rsync -a --delete /etc/mysql-zrm/ /home/back/etc/mysql-zrm/ # /var/lib/mysql-zrm #34 */3 * * * root /usr/bin/rsync -a --delete /var/lib/mysql-zrm/ /home/back/mysql-zrm/ # call backup_trac_svn.sh to backup # subversion /var/www/svn/repos # trac /var/www/trac 45 */3 * * * root /root/scripts/backup_svn_incremental.sh #45 */3 * * * root /root/scripts/trac_backup.pl #45 */3 * * * root /root/scripts/backup_trac_svn.sh # Thisdoes some hourly drupal/mysql optimization 39 * * * * root /root/scripts/drupal_cron.sh
backup script are in /root/scripts
osgeo3 & osgeo4
See: Infrastructure Transition Plan 2010
download.osgeo.org
As noted in Download Server the contents of download.osgeo.org are rsync'ed to osgeo2.
ProjectsVM
Bacula - we need details.
??? How does it work?
svn.osgeo.org
As noted in Subversion the subversion repository is mirrored using svn mirroring and does not need to be backed up otherwise.