m (Clive moved page Favog Wiki Backups to Server Backups)
No edit summary
Line 1: Line 1:
[[Category:IT]]
[[Category:IT]]
Every day, Cron runs a bash script to backup the MySQL DB & Mediawiki image files to Beaker, from where we rely on Beaker's cloud backup for longer term storage.
Crontab for <code>gonzo</code>


== The Script ==
# m h  dom mon dow  command
# every night (at 5am) back up all databases to merple
  0  5    *  *  *    /root/backup_scripts/nightly_backup.sh > /var/log/nightly_backup.log 2>&1
# local backup jobs
# give Matt a back up of the sql server databases every 4 hours
  0  */4  *  *  *    /root/backup_scripts/sqlserver_backup.sh HOUR > /var/log/hour_backup.log 2>&1
# every Monday
  0  4    1  *  *    /root/backup_scripts/sqlserver_backup.sh WEEK > /var/log/weekly_backup.log 2>&1
# and on the 1st of the month
  0  4    1  *  *    /root/backup_scripts/sqlserver_backup.sh MONTH > /var/log/monthly_backup.log 2>&1


The canonical location of the script is <code>/root/backup.sh</code>, there is a symlink from <code>/etc/cron.daily/backup.sh</code> (which is how it runs daily)
== The Scripts ==


== Databases ==
Scripts are located in <code>/root/backup</code>.


The script loops through the databases (except the system DBs 'information_schema', 'performance_schema'  & 'archive'), dumps them in SQL format to a tmpfile, and then compresses that file to <code>/mnt/beaker/IT/MySQL_Backups/[DAY OF THE WEEK]/[DATABASE].sql.bz</code>, providing us with an automated one week backlog
=== Nightly backup ===


== Wiki Uploads ==
The nightly back copies everything to <code>merple</code>. It:
# mounts <code>/mnt/backup</code> to <code>//merple/backups</code>.
# iterates over the <code>ms sqlserver</code> databases, backing them up to <code>/mnt/backup/sqlserver/$DAY</code>
# iterates over the <code>mariadb> databases, backing them up to <code>/mnt/backup/mysql/$DAY</code>
# copies the apache config to <code>/mnt/backup/apache2-config/</code>
# copies the ssl config to <code>/mnt/backup/ssl-config/</code>
# finally, using rsync directly because smb has no compression and it's too slow otherwise, it copies <code>/var/www/html</code> directly to <code>merple:/srv/backups/websites/</code>


The three live wikis (Crew, Plot & Public) also have their image directories backed up to <code>/mnt/beaker/IT/mediawiki-image-backups/</code> by rsync as part of the same script.
=== Other backups ===


== Flaws ==
In order to give Matt the ability to roll back any damaging database changes (or recover historical data), we back up the MS Sql Server every 4 hours, every Monday and on the first day of the month. These go to <code>/var/opt/mssql/data/backups/$BACKUP_FOLDER</code> and Matt can restore from them using Sql Server Manager.
 
* Errors go to cron-mail, which I'm fairly sure is a black hole
* Working out which is the most recent backup isn't trivial
* Daily cron tasks happen at 17:45, which isn't a great time to slow the DB down.

Revision as of 13:54, 26 July 2024

Crontab for gonzo

# m h  dom mon dow   command
# every night (at 5am) back up all databases to merple
  0  5    *   *   *    /root/backup_scripts/nightly_backup.sh > /var/log/nightly_backup.log 2>&1
# local backup jobs
# give Matt a back up of the sql server databases every 4 hours
  0  */4  *   *   *    /root/backup_scripts/sqlserver_backup.sh HOUR > /var/log/hour_backup.log 2>&1
# every Monday
  0  4    1   *   *    /root/backup_scripts/sqlserver_backup.sh WEEK > /var/log/weekly_backup.log 2>&1
# and on the 1st of the month
  0  4    1   *   *    /root/backup_scripts/sqlserver_backup.sh MONTH > /var/log/monthly_backup.log 2>&1

The Scripts

Scripts are located in /root/backup.

Nightly backup

The nightly back copies everything to merple. It:

  1. mounts /mnt/backup to //merple/backups.
  2. iterates over the ms sqlserver databases, backing them up to /mnt/backup/sqlserver/$DAY
  3. iterates over the mariadb> databases, backing them up to /mnt/backup/mysql/$DAY
  4. copies the apache config to /mnt/backup/apache2-config/
  5. copies the ssl config to /mnt/backup/ssl-config/
  6. finally, using rsync directly because smb has no compression and it's too slow otherwise, it copies /var/www/html directly to merple:/srv/backups/websites/

Other backups

In order to give Matt the ability to roll back any damaging database changes (or recover historical data), we back up the MS Sql Server every 4 hours, every Monday and on the first day of the month. These go to /var/opt/mssql/data/backups/$BACKUP_FOLDER and Matt can restore from them using Sql Server Manager.