Difference between revisions of "Backup scripts"

Latest revision as of 14:01, 10 March 2014

These backup scripts use rsync to minimize network load and creates incremental backups, preserving last four backups. For more info, read http://www.mikerubel.org/computers/rsync_snapshots/. Also recommend the article DAR differential backup mini-howto.

To install the cron job, run:

$ sudo crontab -e

And add these lines according to your personal configuration:

MAILTO=nomail@openkm.com
@weekly /root/backup.sh | tee -a /root/backup.log

Or, if you want to separate log reports by date:

MAILTO=nomail@openkm.com
@weekly /root/backup.sh | tee /root/backup.$(date +\%Y.\%m.\%d_\%H.\%M.\%S).log

MAILTO may also be used to direct mail to multiple recipients by separating recipient users with a comma.

This script will export all databases from a MySQL installation:

#!/bin/bash
#
## BEGIN CONFIG ##
MYSQL_PASS=""
DATABASE_EXP="/home/openkm/db"
## END CONFIG ##

rm -rf $DATABASE_EXP
mkdir -p $DATABASE_EXP

# Backup de MySQL
if [ -n "$MYSQL_PASS" ]; then
  MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $2 }');
 
  for DB in $MYSQL_DBS; do
    if [[ $DB != "mysql" && $DB != "test" && $DB != "information_schema" && $DB != "performance_schema" ]]; then
      echo "* Backuping MySQL data from $DB..."
      mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
    fi
  done
fi

This script will export all databases from a PostgreSQL installation:

#!/bin/bash
#
## BEGIN CONFIG ##
DATABASE_EXP="/home/openkm/db"
## END CONFIG ##

rm -rf $DATABASE_EXP
mkdir -p $DATABASE_EXP

# Backup de PostgreSQL
POSTGRESQL_DBS=$(su postgres -c "psql -l" | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $1 }');

for DB in $POSTGRESQL_DBS ; do
  if [[ $DB != "template0" && $DB != "template1" && $DB != "postgres" ]]; then
    echo "* Backuping PostgreSQL data from $DB..."
    su postgres -c "pg_dump -Fc -b $DB" > $DATABASE_EXP/pg_$DB.dmp
  fi
done

For more information take a look at Crontab quick reference

@@ Line 1: / Line 1: @@
-These backup scripts use rsync to minimize network load and creates incremental backups, preserving last four backups. For more info, read http://www.mikerubel.org/computers/rsync_snapshots/.
+{{TOCright}} __TOC__
+These backup scripts use rsync to minimize network load and creates incremental backups, preserving last four backups. For more info, read http://www.mikerubel.org/computers/rsync_snapshots/. Also recommend the article [http://dar.linux.free.fr/doc/mini-howto/dar-differential-backup-mini-howto.es.html DAR differential backup mini-howto].
 To install the cron job, run:
@@ Line 8: / Line 10: @@
 <source lang="bash">
-MAILTO=openkm@nomail.com
+MAILTO=nomail@openkm.com
 @weekly /root/backup.sh | tee -a /root/backup.log
 </source>
-== Remote backup ==
+Or, if you want to separate log reports by date:
 <source lang="bash">
-#!/bin/bash
+MAILTO=nomail@openkm.com
-#
+@weekly /root/backup.sh | tee /root/backup.$(date +\%Y.\%m.\%d_\%H.\%M.\%S).log
-## BEGIN CONFIG ##
+</source>
-HOST=$(uname -n)
-FILES="/home/openkm"
-## END CONFIG ##
-echo -e "### BEGIN: $(date +"%x %X") ###\n"
-# Stop JBoss
+{{Note|MAILTO may also be used to direct mail to multiple recipients by separating recipient users with a comma.}}
-/etc/init.d/jboss stop
-while [ "$(ps -ef | grep java | grep jboss | wc -l)" -gt "0" ]; do
-  sleep 5; echo ".";
-done
-# Copy to backup server
+This script will export all databases from a MySQL installation:
-ssh backup@server "cd $HOST; rm -rf backup.3; mv backup.2 backup.3; mv backup.1 backup.2; mv backup.0 backup.1"
-rsync -apzhR --stats --delete --exclude=*~ --delete-excluded --link-dest="/home/backup/$HOST/backup.1" $FILES backup@server:/home/backup/
-$HOST/backup.0
-# Start JBoss
-/etc/init.d/jboss start
-echo -e "\n### END: $(date +"%x %X") ###"
-</source>
-== Local backup to usb disk ==
 <source lang="bash">
 #!/bin/bash
@@ Line 44: / Line 30: @@
 ## BEGIN CONFIG ##
 MYSQL_PASS=""
-JBOSS_HOME="/home/openkm/jboss-4.2.3.GA"
 DATABASE_EXP="/home/openkm/db"
-BACKUP_DIR="/media/Backup"
-FILES="$JBOSS_HOME $DATABASE_EXP"
 ## END CONFIG ##
-if [ $(id -u) != 0 ]; then echo "You should run this script as root"; exit; fi
-# Mount disk
-mount $BACKUP_DIR
-echo -e "### BEGIN: $(date +"%x %X") ###\n"
 rm -rf $DATABASE_EXP
 mkdir -p $DATABASE_EXP
-# Stop JBoss
-/etc/init.d/jboss stop
-while [ "$(ps -ef | grep java | grep jboss | wc -l)" -gt "0" ]; do
-  sleep 5; echo ".";
-done
-# Clean logs
-echo "Clean JBoss temporal files."
-rm -rf $JBOSS_HOME/server/default/log
-rm -rf $JBOSS_HOME/server/default/tmp
-rm -rf $JBOSS_HOME/server/default/work
 # Backup de MySQL
 if [ -n "$MYSQL_PASS" ]; then
-   MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) && ($2 != "mysql") && ($2 != "test") && ($2 != "information_schema") { print $2 }');
+   MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $2 }');
-  for DB in $MYSQL_DBS ; do
+  for DB in $MYSQL_DBS; do
-    echo "* Backuping MySQL data from $DB...";
+    if [[ $DB != "mysql" && $DB != "test" && $DB != "information_schema" && $DB != "performance_schema" ]]; then
-    mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
+      echo "* Backuping MySQL data from $DB..."
+      mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
+    fi
    done
-  echo "-------------------------------------";
 fi
+</source>
+This script will export all databases from a PostgreSQL installation:
-# Rotate and copy files
+<source lang="bash">
-cd $BACKUP_DIR; rm -rf mv backup.3 backup.4; mv backup.2 backup.3; mv backup.1 backup.2; mv backup.0 backup.1; cd
+#!/bin/bash
-rsync -apzhR --stats --delete --exclude=*~ --exclude="$JBOSS_HOME/cache" --delete-excluded --link-dest="$BACKUP_DIR/backup.1" $FILES "$BACKUP_DIR/backup.0"
+#
+## BEGIN CONFIG ##
+DATABASE_EXP="/home/openkm/db"
+## END CONFIG ##
-# Start JBoss
+rm -rf $DATABASE_EXP
-/etc/init.d/jboss start
+mkdir -p $DATABASE_EXP
-echo -e "\n### END: $(date +"%x %X") ###"
-# Status
+# Backup de PostgreSQL
-echo "=================================";
+POSTGRESQL_DBS=$(su postgres -c "psql -l" | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $1 }');
-du -hs $BACKUP_DIR
-echo "*********************************";
-du -hs --time $BACKUP_DIR/*
-echo "=================================";
-df -h | grep "$BACKUP_DIR"
-echo "=================================";
-# Umount disk
+for DB in $POSTGRESQL_DBS ; do
-sync
+  if [[ $DB != "template0" && $DB != "template1" && $DB != "postgres" ]]; then
-umount $BACKUP_DIR
+    echo "* Backuping PostgreSQL data from $DB..."
+    su postgres -c "pg_dump -Fc -b $DB" > $DATABASE_EXP/pg_$DB.dmp
+  fi
+done
 </source>
+For more information take a look at [http://adminschoice.com/crontab-quick-reference Crontab quick reference]
+* [[Backup with LFTP]]
+* [[Backup with rsync]]
+* [[Backup with rdiff-backup]]
+* [[Backup with duplicity]]
 [[Category: Installation Guide]]
-[[Category: OKM Network]]

Difference between revisions of "Backup scripts"

Latest revision as of 14:01, 10 March 2014

Navigation menu

Views

Personal tools

Navigation

Search

Tools