Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3 [2019/05/02 20:21] – Pandoc Auto-commit pandoc | pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3 [2020/10/20 09:13] (current) – Pandoc Auto-commit pandoc | ||
---|---|---|---|
Line 25: | Line 25: | ||
====== Derzeitiges Off-Site Backup (2) ====== | ====== Derzeitiges Off-Site Backup (2) ====== | ||
- | {{: | + | {{.: |
====== Struktur der Daten ====== | ====== Struktur der Daten ====== | ||
- | {{: | + | {{.: |
====== Struktur der Daten (2) ====== | ====== Struktur der Daten (2) ====== | ||
- | {{: | + | {{.: |
====== Struktur der Daten (3) ====== | ====== Struktur der Daten (3) ====== | ||
- | {{: | + | {{.: |
====== Struktur der Daten (4) ====== | ====== Struktur der Daten (4) ====== | ||
- | {{: | + | {{.: |
====== Backup-Maschine ====== | ====== Backup-Maschine ====== | ||
Line 123: | Line 123: | ||
for i in {1..10} | for i in {1..10} | ||
do | do | ||
- | rsync -avHAXS --delete src/ | + | rsync -avHAXS --delete src/ |
done | done | ||
</ | </ | ||
Line 150: | Line 150: | ||
<code bash> | <code bash> | ||
- | rsync -avHAXS -f"+ */" -f"- */ | + | # Sync Directory Structure |
+ | rsync -avHAXS -f"+ */" -f"- */ | ||
+ | # Create Filelists | ||
( find src/server/ ! -type d > filelist.txt | ( find src/server/ ! -type d > filelist.txt | ||
sort -R filelist.txt > filelist2.txt | sort -R filelist.txt > filelist2.txt | ||
split -d -a6 -n r/ | split -d -a6 -n r/ | ||
+ | # Delete obsolete files | ||
rsync -r --delete --existing --ignore-existing src/server/ dest/ | rsync -r --delete --existing --ignore-existing src/server/ dest/ | ||
wait | wait | ||
+ | # Sync Files in Filelist | ||
for ((i=0; i< | for ((i=0; i< | ||
do | do | ||
Line 177: | Line 180: | ||
====== Bash/Rsync Magic (6) ====== | ====== Bash/Rsync Magic (6) ====== | ||
- | {{: | + | {{.: |
====== Bash/Rsync Magic (7) ====== | ====== Bash/Rsync Magic (7) ====== | ||
Line 196: | Line 199: | ||
* Hinzufuegen neuer Disks | * Hinzufuegen neuer Disks | ||
* ZFS Troubles | * ZFS Troubles | ||
+ | * Bottlenecks | ||
+ | * SAS | ||
+ | * Netzwerk | ||
+ | * CPU/Memory | ||
====== Ausblick ====== | ====== Ausblick ====== | ||
* Backup auf Tapes mit IBM Spectrum Protect | * Backup auf Tapes mit IBM Spectrum Protect | ||
+ | * Tape Library TU Wien Geodaesie | ||
* 9 TB / Tape unkomprimiert (LTO-7 M8) | * 9 TB / Tape unkomprimiert (LTO-7 M8) | ||
- | * 200 MB/s write speed per drive | + | * 300 MB/s write speed per drive |
* 3 Drives | * 3 Drives | ||
* 100 Tapes | * 100 Tapes |