Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3 [2019/05/02 20:21] – Pandoc Auto-commit pandocpandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3 [2020/10/20 09:13] (current) – Pandoc Auto-commit pandoc
Line 25: Line 25:
 ====== Derzeitiges Off-Site Backup (2) ====== ====== Derzeitiges Off-Site Backup (2) ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc_network.png}}+{{.:vsc_network.png}}
  
 ====== Struktur der Daten ====== ====== Struktur der Daten ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc3_files.png}}+{{.:vsc3_files.png}}
  
 ====== Struktur der Daten (2) ====== ====== Struktur der Daten (2) ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc2_files.png}}+{{.:vsc2_files.png}}
  
 ====== Struktur der Daten (3) ====== ====== Struktur der Daten (3) ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc3_space.png}}+{{.:vsc3_space.png}}
  
 ====== Struktur der Daten (4) ====== ====== Struktur der Daten (4) ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc2_space.png}}+{{.:vsc2_space.png}}
  
 ====== Backup-Maschine ====== ====== Backup-Maschine ======
Line 123: Line 123:
 for i in {1..10} for i in {1..10}
 do  do 
-    rsync -avHAXS --delete src/server${i} dest/server${i} & +    rsync -avHAXS --delete src/server${i}/ dest/server${i}/ & 
 done done
 </code> </code>
Line 150: Line 150:
  
 <code bash> <code bash>
-rsync -avHAXS -f"+ */" -f"- */*" $sourcedir/ . >/dev/null 2>&1 &+# Sync Directory Structure 
 +rsync -avHAXS -f"+ */" -f"- */*" src/server/ dest/server/ & 
 +# Create Filelists
 ( find src/server/ ! -type d > filelist.txt ( find src/server/ ! -type d > filelist.txt
 sort -R filelist.txt > filelist2.txt sort -R filelist.txt > filelist2.txt
 split -d -a6 -n r/$numProcesses filelist2.txt > filelist.scrambled.txt ) & split -d -a6 -n r/$numProcesses filelist2.txt > filelist.scrambled.txt ) &
 +# Delete obsolete files
 rsync -r --delete --existing --ignore-existing src/server/ dest/server/ & rsync -r --delete --existing --ignore-existing src/server/ dest/server/ &
 wait wait
 +# Sync Files in Filelist
 for ((i=0; i<$numProcesses; i++)) for ((i=0; i<$numProcesses; i++))
 do  do 
Line 177: Line 180:
 ====== Bash/Rsync Magic (6) ====== ====== Bash/Rsync Magic (6) ======
  
-{{:pandoc:arge_storage:05_backup_on_vsc3:backup_on_vsc3:vsc_backup.png}}+{{.:vsc_backup.png}}
  
 ====== Bash/Rsync Magic (7) ====== ====== Bash/Rsync Magic (7) ======
Line 196: Line 199:
   * Hinzufuegen neuer Disks   * Hinzufuegen neuer Disks
   * ZFS Troubles   * ZFS Troubles
 +  * Bottlenecks
 +    * SAS
 +    * Netzwerk
 +    * CPU/Memory
  
 ====== Ausblick ====== ====== Ausblick ======
  
   * Backup auf Tapes mit IBM Spectrum Protect   * Backup auf Tapes mit IBM Spectrum Protect
 +    * Tape Library TU Wien Geodaesie
     * 9 TB / Tape unkomprimiert (LTO-7 M8)     * 9 TB / Tape unkomprimiert (LTO-7 M8)
-    * 200 MB/s write speed per drive+    * 300 MB/s write speed per drive
     * 3 Drives     * 3 Drives
     * 100 Tapes     * 100 Tapes
  • pandoc/arge_storage/05_backup_on_vsc3/backup_on_vsc3.txt
  • Last modified: 2020/10/20 09:13
  • by pandoc