Skip to content
Snippets Groups Projects
  1. Jul 01, 2021
  2. Jun 30, 2021
  3. Jun 28, 2021
  4. Jun 27, 2021
  5. Jun 26, 2021
  6. Jun 25, 2021
  7. Jun 24, 2021
    • Evangelos Foutras's avatar
      Monitor borg repo sizes · 0edc4292
      Evangelos Foutras authored
      Verified
      0edc4292
    • Evangelos Foutras's avatar
      Merge branch 'gitlab-backup-gzip-rsyncable' into 'master' · 90a51d33
      Evangelos Foutras authored
      gitlab-backup: Set GZIP_RSYNCABLE=yes so borg can dedup
      
      See merge request !429
      90a51d33
    • Evangelos Foutras's avatar
      gitlab-backup: Set GZIP_RSYNCABLE=yes so borg can dedup · 2222767c
      Evangelos Foutras authored
      gitlab-backup produces gzipped tarballs that cannot be meaningfully
      deduplicated by borg.  This can be mitigated by passing --rsyncable
      to gzip.
      
      The above is verified by creating two new borg repositories, adding
      the two most recent gitlab.archlinux.org archives to both, with the
      difference of re-compressing the tarballs with `gzip -1 --rsyncable`
      before adding them to the second repository.
      
      In the first case, the 215.97 GB backup archive gets compressed and
      deduplicated down to 176.24 GB. With --rsyncable it gets reduced to
      just 12.79 GB. These numbers are for /srv/gitlab/data/backups only,
      but the other non-tarballed files get sufficiently deduped already.
      
      Based on the above, I am hoping to see the borg repository for gitlab
      shrink over time from the current 3 TB to around 600 GB which is more
      manageable.
      Verified
      2222767c
  8. Jun 23, 2021
  9. Jun 22, 2021
  10. Jun 20, 2021
  11. Jun 19, 2021
  12. Jun 16, 2021
  13. Jun 15, 2021
Loading