Skip to content
Snippets Groups Projects
  1. Jun 24, 2021
    • Evangelos Foutras's avatar
      Monitor borg repo sizes · 0edc4292
      Evangelos Foutras authored
      Verified
      0edc4292
    • Evangelos Foutras's avatar
      gitlab-backup: Set GZIP_RSYNCABLE=yes so borg can dedup · 2222767c
      Evangelos Foutras authored
      gitlab-backup produces gzipped tarballs that cannot be meaningfully
      deduplicated by borg.  This can be mitigated by passing --rsyncable
      to gzip.
      
      The above is verified by creating two new borg repositories, adding
      the two most recent gitlab.archlinux.org archives to both, with the
      difference of re-compressing the tarballs with `gzip -1 --rsyncable`
      before adding them to the second repository.
      
      In the first case, the 215.97 GB backup archive gets compressed and
      deduplicated down to 176.24 GB. With --rsyncable it gets reduced to
      just 12.79 GB. These numbers are for /srv/gitlab/data/backups only,
      but the other non-tarballed files get sufficiently deduped already.
      
      Based on the above, I am hoping to see the borg repository for gitlab
      shrink over time from the current 3 TB to around 600 GB which is more
      manageable.
      Verified
      2222767c
  2. Jun 22, 2021
  3. Jun 20, 2021
  4. Jun 19, 2021
  5. Jun 16, 2021
  6. Jun 15, 2021
  7. Jun 08, 2021
  8. Jun 07, 2021
  9. Jun 06, 2021
  10. Jun 05, 2021
  11. Jun 04, 2021
  12. Jun 03, 2021
Loading