Commit 9fd5d458 authored by Evangelos Foutras's avatar Evangelos Foutras 🐱
Browse files

syncarchive: Drop --delay-updates; breaks incremental scan

The --delay-updates option results in 6G memory usage per archive mirror
for a total of ~18G memory used on gemini when all three archive mirrors
are syncing. Less important (but still revelant!) is the memory usage on
each mirror, which climbs to about 11G during each synchronization.

Removing the --delay-updates option should be OK considering the archive
hosts data that almost never changes. Without this option, rsync is able
to do a sequential scan which uses 90M of memory (per archive mirror) on
gemini and about 250M on each mirror individually.
parent 86225110
Pipeline #10006 passed with stage
in 33 seconds
......@@ -11,7 +11,7 @@ exec 9>"${lock}"
flock -n 9 || exit
rsync_cmd() {
local -a cmd=(rsync -rlptH --safe-links --delete-delay --delay-updates
local -a cmd=(rsync -rlptH --safe-links --delete-delay
"--timeout=600" "--contimeout=60" --no-motd)
if stty &>/dev/null; then
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment