Skip to content

syncarchive: Drop --delay-updates; breaks incremental scan

Evangelos Foutras requested to merge syncarchive-drop-delay-updates-option into master

The --delay-updates option results in 6G memory usage per archive mirror for a total of ~18G memory used on gemini when all three archive mirrors are syncing. Less important (but still revelant!) is the memory usage on each mirror, which climbs to about 11G during each synchronization.

Removing the --delay-updates option should be OK considering the archive hosts data that almost never changes. Without this option, rsync is able to do a sequential scan which uses 90M of memory (per archive mirror) on gemini and about 250M on each mirror individually.

Edited by Evangelos Foutras

Merge request reports