Move the repos and associated services to its own server
We want to have the repos and the archive on different servers, to
ensure separation of concerns.
The I/O on gemini is also very sluggish, which is likely related to the
archive design (millions of files on spinning rust), and this has
resulted in rsync deleting the package database files due to a race
condtion[1][2]. The does not solve the race condition, but it should
make it less likely.
We also need to rethink the archive design, but for now we are just
isolating the problem.
There is some "brokenness" related to the archive no longer being on the
same server as the repos, which will be fixed in subsequent commits.
[1] https://lore.kernel.org/linux-btrfs/00ed09b9-d60c-4605-b3b6-f4e79bf92fca@foutras.com/
[2] https://lore.kernel.org/linux-btrfs/ZP8AWKMVYOY0mAwq@debian0.Home/
Relates to #531
See the other commits for more details.
Edited by Kristian Klausen
Merge request reports
Activity
added 9 commits
- 55148802 - dbscripts: fix wrong order
- bb09fd66 - dbscripts: we can't forget Morten
- ae9a9ca4 - DNS stuff
- 66deaf40 - dbscripts: add archive user
- 5d553694 - prometheus_exporters: fix
- 29df0e2f - archweb: make location optional
- aa60be6e - Remove repo_archive_split_temp
- e3d98b97 - remove stuff
- 532d834f - playbooks fixup
Toggle commit list- Resolved by Kristian Klausen
added 5 commits
-
23043665...971bc190 - 2 commits from branch
archlinux:master
- 11b7869e - dbscripts: Fix wrong order of dependent tasks
- e246e391 - dbscripts: Add foxboron's PGP key
- 0698d21e - wip: Move the repos and associated services
Toggle commit list-
23043665...971bc190 - 2 commits from branch
added 1 commit
- f7d589e5 - fixup! wip: Move the repos and associated services
- Resolved by Kristian Klausen
The last fixup commit (f7d589e5) has not yet been deployed.
- Resolved by Kristian Klausen
added 14 commits
-
f7d589e5...d324d5c9 - 8 commits from branch
archlinux:master
- 97d095a3 - dbscripts: Fix wrong order of dependent tasks
- 4c8797c9 - dbscripts: Add foxboron's PGP key
- 26d3efd5 - wip: Move the repos and associated services
- 5c22d880 - fixup! wip: Move the repos and associated services
- d262d28f - wip: repos-archive-puller.{service,timer}
- 0ed52e84 - dbscripts: archive-cleanup
Toggle commit list-
f7d589e5...d324d5c9 - 8 commits from branch
added 2 commits
- Resolved by Christian Heusel
mentioned in merge request dbscripts!56 (merged)
added 17 commits
-
75227960...a56d17e4 - 10 commits from branch
archlinux:master
- 793e8768 - dbscripts: Fix wrong order of dependent tasks
- 68c5a8d1 - dbscripts: Add foxboron's PGP key
- 67f17340 - wip: Move the repos and associated services
- 1ae1f0c4 - fixup! wip: Move the repos and associated services
- 30d4847d - wip: repos-archive-puller.{service,timer}
- 55557906 - dbscripts: archive-cleanup
- 0a8f6b00 - fix archive mirroring
Toggle commit list-
75227960...a56d17e4 - 10 commits from branch
requested review from @gromit
assigned to @klausenbusk
Please register or sign in to reply