Skip to content
Snippets Groups Projects

Move the repos and associated services to its own server

We want to have the repos and the archive on different servers, to
ensure separation of concerns.

The I/O on gemini is also very sluggish, which is likely related to the
archive design (millions of files on spinning rust), and this has
resulted in rsync deleting the package database files due to a race
condtion[1][2]. The does not solve the race condition, but it should
make it less likely.

We also need to rethink the archive design, but for now we are just
isolating the problem.

There is some "brokenness" related to the archive no longer being on the
same server as the repos, which will be fixed in subsequent commits.

[1] https://lore.kernel.org/linux-btrfs/00ed09b9-d60c-4605-b3b6-f4e79bf92fca@foutras.com/
[2] https://lore.kernel.org/linux-btrfs/ZP8AWKMVYOY0mAwq@debian0.Home/

Relates to #531

See the other commits for more details.

Edited by Kristian Klausen

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • added 5 commits

    • 23043665...971bc190 - 2 commits from branch archlinux:master
    • 11b7869e - dbscripts: Fix wrong order of dependent tasks
    • e246e391 - dbscripts: Add foxboron's PGP key
    • 0698d21e - wip: Move the repos and associated services

    Compare with previous version

  • Kristian Klausen resolved all threads

    resolved all threads

  • added 1 commit

    • f7d589e5 - fixup! wip: Move the repos and associated services

    Compare with previous version

  • Christian Heusel
  • Kristian Klausen resolved all threads

    resolved all threads

  • Kristian Klausen added 14 commits

    added 14 commits

    • f7d589e5...d324d5c9 - 8 commits from branch archlinux:master
    • 97d095a3 - dbscripts: Fix wrong order of dependent tasks
    • 4c8797c9 - dbscripts: Add foxboron's PGP key
    • 26d3efd5 - wip: Move the repos and associated services
    • 5c22d880 - fixup! wip: Move the repos and associated services
    • d262d28f - wip: repos-archive-puller.{service,timer}
    • 0ed52e84 - dbscripts: archive-cleanup

    Compare with previous version

  • added 2 commits

    Compare with previous version

  • Kristian Klausen
  • I have now also deployed the mirrorsync changes to asia.mirror.pkgbuild.com in order to fix the archive mirroring failure.

  • I have also manually disabled the two leftover services archweb-mirrorresolv.service and archweb-mirrorcheck.service aswell as their timers.

  • mentioned in merge request dbscripts!56 (merged)

  • Kristian Klausen added 17 commits

    added 17 commits

    • 75227960...a56d17e4 - 10 commits from branch archlinux:master
    • 793e8768 - dbscripts: Fix wrong order of dependent tasks
    • 68c5a8d1 - dbscripts: Add foxboron's PGP key
    • 67f17340 - wip: Move the repos and associated services
    • 1ae1f0c4 - fixup! wip: Move the repos and associated services
    • 30d4847d - wip: repos-archive-puller.{service,timer}
    • 55557906 - dbscripts: archive-cleanup
    • 0a8f6b00 - fix archive mirroring

    Compare with previous version

  • Christian Heusel requested review from @gromit

    requested review from @gromit

  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Please register or sign in to reply
    Loading