Split archive role into archive_web for archive-mirrors

See merge request archlinux/infrastructure!175

Jelle van der Waa authored 4 years ago and Jelle van der Waa committed 4 years ago

To simplify the archive role, split it up in the web serving part for
the archive-mirrors, gemini and keep the archive role for only the
archive operation. This simplifies the new role as only two lines are
required to setup the the archive mirror website.

Add ipv6 addresses to archive mirrors for sync whitelisting

See merge request archlinux/infrastructure!177

Add archive mirror DNS entries

See merge request archlinux/infrastructure!174

As we want to serve mirros and the archive add a new domain for the
archive so the mirror and archive can be hosted.

Remove old repro2 hostvars

See merge request archlinux/infrastructure!172

Create archlinux.org server

See merge request archlinux/infrastructure!165

Giancarlo Razzolini authored 4 years ago and Sven-Hendrik Haase committed 4 years ago

Lower the ttl of master-key, dev, packages and ipxe

Giancarlo Razzolini authored 4 years ago and Sven-Hendrik Haase committed 4 years ago

tf-stage1/archlinux.tf: Lower TTL for archlinux.org and www.archlinux.org and create a new server for archlinux.org

For the archweb migration, we need to lower the TTL and create a new archlinux.org server to host the site.

Seems we run at about 5GB of cache. Let postgres assume it gets 4GB.

Element uses a statically configured list of homeservers with disabled
presence. Without hosting our own Element this makes for pretty poor UI.

This reverts commit 82ac30f9.

Only changes to comments.

postgres: Set `jit = off` on matrix.archlinux.org

See merge request !169

Bump the mem settings higher again, now that we know they're not the
cause. Also increase the maximum connection count.

This seems to be the cause for our memory leak.

https://www.postgresql.org/message-id/flat/16707-f5df308978a55bf8%40postgresql.org

Mostly changes to comments.

Add Kape server IPv6 addresses (fixes #230)

Closes #230

See merge request archlinux/infrastructure!173

Restrict Grafana access to Arch Linux Staff group on Keycloak (fixes #151)

Closes #151

See merge request archlinux/infrastructure!171

Fix typo in docs/kape.md

See merge request archlinux/infrastructure!170

The hosts file contains repro2.pkgbuild.com in the `[kape_servers]`
group.

This process didn't need any source changes but it added the new Terraform lockfiles.

Still seeing PostgreSQL session processes eating over 600M of private
memory. What's going on?

Add Kape donated servers

See merge request archlinux/infrastructure!166

Setup Kape servers as archive mirrors (asia,europe,america), Gitlab
runner and Rebuilderd worker. All machines except runner1 are EFI
machines with grub setup and a EFI parition which is not supported by
our ansible install role and is manually rolled out.

Build artifcats are limited to 10MB per piece and we have
logs/diffoscope and json can become a little over 20M.

Allow the log size to be limited to 10 MiB so we don't hit max body size
limits when posting results.

Due to the massive backlog of packages, disable [testing] until
everything is back to being stable. Also disable long during failing to
build packags such as pytorch and kubernetes

rebuilderd requires an X-Real-IP to be set if configured.

Add rebuilderd_worker role for repro1.pkgbuild.com

See merge request archlinux/infrastructure!146

Jelle van der Waa authored 4 years ago and Jelle van der Waa committed 4 years ago

This allows rebuilderctl status to show the real ip of the
rebuilerd-worker.