Fixes: bd19c007 ("Add configuration to retain prometheus data for 1 year")

If the cost exceeds $0, it indicates that we have run out of credit
and/or are doing something wrong, in either case we want to be alerted.

The project now has a centralized landing page hosted in the root
directory which we can observe instead of the docs for one specific
crate.

Related to signstar#124
Related to signstar!131



Signed-off-by: Christian Heusel <christian@heusel.eu>

The project now has a centralized landing page hosted in the root
directory which we can observe instead of the docs for one specific
crate.

Related to archlinux/alpm/alpm#76
Related to archlinux/alpm/alpm!57



Signed-off-by: Christian Heusel <christian@heusel.eu>

Requested by dvzrv[1] and implemented in this MR[2].

[1]: signstar#91
[2]: signstar!125



Signed-off-by: Christian Heusel <christian@heusel.eu>

As per my announcement to arch-devops[1] and staff, this adds a Mumble
server for Arch Linux.

The password for the special root user SuperAdmin is automatically
generated on first launch and printed to the logs. I went ahead and
added it to the vault. It should not usually be required to login as
SuperAdmin though as long as there are user admins around.

This uses certbot for local certificates.

[1] https://lists.archlinux.org/archives/list/arch-devops@lists.archlinux.org/thread/AHAOSTGFJTLQDSXLWFORDKGR6RDVHYEI/

Also regenerate the list of Prometheus Blackbox targets, adding:

- https://london.mirror.pkgbuild.com
- https://package-maintainer-bylaws.aur.archlinux.org

It failed to reboot during the last upgrade procedure. Upon logging into
the Equinix Metal console, we discovered that we lack access to all 4 of
the servers sponsored by Equinix Metal. They are under the CNCF account,
and it's not possible to transfer them to our organization.

Equinix Metal is being sunset, and the remaining 3 servers will also go
away on June 30th 2026. We can keep them until then, or until they fail
to boot like seoul.mirror.pkgbuild.com.

alpm-buildinfo and alpm-types have been consolidated into the alpm
project[1], for which GitLab Pages was recently configured[2][3].

Requested by @dvzrv.

[1] https://gitlab.archlinux.org/archlinux/alpm/alpm
[2] archlinux/alpm/alpm#32
[3] 3d54b56c ("Add GitLab Pages for alpm")

Requested by Orhun[1].

[1] archlinux/alpm/alpm!9

Check the HTTPS DNS records of the following Geo domains:

- geo.mirror.pkgbuild.com
- riscv.mirror.pkgbuild.com

Ensure they return: "1 . alpn=h2,h3 ipv4hint=... ipv6hint=..."

Ref #606

We do not usually expose metrics publicly and there is no good reason
for handling aurweb differently.

Fixes: 74757d6b ("Scape aurweb metrics")

It seems to have broken with the release of filesystem 2021.12.07, which
incorporates this upstream change[1] in [2]. Please also see the
upstream issue[3].

I'm not sure why we used ansible_fqdn in the first place as
inventory_hostname should be preferred (as we define it ourselves).

[1] https://github.com/systemd/systemd/commit/ce266330fc3bd6767451ac3400336cd9acebe9c1
[2] archlinux/packaging/packages/filesystem@fc84245e
[3] https://github.com/systemd/systemd/issues/20358

[1] https://github.com/prometheus/prometheus/commit/8fdfa52976ebb0c0594962fe4dac7605373fa638

Archweb now exports Prometheus status via /metrics with request duration
information.

As we aren't the speediest at checking, this is fine.

Fixes: c55b448c ("Add GitLab Pages for pacman")

Fixes: 4e5550a8 ("Decommission bugs.archlinux.org and replace it with a static copy[1]")

This may be interesting for our mirror administrators and mirror owners.

I tried backfilling the data, but was unsuccessful, due to a bug[1]. We
may try again if/when the bug is fixed.

[1] https://github.com/prometheus/prometheus/issues/13747

I don't expect more GitHub Pages to be set up, so using a explict
resource instead of abstracting it, is fine I think.

[1] https://github.com/archlinux/archinstall/issues/2098

The HTTP code must be 2xx for probe_success to indicate that the probe
succeeded, if not an alert will be sent.

Fixes: 653f8011 ("Add GitLab Pages for alpm-types[1]")

[1] archlinux/alpm/alpm-types#36

It looks more professional and we can move it to a dedicated box if the
load increases.

Equinix's AMS1 DC is being shut down so we need to recreate this box.

For Geo variety, this one is created in Frankfurt instead of Amsterdam.

Ref #495

Equinix's AMS1 DC is being shut down so we need to recreate this box.

Ref #495

This alert only triggers for america.mirror.pkgbuild.com. Ideally, we
should be able to increase the trigger point for high-bandwidth boxes.
I don't see a straightforward way to implement it, so disable for now.

Ref: archlinux/rfcs!15

No reason this should be 0600 as it doesn't contain any sensitive data;
switch it back to the package's default permissions of 0644.

From [1]: "By default, the new Quarkus distribution removes /auth from
           the context-path."

[1] https://www.keycloak.org/migration/migrating-to-quarkus

Signed-off-by: Leonidas Spyropoulos <artafinde@archlinux.org>
Co-authored-by: Kristian Klausen <kristian@klausen.dk>
Co-authored-by: moson-mo <mo-son@mailbox.org>

WireGuard was setup to provide a internal network with confidentiality,
authenticity and integrity[1]. This migrate the remaining Prometheus
exporters to use the internal WireGuard network.

[1] 664deb67 ("WireGuard all hosts")

Fix #384

Going to be served by all our Geo boxes under riscv.mirror.pkgbuild.com.

Fixes: 26f289b7 ("Capitalize the first letter of all task names")

ansible-lint 6.5.0 complains about:

  name: All names should start with an
        uppercase letter. (name[casing])

Ref: monthly-reports!1

Ref: repod!65

We want non-DevOps to be able to deploy project documentation (ex:
repod) with GitLab Pages and a separate domain was considered the only
sensible solution due to security issues[1].

[1] https://github.blog/2013-04-09-yummy-cookies-across-domains/

roles/prometheus/defaults/main.yml used to include a comment with the
commands used to generate a list of HTTPS endpoints to check. Move it
into a proper script and fix it to generate the correct current list.