It has three panels showing "Cache hit ratio", "HTTP version" and "TLS
version".

The metrics are generated with Loki recording rules (see the previous
three commits).

This may be interesting for our mirror administrators and mirror owners.

I tried backfilling the data, but was unsuccessful, due to a bug[1]. We
may try again if/when the bug is fixed.

[1] https://github.com/prometheus/prometheus/issues/13747

As announced[2][3] the bugtracker has been migrated to gitlab, so
bugs.a.o can be decommissioned and replaced with a static copy[1](to
avoid link rot).

[1] https://gitlab.archlinux.org/archlinux/bugs-archive/
[2] https://archlinux.org/news/bugtracker-migration-to-gitlab-completed/
[3] https://lists.archlinux.org/hyperkitty/list/arch-dev-public@lists.archlinux.org/thread/WYXDTJ3TR2DWRQCDZK44BQDH67IDVGTS/

Fix #550
Fix #551

Grafana complains otherwise:

logger=provisioning.dashboard type=file name=default
t=2023-12-23T21:25:35.96456815Z level=error msg="failed to save dashboard"
file=/var/lib/grafana/dashboards/dashboards/archive.json
error="Unique identifier needed to be able to get a dashboard"

The archive is too chonky to fit in 10T so the storage box is now 20T.

The expression "2^40 * ceil(hetzner_storage_box_size_bytes / 2^40)" is
used to round up hetzner_storage_box_size_bytes to the next TB because
when we do "df" on the storage box, the total blocks exclude snapshots.

Add timeseries visualizations for number of requests by status and type.

Convert "graph" vis. types to "timeseries" for Users and Packages.
("graph" is deprecated)

Signed-off-by: moson <moson@archlinux.org>

Rename "search_requests_total" to "aur_search_requests_total"

Related MR: aurweb!743

Signed-off-by: moson <moson@archlinux.org>

* Remove API Requests panel (no values; replaced by goaurrpc dashboard)
* Add panel to visualize new metrics for search requests
* Set default timespan to 1 day (from 30d)

Ref: aurweb@814ccf6b
Signed-off-by: moson <moson@archlinux.org>

Signed-off-by: Leonidas Spyropoulos <artafinde@archlinux.org>

Add panel to visualize how many requests end up being rate-limited

Signed-off-by: moson-mo <mo-son@mailbox.org>

Seems with keycloak-metrics-spi 3.0.0 all metric names end in _total.

Copy the latest dashboard from upstream, fixing the graphs.

Mario Oenning authored 2 years ago and Mario Oenning committed 2 years ago

* Show totals for the last 24 hours (instead of all time)
* Add total search requests pie chart

Signed-off-by: moson-mo <mo-son@mailbox.org>

Symlinking home.json to archive.json causes a duplicate, as both
dashboards have the same uid, and Grafana won't keep the dashboards
updated when there are duplicates[1]. Instead just change
default_home_dashboard_path to point to the archive.json dashboard.

[1] "dashboards provisioning provider has no database write permissions
     because of duplicates"

Signed-off-by: Leonidas Spyropoulos <artafinde@archlinux.org>
Co-authored-by: Kristian Klausen <kristian@klausen.dk>
Co-authored-by: moson-mo <mo-son@mailbox.org>

http_requests_total  contains requests from debuginfo.al.org host
as well as from aur.al.org so filter them on job 'aurweb'

Signed-off-by: Leonidas Spyropoulos <artafinde@archlinux.org>

Fixes these display counters which were tied to aur.archlinux.org:

- Uptime
- RootFS Total
- RAM Total
- SWAP Total

Also add a decimal point to the latter two fields.

No changes made to it; this is to reduce noise in future modifications.

Kristian Klausen authored 3 years ago and Jelle van der Waa committed 3 years ago

https://github.com/jenkins-x-charts/grafana-dashboard/pull/5
Kristian Klausen (2):
      loki: Use rate() for both loki_distributor_ingester_{appends,failure}_total
      loki: Fix panel title not starting with a capital letter

It has been on dashboards.archlinux.org for a few weeks.

Change storage box size from 10000 to 10240 GiB.

Increase default time range from 90 days to 6 months.

This partially reverts commit c3d00264.

The smartd changes are not ready to land yet and were included in the
above commit by accident.

phrik has a polkit rule for demize to restart phrik

Leonidas Spyropoulos authored 3 years ago and Kristian Klausen committed 3 years ago

The dashboards is from [1] and fixed with:
sed 's/${DS_PROMETHEUS}/$datasource/g' -i synapse.json

[1] https://github.com/matrix-org/synapse/tree/c167e09fe58d3a256fb1c763b391ad6633d2507d/contrib/grafana



Closes: #290

Signed-off-by: Leonidas Spyropoulos <artafinde@gmail.com>

Mark "Free Space (Hetzner)" metric as instant for faster updates.

As it turns out, the total size does not include the snapshots (feature
which we recently enabled). Record the free space so we can have a more
accurate picture of the usable space remaining.

Now that we have enabled snapshots, summing all Borg repository sizes
has become a bad approximation of the total space used on the storage
box.

Currently only tracks repo sizes and total backup space used (as a sum
of the former, not the real exact space used on each storage location).

Allow multiple suites to be selected as variables and respect those in
the percentage and status queries.

From [1] with the jenkins-x tag removed.

[1] https://github.com/jenkins-x-charts/grafana-dashboard/blob/451e05780b06dc59f8d689c0b64dada315380740/charts/grafana-dashboard/dashboards/loki.json