grafana.md

Grafana

Our Grafana is hosted on https://monitoring.archlinux.org and is accessible only to DevOps Staff.

A public accessible instance is hosted on https://dashboards.archlinux.org with selected metrics using prometheus "remote write" feature.

Dashboards and datasources are automatically provisioned by Grafana with Grafana's built-in provisioning configuration.

Adding a new Dashboard

A new dashboard can be configured in our Grafana instance to try it out and if satisfactory checked in to Git as following:

• Export the dashboard to json (top left, share dashboard => exporter => save to file).
• Save the json file in `roles/grafana/files/dashboards'
• Git add the file and run the grafana playbook
• If it needs to be available in dashboards.archlinux.org create a symlink in roles/grafana/files/public-dashboards to the dashboard in roles/grafana/files/dashboards

Adding new metrics to dashboards.archlinux.org

Metrics can be added to the public grafana instance if they are already collected on monitoring.archlinux.org

• Verify that the metrics are allowed to be made public and check with another DevOps member.
• Edit roles/prometheus/templates/prometheus.yml.j2 and extending the regex of the remote_write block.
• Run ansible-playbook playboks/monitoring.archlinux.org -t prometheus to update the remote_write configuration.