Add archweb robots.txt to our Git repo
The current robots.txt was migrated from apollo without adding it to Git.
Due to an influx of spam, we have had to temporarily disable account registrations. Please write an email to accountsupport@archlinux.org, with your desired username, if you want to get access. Sorry for the inconvenience.
The current robots.txt was migrated from apollo without adding it to Git.