Skip to content
Snippets Groups Projects
Verified Commit 8691ab73 authored by Jelle van der Waa's avatar Jelle van der Waa :construction:
Browse files

Disallow scraping the search results on the AUR

As the queries for searching are the most 'heavy' queries we can
disallow bots to scrape through all search results. Archweb uses the
same robots.txt rules for disallowing indexing search results.
parent 1b6fad6a
No related branches found
Tags 4.0.0-1
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment