robots.txt 149 Bytes
Newer Older
Thorben Günther's avatar
Thorben Günther committed
1
2
3
4
5
6
User-agent: *
Disallow: /packages/search/
Disallow: /packages/?
Disallow: /packages/?*
Sitemap: https://www.archlinux.org/sitemap.xml
Crawl-delay: 2