Gazelle/robots.txt
2012-09-08 08:00:27 +00:00

11 lines
176 B
Plaintext

User-agent: *
Allow: /index.php
Allow: /login.php
Allow: /register.php
#<skip>
Allow: /what-network/
Allow: /gazelle/
Sitemap: https://what.cd/sitemap.xml
#</skip>
Disallow: /