catcrafts.net/robots.txt

9 lines
287 B
Text
Raw Normal View History

2025-11-12 22:53:37 +01:00
User-agent: *
Allow: /
2026-08-05 04:18:37 +02:00
# The landing page for a submitted reservation. It also carries
# X-Robots-Tag: noindex — this is the belt to that braces, since a crawler that
# never fetches the URL cannot index it by accident.
Disallow: /reserved
Sitemap: https://catcrafts.net/sitemap.xml