Kremta-Website/public/robots.txt

7 lines
93 B
Plaintext

User-agent: *
Allow: /
Disallow: /api/*
Sitemap: https://www.janedoe.com/sitemap-index.xml