# Robots.txt for cutx.me User-agent: * Disallow: /user Disallow: /admin Disallow: /stats # Allow main pages and public short links Allow: / # Important: Don't block short URLs like /xyz123 # Ensure no wildcard rules block /abc123-type links # Sitemap location for better crawling Sitemap: https://cutx.me/sitemap.xml