# Pylon — robots.txt # # Funnel pages (/signup/email/ through /signup/finalize/) carry # directly on each page. We # intentionally do NOT Disallow them here so crawlers can see + honor # that meta tag — Disallow-in-robots prevents the crawler from reading # the meta tag at all, which is strictly worse than letting them read # and respect the noindex. # # We Disallow only the truly non-public surfaces: admin / 2FA / webhook # receivers / management URLs — places crawlers should never touch. User-agent: * Allow: / Disallow: /internal/ Disallow: /admin/ Disallow: /admin-2fa/ Disallow: /webhooks/ # Sitemap — all of Pylon's pages, including the blog index at /blog/ and # every published blog post, live in this one sitemap. Sitemap: https://yourpylon.com/sitemap.xml