# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / # Pull-request previews. Every page in one is already noindex; this keeps # them from being fetched at all. Unprefixed: a preview mounts the whole # site, locales included, at the origin root as /pr-42/ — so this rule sits # above the locale segment rather than inside one. Disallow: /pr- # Component and layout demos: real URLs, no reader-facing content. Disallow: /en/demo Disallow: /ja/demo # Pagefind's index shards — binary fragments, not documents. One index per # locale, so one rule per locale. Disallow: /en/pagefind/ Disallow: /ja/pagefind/ Sitemap: https://libtmux.org/en/sitemap-index.xml Sitemap: https://libtmux.org/ja/sitemap-index.xml