# Nothing is disallowed here on purpose. /get is kept out of the index with # X-Robots-Tag: noindex (see netlify.toml), not with a Disallow: a Disallow # would stop crawlers from ever fetching the page and reading that noindex, # while the URL could still be indexed from an inbound link. User-agent: * Allow: / Sitemap: https://welmi.ai/sitemap.xml