User-agent: * Allow: / Disallow: /api/check Disallow: /api/dns Disallow: /api/investigate Disallow: /health Sitemap: https://webupcheck.com/sitemap.xml