User-agent: * Allow: /blog/ Allow: /sitemap.xml Disallow: /download Disallow: /download/ Disallow: /task/ Disallow: /preview/ Disallow: /api/ Disallow: /admin/ Disallow: /healthz Disallow: /temp/ Disallow: /docs Disallow: /redoc Disallow: /openapi.json Disallow: /debug # Russian search engines support Crawl-delay; Google ignores it. User-agent: YandexBot Allow: /blog/ Allow: /sitemap.xml Disallow: /download Disallow: /download/ Disallow: /task/ Disallow: /preview/ Disallow: /api/ Disallow: /admin/ Disallow: /healthz Disallow: /temp/ Disallow: /docs Disallow: /redoc Disallow: /openapi.json Disallow: /debug Crawl-delay: 1 User-agent: Googlebot Allow: /blog/ Allow: /sitemap.xml Disallow: /download Disallow: /download/ Disallow: /task/ Disallow: /preview/ Disallow: /api/ Disallow: /admin/ Disallow: /healthz Disallow: /temp/ Disallow: /docs Disallow: /redoc Disallow: /openapi.json Disallow: /debug # Sitemap location is converted to an absolute URL by the FastAPI route. Sitemap: https://mpimg.ru/sitemap.xml