ClickHouse/website/robots.txt
2020-05-21 22:34:50 +03:00

16 lines
373 B
Plaintext

User-agent: *
Disallow: /docs/en/single/
Disallow: /docs/zh/single/
Disallow: /docs/es/single/
Disallow: /docs/fr/single/
Disallow: /docs/ru/single/
Disallow: /docs/ja/single/
Disallow: /docs/fa/single/
Disallow: /docs/v1*
Disallow: /docs/v2*
Disallow: /docs/v3*
Disallow: /cdn-cgi/
Allow: /
Host: https://clickhouse.tech
Sitemap: https://clickhouse.tech/sitemap-index.xml