Update robots.txt

This commit is contained in:
Ivan Blinkov 2020-01-31 20:45:06 +03:00 committed by GitHub
parent d43d84e71d
commit 23dedcbfa9
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -12,6 +12,7 @@ Disallow: /docs/ru/search.html
Disallow: /docs/ja/search.html
Disallow: /docs/zh/search.html
Disallow: /docs/fa/search.html
Disallow: /cdn-cgi/
Allow: /
Host: https://clickhouse.tech
Sitemap: https://clickhouse.tech/docs/sitemap.xml