Update robots.txt

This commit is contained in:
Ivan Blinkov 2021-09-21 17:07:19 +03:00 committed by GitHub
parent d0721b87ab
commit 9ecf9e5ba0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -1,5 +1,5 @@
User-agent: *
Disallow: /cdn-cgi/
Allow: /
Host: https://clickhouse.tech
Sitemap: https://clickhouse.tech/sitemap-index.xml
Host: https://clickhouse.com
Sitemap: https://clickhouse.com/sitemap-index.xml