Disallow versioned docs in robots.txt

This commit is contained in:
Ivan Blinkov 2019-04-17 15:23:14 +03:00 committed by GitHub
parent f566182582
commit 6c8f8f80c7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -3,6 +3,9 @@ Disallow: /docs/en/single/
Disallow: /docs/ru/single/
Disallow: /docs/zh/single/
Disallow: /docs/fa/single/
Disallow: /docs/v1*
Disallow: /docs/v2*
Disallow: /docs/v3*
Disallow: /docs/en/search.html
Disallow: /docs/ru/search.html
Disallow: /docs/fa/search.html