ClickHouse/docs/tools
Alexey 54b8491a95 single.md is removed before build
in case it is left after previous abnormal build
2021-11-06 09:54:19 +00:00
..
.gitignore
amp.py
blog.py Change copyright, step 2 2021-09-21 03:23:00 +03:00
build.py single.md is removed before build 2021-11-06 09:54:19 +00:00
cmake_in_clickhouse_generator.py Unlink before creating a link 2021-10-12 20:15:49 +00:00
deploy-to-test.sh .tech -> .com 2021-09-22 03:22:57 +03:00
easy_diff.py
easy_edit.sh
github.py
make_links.sh
mdx_clickhouse.py make_links.sh 2021-09-20 09:51:41 +03:00
nav.py
package-lock.json
package.json
README.md find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
redirects.py
release.sh Turn off logging in docs. release script just in case 2021-10-31 22:27:01 +03:00
requirements.txt [docs] fix build on Mac OS Big Sur 2021-09-30 11:04:15 +03:00
single_page.py single.md is removed before build 2021-11-06 09:54:19 +00:00
test.py Remove garbage from doc build 2021-09-22 02:58:11 +03:00
util.py
webpack.config.js Add greenhouse careers page 2021-10-12 16:19:07 -06:00
website.py Merge pull request #30077 from flickerbox/crb-careers-page 2021-10-13 05:26:37 +03:00

How ClickHouse documentation is generated?

ClickHouse documentation is built using build.py script that uses mkdocs library and its dependencies to separately build all version of documentations (all languages in either single and multi page mode) as static HTMLs and then a PDF for each single page version. The results are then put in the correct directory structure. It is recommended to use Python 3.7 to run this script.

release.sh also pulls static files needed for official ClickHouse website from ../../website folder then pushes to specified GitHub repo to be served via GitHub Pages.

How to check if the documentation will look fine?

There are few options that are all useful depending on how large or complex your edits are.

Use GitHub web interface to edit

GitHub has Markdown support with preview feature, but the details of GitHub Markdown dialect are a bit different in ClickHouse documentation.

Install Markdown editor or plugin for your IDE

Usually those also have some way to preview how Markdown will look like, which allows to catch basic errors like unclosed tags very early.

Use build.py

Itll take some effort to go through, but the result will be very close to production documentation.

For the first time youll need to:

1. Install wkhtmltopdf

Follow the instructions on it's official website: https://wkhtmltopdf.org/downloads.html

2. Install CLI tools from npm

  1. sudo apt-get install npm for Debian/Ubuntu or brew install npm on Mac OS X.
  2. sudo npm install -g purify-css amphtml-validator.

3. Set up virtualenv

$ cd ClickHouse/docs/tools
$ mkdir venv
$ virtualenv -p $(which python3) venv
$ source venv/bin/activate
$ pip3 install -r requirements.txt

4. Run build.py

When all prerequisites are installed, running build.py without args (there are some, check build.py --help) will generate ClickHouse/docs/build folder with complete static html website.

The easiest way to see the result is to use --livereload=8888 argument of build.py. Alternatively, you can manually launch a HTTP server to serve the docs, for example by running cd ClickHouse/docs/build && python3 -m http.server 8888. Then go to http://localhost:8888 in browser. Feel free to use any other port instead of 8888.

How to change code highlighting?

ClickHouse does not use mkdocs highlightjs feature. It uses modified pygments styles instead. If you want to change code highlighting, edit the website/css/highlight.css file. Currently, an eighties theme is used.

How to subscribe on documentation changes?

At the moment theres no easy way to do just that, but you can consider:

  • To hit the “Watch” button on top of GitHub web interface to know as early as possible, even during pull request. Alternative to this is #github-activity channel of public ClickHouse Slack.
  • Some search engines allow to subscribe on specific website changes via email and you can opt-in for that for https://clickhouse.com.