ClickHouse/docs/en/development/build.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

155 lines
4.9 KiB
Markdown
Raw Normal View History

2020-04-03 13:23:32 +00:00
---
2022-08-28 14:53:34 +00:00
slug: /en/development/build
sidebar_position: 64
sidebar_label: Build on Linux
2022-08-28 15:58:59 +00:00
title: How to Build ClickHouse on Linux
description: How to build ClickHouse on Linux
2020-04-03 13:23:32 +00:00
---
2020-06-03 10:19:08 +00:00
Supported platforms:
- x86_64
- AArch64
2023-07-14 18:09:58 +00:00
- PowerPC 64 LE (experimental)
- RISC-V 64 (experimental)
## Building on Ubuntu
The following tutorial is based on Ubuntu Linux.
With appropriate changes, it should also work on any other Linux distribution.
The minimum recommended Ubuntu version for development is 22.04 LTS.
2023-02-08 17:59:44 +00:00
### Install Prerequisites {#install-prerequisites}
2020-03-20 10:10:48 +00:00
``` bash
sudo apt-get update
sudo apt-get install git cmake ccache python3 ninja-build nasm yasm gawk lsb-release wget software-properties-common gnupg
```
### Install and Use the Clang compiler
On Ubuntu/Debian, you can use LLVM's automatic installation script; see [here](https://apt.llvm.org/).
2022-09-08 05:41:24 +00:00
``` bash
2022-12-17 02:03:12 +00:00
sudo bash -c "$(wget -O - https://apt.llvm.org/llvm.sh)"
2022-09-08 05:41:24 +00:00
```
Note: in case of trouble, you can also use this:
2021-04-22 01:20:03 +00:00
```bash
2022-12-17 02:03:12 +00:00
sudo apt-get install software-properties-common
sudo add-apt-repository -y ppa:ubuntu-toolchain-r/test
```
For other Linux distributions - check the availability of LLVM's [prebuild packages](https://releases.llvm.org/download.html).
2024-03-04 02:52:47 +00:00
As of March 2024, clang-17 or higher will work.
2023-05-30 17:46:21 +00:00
GCC as a compiler is not supported.
To build with a specific Clang version:
2023-05-23 13:58:59 +00:00
:::tip
This is optional, if you are following along and just now installed Clang then check
to see what version you have installed before setting this environment variable.
:::
``` bash
2024-02-27 22:17:11 +00:00
export CC=clang-18
export CXX=clang++-18
```
2024-04-09 18:34:52 +00:00
### Install Rust compiler
2024-04-09 17:32:39 +00:00
2024-04-09 18:34:52 +00:00
First follow the steps in the official [rust documentation](https://www.rust-lang.org/tools/install) to install `rustup`.
2024-04-09 17:32:39 +00:00
2024-04-09 18:34:52 +00:00
As with C++ dependencies, ClickHouse uses vendoring to control exactly what's installed and avoid depending on third
party services (like the `crates.io` registry).
Although in release mode any rust modern rustup toolchain version should work with this dependencies, if you plan to
enable sanitizers you must use a version that matches the exact same `std` as the one used in CI (for which we vendor
the crates):
2024-04-09 17:32:39 +00:00
```bash
rustup toolchain install nightly-2024-04-01
rustup default nightly-2024-04-01
rustup component add rust-src
```
### Checkout ClickHouse Sources {#checkout-clickhouse-sources}
2020-03-20 10:10:48 +00:00
``` bash
git clone --recursive --shallow-submodules git@github.com:ClickHouse/ClickHouse.git
DOCAPI-8530: Code blocks markup fix (#7060) * Typo fix. * Links fix. * Fixed links in docs. * More fixes. * docs/en: cleaning some files * docs/en: cleaning data_types * docs/en: cleaning database_engines * docs/en: cleaning development * docs/en: cleaning getting_started * docs/en: cleaning interfaces * docs/en: cleaning operations * docs/en: cleaning query_lamguage * docs/en: cleaning en * docs/ru: cleaning data_types * docs/ru: cleaning index * docs/ru: cleaning database_engines * docs/ru: cleaning development * docs/ru: cleaning general * docs/ru: cleaning getting_started * docs/ru: cleaning interfaces * docs/ru: cleaning operations * docs/ru: cleaning query_language * docs: cleaning interfaces/http * Update docs/en/data_types/array.md decorated ``` Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/getting_started/example_datasets/nyc_taxi.md fixed typo Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/getting_started/example_datasets/ontime.md fixed typo Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/interfaces/formats.md fixed error Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/operations/table_engines/custom_partitioning_key.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/operations/utils/clickhouse-local.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/dicts/external_dicts_dict_sources.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/operations/utils/clickhouse-local.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/functions/json_functions.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/functions/json_functions.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/functions/other_functions.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/functions/other_functions.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/query_language/functions/date_time_functions.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * Update docs/en/operations/table_engines/jdbc.md Co-Authored-By: BayoNet <da-daos@yandex.ru> * docs: fixed error * docs: fixed error
2019-09-23 15:31:46 +00:00
```
2020-03-20 10:10:48 +00:00
or
2020-03-20 10:10:48 +00:00
``` bash
git clone --recursive --shallow-submodules https://github.com/ClickHouse/ClickHouse.git
```
### Build ClickHouse {#build-clickhouse}
2020-03-20 10:10:48 +00:00
``` bash
cd ClickHouse
mkdir build
cmake -S . -B build
cmake --build build # or: `cd build; ninja`
```
2023-08-08 13:36:10 +00:00
:::tip
In case `cmake` isn't able to detect the number of available logical cores, the build will be done by one thread. To overcome this, you can tweak `cmake` to use a specific number of threads with `-j` flag, for example, `cmake --build build -j 16`. Alternatively, you can generate build files with a specific number of jobs in advance to avoid always setting the flag: `cmake -DPARALLEL_COMPILE_JOBS=16 -S . -B build`, where `16` is the desired number of threads.
:::
To create an executable, run `cmake --build build --target clickhouse` (or: `cd build; ninja clickhouse`).
This will create an executable `build/programs/clickhouse`, which can be used with `client` or `server` arguments.
## Building on Any Linux {#how-to-build-clickhouse-on-any-linux}
2020-02-16 10:45:15 +00:00
The build requires the following components:
2020-02-16 10:45:15 +00:00
- Git (used to checkout the sources, not needed for the build)
- CMake 3.20 or newer
2024-02-27 22:17:11 +00:00
- Compiler: clang-18 or newer
- Linker: lld-17 or newer
- Ninja
- Yasm
- Gawk
2024-04-09 17:32:39 +00:00
- rustc
2020-02-16 10:45:15 +00:00
If all the components are installed, you may build it in the same way as the steps above.
2020-02-16 10:45:15 +00:00
Example for OpenSUSE Tumbleweed:
``` bash
2023-04-27 17:20:53 +00:00
sudo zypper install git cmake ninja clang-c++ python lld nasm yasm gawk
git clone --recursive https://github.com/ClickHouse/ClickHouse.git
mkdir build
cmake -S . -B build
cmake --build build
```
2020-02-16 10:45:15 +00:00
2020-02-17 04:37:37 +00:00
Example for Fedora Rawhide:
``` bash
sudo yum update
sudo yum --nogpg install git cmake make clang python3 ccache lld nasm yasm gawk
git clone --recursive https://github.com/ClickHouse/ClickHouse.git
mkdir build
cmake -S . -B build
cmake --build build
2022-02-19 16:19:07 +00:00
```
## Building in docker
We use the docker image `clickhouse/binary-builder` for our CI builds. It contains everything necessary to build the binary and packages. There is a script `docker/packager/packager` to ease the image usage:
```bash
# define a directory for the output artifacts
output_dir="build_results"
# a simplest build
./docker/packager/packager --package-type=binary --output-dir "$output_dir"
# build debian packages
./docker/packager/packager --package-type=deb --output-dir "$output_dir"
# by default, debian packages use thin LTO, so we can override it to speed up the build
CMAKE_FLAGS='-DENABLE_THINLTO=' ./docker/packager/packager --package-type=deb --output-dir "./$(git rev-parse --show-cdup)/build_results"
```