Commit Graph

4149 Commits

Author SHA1 Message Date
Azat Khuzhin
bf17c819c3 docker: fix path to clang builtin headers for woboq code browser
By default woboq uses $version.$minor.$patch, while clang simply uses
$version:

    CMake Error at generator/CMakeLists.txt:77 (message):
      Could not find any clang builtins headers in
      /usr/lib/llvm-16/lib/clang/16.0.4/include

    # ls -d /usr/lib/llvm-16/lib/clang/16/include
    /usr/lib/llvm-16/lib/clang/16/include

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:31:55 +02:00
Azat Khuzhin
08b8b7e587 docker: remove symlink for libclang (not required anymore)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:30:02 +02:00
Azat Khuzhin
82536fedde docker: install libclang-16-dev for woboq code browser
Otherwise you will get the following error:

    CMake Error at /usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake:792 (message):
      The imported target "clangBasic" references the file

         "/usr/lib/llvm-16/lib/libclangBasic.a"

      but this file does not exist.  Possible reasons include:

      * The file was deleted, renamed, or moved to another location.

      * An install or uninstall procedure did not complete successfully.

      * The installation package was faulty and contained

         "/usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake"

      but not all the files it references.

    Call Stack (most recent call first):
      /usr/lib/llvm-16/lib/cmake/clang/ClangConfig.cmake:20 (include)
      generator/CMakeLists.txt:7 (Find_Package)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:25:50 +02:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
Azat Khuzhin
c525d13272 Enable back thread fuzzuer under TSan
Since initial issue got resolved [1].

  [1]: https://github.com/google/sanitizers/issues/1540

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-08 22:35:09 +02:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Alexey Milovidov
763c98bd70 Fix typo 2023-05-06 23:40:19 +02:00
Dmitry Novik
a3b3b78eb0 EXPECTED_TO_FAIL -> NOT_FAILED 2023-05-05 17:53:15 +00:00
Dmitry Novik
0baaaaba42 KNOWN_BROKEN -> BROKEN 2023-05-05 17:43:54 +00:00
Dmitry Novik
5422e3058f Use more specific test status 2023-05-05 16:19:01 +00:00
Dmitry Novik
b13e3abc4d Improve CI check for Analyzer 2023-05-05 15:17:16 +00:00
alesapin
08039024a2
Merge pull request #49492 from ClickHouse/add_server_jepsen_image
Fixes in server jepsen image
2023-05-04 12:02:27 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
2023-05-04 11:47:43 +02:00
alesapin
27f9384717 Followup 2023-05-03 23:33:19 +02:00
alesapin
c1d8fab2da Fxi 2023-05-03 21:05:19 +02:00
alesapin
6e8934f856 Improve image for local run 2023-05-03 14:40:18 +02:00
alesapin
fad187fa8a Add image for docker-server jepsen 2023-05-03 14:38:56 +02:00
robot-clickhouse
b7d641cebe Update version_date.tsv and changelogs after v23.4.2.11-stable 2023-05-02 16:39:28 +00:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Kseniia Sumarokova
d4aa96e262
Merge branch 'master' into better-local-object-storage 2023-04-28 21:05:05 +02:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage 2023-04-27 14:54:04 +02:00
robot-clickhouse
3448b112d8 Automatic style fix 2023-04-27 12:31:00 +00:00
Alexey Milovidov
8eae3ed3a5 Fix garbage #48719 2023-04-27 13:48:23 +02:00
robot-clickhouse
904461773d Update version_date.tsv and changelogs after v23.4.1.1943-stable 2023-04-26 23:50:52 +00:00
Kseniia Sumarokova
c4abe66d77
Update run.sh 2023-04-25 12:25:49 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
055a72d54f
Remove the comment to rebuild the docker image 2023-04-24 11:21:09 +02:00
kssenii
f38dfc9206 Update run.sh 2023-04-23 12:49:22 +02:00
kssenii
24b75329f0 Merge remote-tracking branch 'origin/better-local-object-storage' into better-local-object-storage 2023-04-23 12:41:22 +02:00
kssenii
d8023806a9 Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-23 12:39:34 +02:00
robot-clickhouse
9a3600bda5 Update version_date.tsv and changelogs after v23.3.2.37-lts 2023-04-22 15:54:55 +00:00
Kseniia Sumarokova
370aa60159
Update run.sh 2023-04-21 22:10:06 +02:00
robot-clickhouse
eda1379180 Automatic style fix 2023-04-21 19:04:36 +00:00
Dmitry Novik
5fef967872 Make error message better 2023-04-21 18:11:54 +00:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci 2023-04-21 15:43:16 +02:00
kssenii
e58c16318f Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-21 12:49:40 +02:00
kssenii
88f412ad23 Fix upgrade check, fix integration test 2023-04-21 12:44:08 +02:00
Mikhail f. Shiryaev
634cf010b9
Merge pull request #48935 from ClickHouse/fasttests-build-time
Add building stage to the fasttests report, respect existing status on rerun
2023-04-20 15:50:18 +02:00
Mikhail f. Shiryaev
c80d8081d2
Add building stage to the fasttests report 2023-04-19 13:35:28 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS 2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup 2023-04-19 09:44:53 +02:00
Dmitry Novik
308970da83 Add logging 2023-04-18 13:53:13 +00:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
6197d3d55f Pass volume only for analyzer 2023-04-18 00:12:30 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Dmitry Novik
3df33d74f5 Get rid of another docker image 2023-04-13 17:22:12 +02:00
kssenii
4bf01c611c Fix 2023-04-13 16:56:11 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
robot-clickhouse
fa7b72570b Automatic style fix 2023-04-12 17:09:37 +00:00
Dmitry Novik
360fc59694 Handle known broken tests 2023-04-12 16:46:30 +00:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
Azat Khuzhin
61bf70be12 Add second_deadlock_stack=1 for TSan on CI
To improve TSan reports.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:05:57 +02:00
kssenii
00282483c9 Address remaining review comments 2023-04-07 18:29:55 +02:00
kssenii
c40f17a276 One more attempt 2023-04-06 20:09:06 +02:00
kssenii
4a94074f71 Try fix java errors in CI 2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91 Remove redundant from dockerd-entrypoint.sh 2023-04-05 14:40:30 +02:00
kssenii
8915f49b7d Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-03 17:43:42 +02:00
robot-clickhouse
0c9d7f73ce Update version_date.tsv and changelogs after v23.3.1.2823-lts 2023-03-31 10:35:58 +00:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
Mikhail f. Shiryaev
1c58a911eb
Push clickhouse-keeper as both w/ and w/o suffix -alpine 2023-03-30 18:07:40 +02:00
Mikhail f. Shiryaev
7ff582b963
Deprecate ENABLE_CCACHE and replace it by COMPILER_CACHE 2023-03-29 23:33:31 +02:00
Mikhail f. Shiryaev
def5ae851e
Use CTCACHE_DIR only with ccache 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
f1b1f30764
Make --ccache-dir equal to --ccache_dir 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
6d8da8f88b
Add sccache and ctcache S3 parameters, don't use 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
df17a35410
Get rid of useless cache_maxsize parameter 2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
2d872ff23b
Add a function to parse arguments 2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
419f234294
Fix logic for --force-build-image 2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
3b1291eb0e
Replace distcc with sccache in packager 2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests 2023-03-29 23:33:24 +02:00
Mikhail f. Shiryaev
c994c41e74
Fix logging formatting 2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
648697f085
Add main function, use specific exception in packager 2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
cd5852f11a
Add typing and rewrite packager to pathlib.Path 2023-03-29 23:33:21 +02:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Raúl Marín
ff209db129
Merge branch 'master' into zk_inject_timeout 2023-03-27 19:46:10 +02:00
Raúl Marín
c47dcb0805 Enable ZK fault injection on new servers (but not during startup) 2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread
Fix terminate in parts check thread
2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix 2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX 2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe fix 2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 (#47858) 2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e apply black to all python scripts 2023-03-20 17:30:20 +00:00
Alexey Milovidov
0f7f620100 Update one more place 2023-03-19 01:07:11 +01:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad fix intersecting parts, better fault injections 2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881 ci/upgrade: remove obsolete function call
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7 ci/upgrade: fix creating system database with Ordinary engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:12:32 +01:00
robot-clickhouse
363989f3f8 Update version_date.tsv and changelogs after v23.2.4.12-stable 2023-03-10 17:56:29 +00:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper
Fix Keeper with `force_sync = false`
2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9 Use force_sync=true in upgrade check 2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880 suppress expected errors from test 01111 in Upgrade check 2023-03-08 15:27:43 +01:00
robot-clickhouse
e50fd6e1ef Update version_date.tsv and changelogs after v23.2.3.17-stable 2023-03-06 16:35:17 +00:00
Alexander Tokmakov
d34f00f437
Update run.sh 2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa Suppress "Cannot flush" for Distributed tables in upgrade check
CI reports [1]:

    2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
    2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Kruglov Pavel
4e0a4e56c9
Add upgrade check to stateful dependent field 2023-02-28 17:45:04 +01:00
avogar
cc02de69d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 19:49:33 +00:00
Julio Jimenez
76d0fb3cac
🐳 Update Ubuntu Image (#46784)
* 🐳 Update Ubuntu Image

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* Ready for testing

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

---------

Signed-off-by: Julio Jimenez <julio@clickhouse.com>
2023-02-27 14:43:16 -05:00
Pradeep Chhetri
af3b8d5cbd
Revert "Add join_algorithm='grace_hash' to stress tests" 2023-02-28 02:15:15 +08:00
Kruglov Pavel
261c3aa86d
Update 2023-02-27 16:42:29 +01:00
Alexey Milovidov
44f9688fa4
Merge pull request #45607 from chhetripradeep/pchhetri/add-grace-hash-stress
Add join_algorithm='grace_hash' to stress tests
2023-02-27 08:32:03 +03:00
Pradeep Chhetri
389803ca62
Merge branch 'master' into pchhetri/fix-query-in-stress 2023-02-27 11:27:16 +08:00
Pradeep Chhetri
c8dcea9539
Merge branch 'master' into pchhetri/add-grace-hash-stress 2023-02-27 11:26:48 +08:00
avogar
ff67fc4b06 Remove llvm-9 from dependencies 2023-02-24 16:59:27 +00:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
robot-clickhouse
f2e71bc3b7 Update version_date.tsv and changelogs after v23.2.1.2537-stable 2023-02-23 19:46:46 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests (#46641)
* Avoid OOM in perf tests

At some point perf tests started to fail for one setup on CI [1]:

    /home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed                  python3 performance_comparison_check.py "$CHECK_NAME"
    Error: Process completed with exit code 137.

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-23 14:05:18 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release
Get rid of legacy DocsReleaseChecks
2023-02-22 00:31:17 +03:00
Alexander Tokmakov
dcf8aeab8f
Update stress 2023-02-21 22:16:05 +03:00
Alexey Milovidov
bf5640a597
Merge pull request #46629 from ClickHouse/fix-coverity
Fix coverity
2023-02-21 21:04:20 +03:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Alexander Tokmakov
97e9df0148
Update stress 2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests (#41534)
* Update stress

* fix

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-02-21 15:36:23 +03:00
Alexey Milovidov
d0d6306102 Fix coverity 2023-02-21 00:46:27 +01:00
Alexander Tokmakov
669c4e94d5
Update compare.sh 2023-02-20 17:35:30 +03:00
Mikhail f. Shiryaev
c64c3e3854
Merge pull request #46535 from ClickHouse/autoupdate-keeper-dockerfile
Autoupdate keeper dockerfile
2023-02-18 11:21:29 +01:00
Mikhail f. Shiryaev
ecf33b9059
Update the VERSION for clickhouse-keeper Dockerfile 2023-02-17 18:39:43 +01:00
Azat Khuzhin
5a5f99a27e Add CPU flamegraphs for perf tests
In Real profiler there is too much noise (polling, cond vars, ...)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Alexander Gololobov
d0f402fa5b
Merge pull request #46391 from ClickHouse/debug-docker
Easy debugging of clickhouse-server in Docker
2023-02-16 14:09:43 +01:00
alesapin
d08b2753e4
Merge pull request #46367 from ClickHouse/reduce-keeper-build-time
Do not build libclickhouse-keeper-lib.a for standalone keeper
2023-02-16 13:56:27 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress"
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Alexey Milovidov
c2660646fe
Merge branch 'master' into debug-docker 2023-02-15 15:59:49 +03:00
Mikhail f. Shiryaev
08ffb8f93d
Install only "programs" directory during build 2023-02-15 11:49:19 +01:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Mikhail f. Shiryaev
6a968bad8e
Reduce building and compiling deb packages with ninja *install 2023-02-14 14:57:00 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses
Fix stress tests statuses
2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e fix stress tests statuses 2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh 2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh 2023-02-14 13:10:18 +01:00
Alexey Milovidov
183707be74 Fix the script 2023-02-14 12:05:38 +01:00
robot-ch-test-poll1
eb580426ab
Merge pull request #46362 from azat/tests/perf-create-errors-fix
Do not continue perf tests in case of exception in create_query/fill_query
2023-02-14 11:57:29 +01:00
Alexey Milovidov
bbcadd2311 Fix the script 2023-02-14 11:57:05 +01:00
robot-ch-test-poll3
f654174362
Merge pull request #46246 from ClickHouse/optimize-binary-builder
Optimize docker binary-builder
2023-02-14 10:06:15 +01:00
Alexey Milovidov
e1ae60e6d9
Merge pull request #46159 from ClickHouse/docker-server-readme
Fix clickhouse/clickhouse-server description to make it in sync
2023-02-14 12:05:48 +03:00