Commit Graph

4009 Commits

Author SHA1 Message Date
Raúl Marín
c47dcb0805 Enable ZK fault injection on new servers (but not during startup) 2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread
Fix terminate in parts check thread
2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix 2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX 2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe fix 2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 (#47858) 2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e apply black to all python scripts 2023-03-20 17:30:20 +00:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad fix intersecting parts, better fault injections 2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881 ci/upgrade: remove obsolete function call
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7 ci/upgrade: fix creating system database with Ordinary engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:12:32 +01:00
robot-clickhouse
363989f3f8 Update version_date.tsv and changelogs after v23.2.4.12-stable 2023-03-10 17:56:29 +00:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper
Fix Keeper with `force_sync = false`
2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9 Use force_sync=true in upgrade check 2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880 suppress expected errors from test 01111 in Upgrade check 2023-03-08 15:27:43 +01:00
robot-clickhouse
e50fd6e1ef Update version_date.tsv and changelogs after v23.2.3.17-stable 2023-03-06 16:35:17 +00:00
Alexander Tokmakov
d34f00f437
Update run.sh 2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa Suppress "Cannot flush" for Distributed tables in upgrade check
CI reports [1]:

    2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
    2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Kruglov Pavel
4e0a4e56c9
Add upgrade check to stateful dependent field 2023-02-28 17:45:04 +01:00
avogar
cc02de69d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 19:49:33 +00:00
Julio Jimenez
76d0fb3cac
🐳 Update Ubuntu Image (#46784)
* 🐳 Update Ubuntu Image

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* Ready for testing

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

---------

Signed-off-by: Julio Jimenez <julio@clickhouse.com>
2023-02-27 14:43:16 -05:00
Pradeep Chhetri
af3b8d5cbd
Revert "Add join_algorithm='grace_hash' to stress tests" 2023-02-28 02:15:15 +08:00
Kruglov Pavel
261c3aa86d
Update 2023-02-27 16:42:29 +01:00
Alexey Milovidov
44f9688fa4
Merge pull request #45607 from chhetripradeep/pchhetri/add-grace-hash-stress
Add join_algorithm='grace_hash' to stress tests
2023-02-27 08:32:03 +03:00
Pradeep Chhetri
389803ca62
Merge branch 'master' into pchhetri/fix-query-in-stress 2023-02-27 11:27:16 +08:00
Pradeep Chhetri
c8dcea9539
Merge branch 'master' into pchhetri/add-grace-hash-stress 2023-02-27 11:26:48 +08:00
avogar
ff67fc4b06 Remove llvm-9 from dependencies 2023-02-24 16:59:27 +00:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
robot-clickhouse
f2e71bc3b7 Update version_date.tsv and changelogs after v23.2.1.2537-stable 2023-02-23 19:46:46 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests (#46641)
* Avoid OOM in perf tests

At some point perf tests started to fail for one setup on CI [1]:

    /home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed                  python3 performance_comparison_check.py "$CHECK_NAME"
    Error: Process completed with exit code 137.

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-23 14:05:18 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release
Get rid of legacy DocsReleaseChecks
2023-02-22 00:31:17 +03:00
Alexander Tokmakov
dcf8aeab8f
Update stress 2023-02-21 22:16:05 +03:00
Alexey Milovidov
bf5640a597
Merge pull request #46629 from ClickHouse/fix-coverity
Fix coverity
2023-02-21 21:04:20 +03:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Alexander Tokmakov
97e9df0148
Update stress 2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests (#41534)
* Update stress

* fix

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-02-21 15:36:23 +03:00
Alexey Milovidov
d0d6306102 Fix coverity 2023-02-21 00:46:27 +01:00
Alexander Tokmakov
669c4e94d5
Update compare.sh 2023-02-20 17:35:30 +03:00
Mikhail f. Shiryaev
c64c3e3854
Merge pull request #46535 from ClickHouse/autoupdate-keeper-dockerfile
Autoupdate keeper dockerfile
2023-02-18 11:21:29 +01:00
Mikhail f. Shiryaev
ecf33b9059
Update the VERSION for clickhouse-keeper Dockerfile 2023-02-17 18:39:43 +01:00
Azat Khuzhin
5a5f99a27e Add CPU flamegraphs for perf tests
In Real profiler there is too much noise (polling, cond vars, ...)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Alexander Gololobov
d0f402fa5b
Merge pull request #46391 from ClickHouse/debug-docker
Easy debugging of clickhouse-server in Docker
2023-02-16 14:09:43 +01:00
alesapin
d08b2753e4
Merge pull request #46367 from ClickHouse/reduce-keeper-build-time
Do not build libclickhouse-keeper-lib.a for standalone keeper
2023-02-16 13:56:27 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress"
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Alexey Milovidov
c2660646fe
Merge branch 'master' into debug-docker 2023-02-15 15:59:49 +03:00
Mikhail f. Shiryaev
08ffb8f93d
Install only "programs" directory during build 2023-02-15 11:49:19 +01:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Mikhail f. Shiryaev
6a968bad8e
Reduce building and compiling deb packages with ninja *install 2023-02-14 14:57:00 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses
Fix stress tests statuses
2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e fix stress tests statuses 2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh 2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh 2023-02-14 13:10:18 +01:00
Alexey Milovidov
183707be74 Fix the script 2023-02-14 12:05:38 +01:00
robot-ch-test-poll1
eb580426ab
Merge pull request #46362 from azat/tests/perf-create-errors-fix
Do not continue perf tests in case of exception in create_query/fill_query
2023-02-14 11:57:29 +01:00
Alexey Milovidov
bbcadd2311 Fix the script 2023-02-14 11:57:05 +01:00
robot-ch-test-poll3
f654174362
Merge pull request #46246 from ClickHouse/optimize-binary-builder
Optimize docker binary-builder
2023-02-14 10:06:15 +01:00
Alexey Milovidov
e1ae60e6d9
Merge pull request #46159 from ClickHouse/docker-server-readme
Fix clickhouse/clickhouse-server description to make it in sync
2023-02-14 12:05:48 +03:00
Alexey Milovidov
dd79c5f4f6 Easy debugging of clickhouse-server in Docker 2023-02-14 09:49:05 +01:00
Azat Khuzhin
dc5d7809b6 Do not continue perf tests in case of exception in create_query/fill_query
Previously due to using of threading.Thread, exception had been
ignored, and perf test simply continues, yes it will show some errors,
but it also may show that the test became faster, while it is because
the underlying table was empty.

Replace threading.Thread with a SafeThread (inline implementation) that
simply rethrow exception in join.

Here is an example of such report [1], look at the ip_trie test.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/2101b66570cbb9eb9a492afa8ab82d562c34336b/performance_comparison_[3/4]/report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 17:31:15 +01:00
Mikhail f. Shiryaev
7b5e31cd8d
Revert some typos, improve the language 2023-02-13 15:53:28 +01:00
Mikhail f. Shiryaev
4d8ff0c0fb
Update the golang version to 1.19.5 2023-02-13 13:19:45 +01:00
Mikhail f. Shiryaev
ebb41504c0
Move copy to the end for parallel image building 2023-02-12 14:55:16 +01:00
serxa
c17dc8e284 fix 2023-02-11 16:48:47 +00:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler 2023-02-11 10:30:26 +01:00
Kruglov Pavel
38fbf88ea7
Merge branch 'master' into split-bc-check 2023-02-10 18:28:49 +01:00
Kruglov Pavel
43e660ebd2
Update run.sh 2023-02-10 18:28:19 +01:00
Alexander Tokmakov
9c20e42807
Update run.sh 2023-02-10 14:25:26 +03:00
Alexander Tokmakov
d61c665cd5
Update run.sh 2023-02-10 14:01:48 +03:00
Kruglov Pavel
4067453602
Update run.sh 2023-02-10 11:57:02 +01:00
Alexander Tokmakov
9e5e3e7ca9
Merge branch 'master' into tavplubix-patch-2 2023-02-09 22:42:23 +03:00
serxa
f61f95fcec Replace background executor scheduler merges and mutations with round-robin 2023-02-09 18:54:15 +00:00
Mikhail f. Shiryaev
376b5d178f
Experiment with multiple build stages 2023-02-09 19:13:44 +01:00
Mikhail f. Shiryaev
1ef1eefa26
Format the RUN, update clang-tidy-cache 2023-02-09 19:10:48 +01:00
Mikhail f. Shiryaev
5bc3e703ef
Move the heaviest operation to the top 2023-02-09 19:10:06 +01:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
de1c4f5764 fix disabled by mistake hung check 2023-02-08 22:37:22 +01:00
Alexander Tokmakov
cb45d3aec1
Update Dockerfile.ubuntu 2023-02-08 19:00:17 +03:00
Mikhail f. Shiryaev
b2f583e749
Fix some typos, improve versions description 2023-02-08 13:26:41 +01:00
Mikhail f. Shiryaev
5641f56af6
Copy image description from docker hub to sync 2023-02-08 13:06:06 +01:00
Mikhail f. Shiryaev
cdf35755c9
Update clickhouse-server image desription 2023-02-08 13:05:02 +01:00
Kseniia Sumarokova
6160db6569
Merge pull request #44949 from ClibMouse/HDFS_PowerPC
Changes to support the HDFS in Power PC.
2023-02-08 12:17:15 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075)
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
2023-02-08 12:04:11 +01:00
Mikhail f. Shiryaev
c1655052e2
Merge pull request #46079 from ClickHouse/update-yarn-docs
Update yarn packages for dev branches
2023-02-06 15:44:07 +01:00
Mikhail f. Shiryaev
805a1aab8b
Update yarn packages for dev branches 2023-02-06 15:17:55 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings
Allow to randomize merge tree settings in tests
2023-02-04 02:59:52 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd
Add systemd.service for clickhouse-keeper
2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2 2023-02-03 18:44:53 +03:00