Commit Graph

3428 Commits

Author SHA1 Message Date
lgbo-ustc
eddb6443f2 rollback dockerd-entrypoint.sh 2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06 tests/stress: fix TSan detection
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
    /run.sh: line 13: test: too many arguments

Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca tests: add no-stress tag
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda docker/test/stress/stress: apply black
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6 tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Mikhail f. Shiryaev
2bef5257b7
Merge pull request #38147 from ClickHouse/22.7-prepare
Update version after release
2022-06-16 17:19:40 +02:00
Mikhail f. Shiryaev
dbe1eafff1
Update docker server version 2022-06-16 17:18:18 +02:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh 2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957 tests: avoid "_csv.Error: field larger than field limit (131072)" error
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00 docker/test/util/process_functional_tests_result.py: fix typo
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
79b4648c96
Merge pull request #38016 from ClickHouse/clickhouse-client-readme
Add another useful `docker exec` option
2022-06-13 12:25:02 +02:00
Mikhail f. Shiryaev
a78ff2b9bb
Merge pull request #37979 from ClickHouse/minio-images
Generalize setup_minio.sh
2022-06-13 12:20:02 +02:00
Mikhail f. Shiryaev
1e67885915
Add another useful docker exec option 2022-06-13 12:03:11 +02:00
vdimir
7a5b8a8ea9
Update docker run client command in docs 2022-06-13 11:35:46 +02:00
Alexander Tokmakov
72fe5144ca
Revert "Don't try to kill empty list of containers in integration/runner" 2022-06-11 22:55:31 +03:00
Alexey Milovidov
384cef7242
Merge pull request #37854 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner`
2022-06-11 03:01:41 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image 2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too 2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell 2022-06-09 11:01:25 +02:00
Mikhail f. Shiryaev
2cfaa75278
Merge pull request #37925 from ClickHouse/docs-docker
Docs docker
2022-06-08 15:31:05 +02:00
Mikhail f. Shiryaev
145c916e65
Update pylint 2022-06-08 15:15:13 +02:00
Mikhail f. Shiryaev
9ca03d09cc
Add a way to invalidate docker images cache 2022-06-08 14:47:45 +02:00
Vladimir Chebotarev
91d9a074e1 Even more better. 2022-06-08 15:47:20 +03:00
vdimir
27ebad89c5
Add doc_spell_output.txt to process_style_check_result.py 2022-06-08 14:28:44 +02:00
vdimir
abce81058e
Add doc aspell 2022-06-08 14:25:56 +02:00
James Maidment
63f5e0b0c7 Add coordination dir root 2022-06-08 09:13:27 +10:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
mergify[bot]
ba5df6a8f9
Merge branch 'master' into nickitat-patch-2 2022-06-04 18:04:53 +00:00
Alexey Milovidov
b81a92ca8d
Merge pull request #37836 from vdimir/fix-doc-check
Fix docs check (remove git clean for yarn.lock)
2022-06-04 14:31:33 +03:00
Alexander Tokmakov
1ab5dcae38 fix for aarch64 2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f fix 2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15 fix 2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344 hotfix for minio in functional tests 2022-06-03 20:47:26 +02:00
vdimir
3bb0b286ea
git clean in docs-builder 2022-06-03 16:14:20 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster [2] (#35812) 2022-06-03 15:54:29 +02:00
vdimir
a351ed3208
Debugging docs check 2022-06-03 15:43:35 +02:00
Nikita Taranov
e41b268cc1
Fix packager 2022-06-03 14:32:29 +02:00
Kruglov Pavel
ed3bc4328e
Merge pull request #37788 from ClickHouse/Avogar-patch-5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-03 13:09:04 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check 2022-06-02 13:33:27 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3 2022-06-01 12:02:33 +00:00
jinjunzh
1d3ae2d88c fixed unable to find library -ldl in docker build 2022-05-31 17:14:08 -04:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
jinjunzh
822cef10b3 add nasm into more docker configuration 2022-05-30 21:16:06 -04:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
mergify[bot]
df9f7c59a2
Merge branch 'master' into try_fix_tests 2022-05-29 15:04:48 +00:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e500ec5fd8
Update run-fuzzer.sh 2022-05-28 21:25:20 +03:00
Alexander Tokmakov
1ae919a18a Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
This reverts commit 18d094d79d, reversing
changes made to 224f4dc620.
2022-05-28 19:23:58 +02:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
tchepavel
42cd854688
Merge branch 'master' into nats-integration 2022-05-27 16:05:08 +03:00
Azat Khuzhin
827e73a2f4 tests/fasttest: simplify waiting of the server
Note, thiat removes "ability to run fasttest locally", but other jobs
cannot do this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
2570136e5e tests/sqlancer: remove superior wait of the server stop
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
d90f21a569 tests/stateful: properly wait the server
v2: fix permissions for /var/run/clickhouse-server?
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
478b03c5cb tests/fuzzer: use "clickhouse stop" to stop the server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
28e0bb78db tests/stateless: properly wait for server
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:

    Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html

So use proper wait via "clickhouse stop"

v2: Fix permissions pid file for replicated database servers
    They do not use default, /var/run/clickhouse-server, that do not have
    proper permissions.

Fixes: #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Alexey Milovidov
207ffc0f92 Merge branch 'master' into llvm-14 2022-05-27 01:18:51 +02:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Alexey Milovidov
94e693f96e Fix Docker 2022-05-24 23:40:10 +02:00
Alexey Milovidov
516fba27dc Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-24 23:31:14 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes
Do computations on the raw input data without copying to Eigen::Matrix
2022-05-24 20:59:04 +02:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Vladimir C
b9bea7d803
Merge pull request #37436 from vdimir/add_parallel_hash_stress 2022-05-24 14:59:48 +02:00
Mikhail f. Shiryaev
3ab5390327
Trigger rebuild for docs-release docker image 2022-05-24 11:14:15 +02:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
Mikhail f. Shiryaev
bc145294a6
Merge pull request #37441 from ClickHouse/website-content
Release website content
2022-05-23 12:51:14 +02:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Mikhail f. Shiryaev
fd217da123
Restore website release 2022-05-23 11:42:51 +02:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test 2022-05-23 10:18:22 +02:00
Alexey Milovidov
f614c139f4 Maybe better 2022-05-23 02:06:03 +02:00
Alexey Milovidov
7ad8d48771 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-23 01:09:08 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Alexey Milovidov
d0d0807a10 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-20 02:37:15 +02:00
Michael Nutt
e0c14dfc01 fix includes 2022-05-18 20:16:43 -04:00
Mikhail f. Shiryaev
79c30f5e58
Do not fail if output and workspace are the same 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
ec3246ea4f
Run binary-builder as a current user 2022-05-18 01:38:45 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
8507a4ddbf
Update nfpm version, prepare UID/GID workdir 2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
96859ec678
Remove unused packager code for deb packages 2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
d2e5ab0f6c
Improve packager script a little bit 2022-05-18 01:38:42 +02:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration 2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch 2022-05-16 22:42:09 +02:00
tchepavel
35cbe48ca3 Fixing; preparing test 2022-05-16 13:03:28 +03:00
Nikolai Kochetov
f1bc2bc615 Merge branch 'master' into llvm-14 2022-05-16 12:03:26 +02:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration 2022-05-15 14:41:22 +03:00
jasperzhu
5e607e6cf5
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-15 10:59:07 +08:00
Alexey Milovidov
7ce409da52
Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-15 04:33:59 +03:00
tchepavel
cc94378698 Add nats-io cmake; finally fix publishing 2022-05-12 19:11:32 +03:00
Mikhail Artemenko
12717f2417 fix <Breaking changes> in Meilisearch v0.27.0 2022-05-12 16:51:00 +03:00
jasperzhu
c74732ae79
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-12 21:28:13 +08:00
Alexander Tokmakov
425b31ba1b
Update stress 2022-05-12 15:04:12 +03:00
Alexander Tokmakov
c23bc01196 Merge branch 'master' into zookeeper_client_fault_injection 2022-05-11 17:20:42 +02:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions 2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash
Wyhash
2022-05-11 09:57:09 -04:00
qieqieplus
6903b3d33c fix ci fast test 2022-05-11 17:16:23 +08:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
Changelog script
2022-05-11 10:54:29 +02:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch 2022-05-11 08:49:19 +00:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
Alexey Milovidov
e40396a0e5 Fix Docker 2022-05-11 03:21:08 +02:00
Alexey Milovidov
f3c3935df3 Fix shellcheck 2022-05-11 03:18:28 +02:00
Alexey Milovidov
a8506f6604 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-11 03:14:28 +02:00
alesapin
3cc8e2af51
Merge pull request #37079 from ClickHouse/disable_thread_fuzzer
Disable thread fuzzer after server restart
2022-05-10 23:24:34 +02:00
Mikhail f. Shiryaev
3802944cc0
Merge pull request #36863 from ClickHouse/tests-result-for-not-finished
Replace `Timeout` with `Tests not finished`
2022-05-10 19:23:34 +02:00
Mikhail f. Shiryaev
e31ac2e717
Fix cleaning up integration-runner docker volume 2022-05-10 17:41:49 +02:00
alesapin
af99183950 Disable thread fuzzer after server restart 2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3 2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7 fix shellcheck 2022-05-10 11:48:55 +02:00
Mikhail f. Shiryaev
d78709c656
Add dependencies and CI for changelogs generator 2022-05-10 11:25:38 +02:00
Alexander Tokmakov
92d423c478 print stacks if wa cannot terminate server in stress tests 2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh 2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh 2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit 2022-05-09 10:17:40 +02:00
Alexey Milovidov
c95f22e64d
Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-07 00:21:47 +03:00
Mikhail f. Shiryaev
cad69ad30d
Rebuild docs-builder 2022-05-06 14:53:33 +02:00
jinjunzh
fd5085c290 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-05-05 12:00:30 -04:00
jinjunzh
c4bce5234e add nasm source into contrib for nasm compiler 2022-05-05 11:56:11 -04:00
Mikhail f. Shiryaev
37533eb14b
Improve comment FIXME for errors report 2022-05-04 16:56:43 +02:00
Mikhail f. Shiryaev
2b67208dea
Ignore slow query as errors in performance tests report 2022-05-04 13:02:48 +02:00
Alexander Tokmakov
c3f177f0ac
Merge pull request #36885 from ClickHouse/fix_system_logs_saving
Save system logs in functionsl tests if server crashed
2022-05-04 01:12:41 +03:00
Alexander Tokmakov
7a9c9da0bd
Update run.sh 2022-05-04 01:10:40 +03:00
Alexander Tokmakov
193a50a688
Update run.sh 2022-05-03 23:17:03 +03:00
Alexander Tokmakov
3baf72f1d4 save system logs in func tests if server crashed 2022-05-03 20:10:07 +02:00
Mikhail f. Shiryaev
6197934e14
Replace Timeout with Tests not finished 2022-05-03 10:45:29 +02:00
jasperzhu
7f47e9b934
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-03 15:47:57 +08:00
Alexey Milovidov
88826e2da5 Remove "preconditions" from performance tests (overengineering, unneeded feature) 2022-05-02 02:33:22 +02:00
alesapin
85dda249b8 Don't download stateful table 2022-05-02 00:11:05 +02:00
Mikhail Artemenko
6830b74925 fix ref after merge & change runner dockerfile 2022-05-01 23:57:44 +03:00
alesapin
51345fa25b Trying stress on top of S3 2022-05-01 19:07:02 +02:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch 2022-05-01 10:01:56 +03:00
jinjunzh
34934b80a9 update qpl deflate supporting test script and docs 2022-04-29 11:40:08 -04:00
Mikhail f. Shiryaev
5a8fcafc5e
Fix GIT_DOCS_BRANCH with the same branch as checked out 2022-04-29 15:23:25 +02:00
Alexey Milovidov
1dc56e39fc black . 2022-04-29 04:39:21 +02:00
Alexey Milovidov
2a3a2184ec Refinement 2022-04-29 04:37:57 +02:00
Alexey Milovidov
2d7d67e7bc Remove special handling of "short" queries - the logic is too ad-hoc, it pollutes the code and is difficult to handle 2022-04-29 04:27:57 +02:00
Mikhail f. Shiryaev
a2dc780174
Make backward compatible integration tests runner 2022-04-25 21:16:02 +02:00
Mikhail f. Shiryaev
f53040b95e
Merge pull request #36559 from ClickHouse/performance-rebalance
Use just index to split performance tests by group
2022-04-25 14:15:23 +02:00
Alexey Milovidov
bdf86f3b7a
Merge pull request #36554 from ClickHouse/snyk-fixes
Snyk fixes
2022-04-23 22:51:56 +03:00
Mikhail f. Shiryaev
04a8955427
fixup! Update golang-mysql integration image 2022-04-23 15:24:42 +02:00
Mikhail f. Shiryaev
e434d78e68
fixup! Update golang-mysql integration image 2022-04-22 23:02:22 +02:00
alesapin
7380a71333
Merge pull request #31833 from ClickHouse/musl-check
Build clickhouse-keeper with Musl
2022-04-22 22:41:16 +02:00
Mikhail f. Shiryaev
74a755d170
Use just index to split tests by group 2022-04-22 20:34:34 +02:00
Mikhail f. Shiryaev
11694459f3
Update mysql_php_client php version 2022-04-22 18:22:14 +02:00
Mikhail f. Shiryaev
d4e8c6fb44
Update golang-mysql integration image 2022-04-22 18:22:12 +02:00
alesapin
18d094d79d
Merge pull request #35865 from azat/clickhouse-test-left-queries
clickhouse-test: fix left-queries-check, to fix test log parser
2022-04-22 15:59:38 +02:00
Mikhail f. Shiryaev
bf41199cc3
Fix issue with broken git ownership 2022-04-22 14:56:34 +02:00
alesapin
c2a881decd
Update docker/packager/packager
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2022-04-22 11:30:22 +02:00
Mikhail f. Shiryaev
382c717d09
Speed-up fetching submodules 2022-04-21 20:08:55 +02:00
olevino999
a32aa93b50 wyhash 2022-04-21 19:36:47 +03:00
Mikhail f. Shiryaev
fc83f5e96c
Get ccache status before build 2022-04-21 17:18:43 +02:00
Mikhail f. Shiryaev
7dd2fdb47c
Try to minimize linking for keeper 2022-04-21 16:11:43 +02:00
Mikhail f. Shiryaev
619d2703f0
Simplify build.sh for binary packager 2022-04-21 14:15:24 +02:00
Mikhail f. Shiryaev
49a572e00c
Build only clickhouse-keeper with musl 2022-04-21 13:43:24 +02:00
alesapin
48f1ce96e7 AA 2022-04-21 00:04:49 +02:00
alesapin
9815b4bea4 Followup 2022-04-20 22:42:26 +02:00
alesapin
b8021be891 Perfect cmake 2022-04-20 21:19:43 +02:00
tavplubix
06de1adebc
Merge pull request #36450 from ClickHouse/Avogar-patch-4
Fix stress test
2022-04-20 21:42:24 +03:00
tavplubix
2d34d46b28
Update entrypoint.sh 2022-04-20 21:38:49 +03:00
Azat Khuzhin
08e74b98f5 tests: do not check queries after tests for replicated database
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-20 21:34:31 +03:00
Kruglov Pavel
4e2b1cd981
Update run.sh 2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output 2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test 2022-04-20 13:53:16 +02:00
alesapin
ba81816dc1 Better cmake 2022-04-20 12:11:55 +02:00
mergify[bot]
0df5fda6ed
Merge branch 'master' into musl-check 2022-04-20 09:28:40 +00:00
Mikhail f. Shiryaev
8e2874328f
Prepare docs_check.py to be used in docs-clickhouse 2022-04-19 23:35:39 +02:00
Mikhail f. Shiryaev
7925d925a9
Merge branch 'master' into docs-staging 2022-04-19 11:00:03 +02:00
Mikhail f. Shiryaev
ffbf05c4bd
Merge lang directories in clickhouse-docs repo 2022-04-19 10:43:14 +02:00
Mikhail f. Shiryaev
fe8bbbadcc
Decrease image size by removal cache 2022-04-19 10:43:13 +02:00
Mikhail f. Shiryaev
cc3a9586d0
Fail DocsCheck on markdown symlinks 2022-04-19 10:43:12 +02:00
Mikhail f. Shiryaev
7a7a5a72cb
Intermediate step of migration to docusaurus 2022-04-19 10:43:10 +02:00
Alexey Milovidov
88f98443bd
Merge branch 'master' into allow-setuid-inside-clickhouse 2022-04-18 07:06:02 +03:00
Alexey Milovidov
543e5d7242 Merge branch 'master' into musl-check 2022-04-18 02:40:13 +02:00
Azat Khuzhin
8d87e48cb4 Simplify perf scripts by using schema inference 2022-04-17 09:01:15 +03:00
Alexey Milovidov
e0121dfe6f Remove old comment 2022-04-17 00:33:58 +02:00
Alexey Milovidov
b7e5a81215 Allow to drop privileges at startup 2022-04-17 00:24:47 +02:00
Alexey Milovidov
dda060063b Remove trash 2022-04-17 00:14:27 +02:00
Alexey Milovidov
b5c64244c9 Merge branch 'llvm-14' of github.com:ClickHouse/ClickHouse into llvm-14 2022-04-16 01:15:27 +02:00
Alexey Milovidov
73b52859df Merge branch 'master' into llvm-14 2022-04-16 00:46:58 +02:00
alesapin
be5b75b567 Reverse 2022-04-14 15:44:09 +02:00
alesapin
774e01bf13 Hacky hack 2022-04-14 15:43:36 +02:00
tavplubix
5f31185125
Update stress 2022-04-14 14:35:46 +03:00
alesapin
b27070856e Fix 2022-04-14 12:27:13 +02:00
alesapin
7521aecdf5 Debug why we have dynamic binary 2022-04-14 12:23:09 +02:00
alesapin
7c11abb995 Followup 2022-04-13 21:33:34 +02:00
alesapin
aba2b77972 Fix order 2022-04-13 17:45:34 +02:00
mergify[bot]
ea3afd4c6c
Merge branch 'master' into musl-check 2022-04-13 12:28:34 +00:00
Mikhail f. Shiryaev
51685e0956
Dirty fix fasttest after addressing CVE-2022-24765 2022-04-13 13:36:28 +02:00
alesapin
1a88143468 Fix build 2022-04-13 11:49:56 +02:00
Mikhail Artemenko
2fd86cc564
Merge branch 'master' into MeiliSearch 2022-04-13 12:05:46 +03:00
alesapin
b8389d48b4 Fix packager 2022-04-12 18:51:35 +02:00
alesapin
f011864386 Build clickhouse-keeper with musl 2022-04-12 18:48:16 +02:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4
Try to turn off always green backward compatibility checks
2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress 2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress 2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress 2022-04-11 18:03:19 +03:00
mergify[bot]
df81e8d60c
Merge branch 'master' into Avogar-patch-4 2022-04-11 14:37:28 +00:00
Mikhail f. Shiryaev
08e518a821
Merge branch 'master' into llvm-14 2022-04-08 13:57:44 +02:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks 2022-04-08 13:55:10 +02:00
Mikhail f. Shiryaev
20aee231bd
Improve codebrowser image, use a temporary branch as source 2022-04-08 13:44:25 +02:00
Alexander Tokmakov
49c35f3261 Merge branch 'master' into mvcc_prototype 2022-04-08 13:34:40 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2
Fix Backward comapatibility check
2022-04-08 13:10:59 +03:00
alesapin
8ec802bc62
Merge pull request #35475 from kssenii/remote-fs-cache-improvements
Allow to write remote fs cache on all write operations. Add `system.remote_filesystem_cache` table. Add `drop remote filesystem cache (<path>)` query. Add `system.remote_data_paths` table.
2022-04-08 12:06:26 +02:00
Alexander Tokmakov
6a46da93ae Merge branch 'master' into mvcc_prototype 2022-04-07 23:22:19 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity 2022-04-07 18:35:58 +02:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green 2022-04-07 17:42:33 +02:00
Mikhail f. Shiryaev
8111010815
Rebuild a builder for test 2022-04-07 17:16:44 +02:00
Mikhail f. Shiryaev
5b69caf383
Update codebrowser clang to 14 2022-04-07 15:18:26 +02:00
Alexander Tokmakov
7f54e7b422 Merge branch 'master' into mvcc_prototype 2022-04-07 15:14:06 +02:00
Alexander Tokmakov
8290ffa88d Merge branch 'master' into mvcc_prototype 2022-04-07 13:50:42 +02:00
Vladimir C
a2aec793d1
Merge pull request #35985 from azat/stress-improve-checks 2022-04-07 12:42:57 +02:00
tavplubix
b32800420c
Update stress 2022-04-07 13:30:11 +03:00
Mikhail f. Shiryaev
2d87e3587d
Merge pull request #34895 from DevTeamBK/coverity_scan
Attempt at Nightly Coverity Scan and upload
2022-04-06 19:07:00 +02:00
Mikhail Artemenko
151eeb1a27
Merge branch 'master' into MeiliSearch 2022-04-06 17:07:55 +03:00
Azat Khuzhin
2fb6d6acb4 stress: use more meaningful names for clickhouse-server.log
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f test/stress: improve error checks for backward compatiblity check
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:52 +03:00
Kruglov Pavel
ab5c912ad4
Merge pull request #35613 from ClickHouse/Avogar-patch-3
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-04-06 12:58:37 +02:00
Kseniia Sumarokova
0e1637dfaf
Merge pull request #35354 from kssenii/enable-testmode-by-default
Remove testmode option, enable it unconditionally
2022-04-06 10:06:08 +02:00
kssenii
d59d4eda4f Fix tests 2022-04-06 01:58:16 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Alexey Milovidov
1d02f9e296
Merge pull request #35942 from ClickHouse/snyk-fix-d2de427965e212a701b47d65ca7642bc
[Snyk] Security upgrade node from 8 to 16.14.2
2022-04-05 19:21:43 +03:00
Alexander Tokmakov
1fe50ad201 Merge branch 'master' into mvcc_prototype 2022-04-05 14:38:02 +02:00
Alexander Tokmakov
da00beaf7f Merge branch 'master' into mvcc_prototype 2022-04-05 11:14:42 +02:00
Mikhail f. Shiryaev
12ac4cc731
Merge pull request #35945 from ClickHouse/keeper-docker-image
Fix keeper image for `arm64`
2022-04-05 10:48:37 +02:00
Nikita Mikhaylov
61183ac07b Done 2022-04-04 22:24:39 +00:00
Mikhail f. Shiryaev
4d7618585b
Fix WORKDIR issue after upgrading npm 2022-04-05 00:10:33 +02:00
snyk-bot
e78ff3ea7b
fix: docker/test/integration/mysql_js_client/Dockerfile to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON27-341379
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-1063181
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-340072
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-453739
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-584435
2022-04-04 21:20:18 +00:00
Mikhail f. Shiryaev
d475ce5d16
Fix building ubuntu image from deb-repo 2022-04-04 18:50:50 +02:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Nikita Mikhaylov
279defbe9f
Add clickhouse-keeper Dockerfile 2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
b950b53156
Make multiarch clickhouse-server Dockerfiles 2022-04-01 11:59:49 +02:00
Mikhail f. Shiryaev
c053f1cb1d
Rewrite alpine building to pure Dockerfile 2022-04-01 11:59:46 +02:00
Mikhail f. Shiryaev
1b53993560
Make Dockerfile.ubuntu a default image definition 2022-04-01 11:59:46 +02:00
Mikhail f. Shiryaev
fbb6787a45
Rename Dockerfile to Dockerfile.ubuntu 2022-04-01 11:59:45 +02:00
Mikhail f. Shiryaev
4cc37ae9f3
Clean stale code 2022-04-01 11:59:44 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14 2022-04-01 04:49:03 +03:00
Alexander Tokmakov
307a2ca579 Merge branch 'master' into zookeeper_client_fault_injection 2022-03-31 15:32:41 +02:00
Nikita Mikhaylov
5f27f690f4 Revert "Added support for schema inference for hdfsCluster (#35602)"
This reverts commit f6bfdcc0c9.
2022-03-31 14:19:56 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster (#35602) 2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
tavplubix
5680f53ed4
Merge pull request #35773 from azat/stateless-tests-artifacts
ci: replace directory system log tables artifacts with tsv
2022-03-31 12:16:48 +03:00
Azat Khuzhin
8b84829e93 ci: replace directory system log tables artifacts with tsv
Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
  used, replace them with plain TSVWithNamesAndTypes, also note, that
  after schema inference it is even pretty easy to use
- support replicated database env correctly

Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 21:50:55 +03:00
kssenii
0fc92fe2aa Get rid of all "remote" mentions 2022-03-30 17:15:29 +02:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8 run stateful tests in parallel 2022-03-29 15:24:29 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
alesapin
a38f63af2d
Merge pull request #35676 from ClickHouse/remove_outdated_links
Remove outdated links from CI
2022-03-28 21:24:45 +02:00
alesapin
7ab8d7178c
Merge pull request #35308 from ClickHouse/clickhouse-keeper
New package clickhouse-keeper
2022-03-28 21:23:17 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
tavplubix
239be83757
Merge pull request #35669 from ClickHouse/fast_test_disable_rand_settings
Disable random settings in Fast Test
2022-03-28 17:06:12 +03:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Alexander Tokmakov
e795b83148 disable random settings in fast test 2022-03-28 14:56:23 +02:00
Mikhail Artemenko
1886d9c2ea refactor parseTypeOfField & fix tests 2022-03-27 23:00:28 +03:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
alesapin
c95a9971bc Merge branch 'master' into clickhouse-keeper 2022-03-25 11:22:57 +01:00
Mikhail f. Shiryaev
b2863d4cea
Rebuild docs-check for a test 2022-03-24 16:24:07 +01:00
mergify[bot]
03c8a59a57
Merge branch 'master' into stress-test 2022-03-23 17:37:05 +00:00
Alexander Tokmakov
bcec53aadc Merge branch 'master' into mvcc_prototype 2022-03-23 11:28:43 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Mikhail f. Shiryaev
5fea6d24fa
Add black formatting check 2022-03-22 17:38:48 +01:00
Mikhail f. Shiryaev
1e0ad94d67
Add a stand alone clickhouse-keeper package 2022-03-22 15:05:29 +01:00
alesapin
0ab9a9c0f6
Merge pull request #33664 from ClickHouse/release-steps
Refactor releasing process
2022-03-22 14:43:18 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
Mikhail f. Shiryaev
b9cb64a4a1
Add apk package and reports 2022-03-22 11:11:38 +01:00
Mikhail f. Shiryaev
d55785156b
Fix always success builds by move ts to build.sh 2022-03-22 11:10:03 +01:00
Mikhail f. Shiryaev
9ad31e983c
Fix compiler interpolation 2022-03-22 11:10:02 +01:00
Mikhail f. Shiryaev
0dd1f4af76
Rename alien arguments and parameters 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
70945764e5
Fix a tiny typo 2022-03-22 11:10:00 +01:00
Mikhail f. Shiryaev
342f7ba567
Migrate to nfpm 2022-03-22 11:09:59 +01:00
Mikhail f. Shiryaev
04e9d1b9f6
Add default values for some arguments of packager 2022-03-22 11:09:58 +01:00
Mikhail f. Shiryaev
2bed5ba0ad
Fix pylint issues 2022-03-22 11:09:57 +01:00
Mikhail f. Shiryaev
f4f60311ce
Apply black to docker packager 2022-03-22 11:09:55 +01:00
Alexander Tokmakov
3c762f566d Merge branch 'master' into mvcc_prototype 2022-03-21 20:16:29 +01:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00