Commit Graph

3269 Commits

Author SHA1 Message Date
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
lgbo-ustc
eddb6443f2 rollback dockerd-entrypoint.sh 2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06 tests/stress: fix TSan detection
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
    /run.sh: line 13: test: too many arguments

Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca tests: add no-stress tag
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda docker/test/stress/stress: apply black
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6 tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Mikhail f. Shiryaev
2bef5257b7
Merge pull request #38147 from ClickHouse/22.7-prepare
Update version after release
2022-06-16 17:19:40 +02:00
Mikhail f. Shiryaev
dbe1eafff1
Update docker server version 2022-06-16 17:18:18 +02:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh 2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957 tests: avoid "_csv.Error: field larger than field limit (131072)" error
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00 docker/test/util/process_functional_tests_result.py: fix typo
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
79b4648c96
Merge pull request #38016 from ClickHouse/clickhouse-client-readme
Add another useful `docker exec` option
2022-06-13 12:25:02 +02:00
Mikhail f. Shiryaev
a78ff2b9bb
Merge pull request #37979 from ClickHouse/minio-images
Generalize setup_minio.sh
2022-06-13 12:20:02 +02:00
Mikhail f. Shiryaev
1e67885915
Add another useful docker exec option 2022-06-13 12:03:11 +02:00
vdimir
7a5b8a8ea9
Update docker run client command in docs 2022-06-13 11:35:46 +02:00
Alexander Tokmakov
72fe5144ca
Revert "Don't try to kill empty list of containers in integration/runner" 2022-06-11 22:55:31 +03:00
Alexey Milovidov
384cef7242
Merge pull request #37854 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner`
2022-06-11 03:01:41 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image 2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too 2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell 2022-06-09 11:01:25 +02:00
Mikhail f. Shiryaev
2cfaa75278
Merge pull request #37925 from ClickHouse/docs-docker
Docs docker
2022-06-08 15:31:05 +02:00
Mikhail f. Shiryaev
145c916e65
Update pylint 2022-06-08 15:15:13 +02:00
Mikhail f. Shiryaev
9ca03d09cc
Add a way to invalidate docker images cache 2022-06-08 14:47:45 +02:00
Vladimir Chebotarev
91d9a074e1 Even more better. 2022-06-08 15:47:20 +03:00
vdimir
27ebad89c5
Add doc_spell_output.txt to process_style_check_result.py 2022-06-08 14:28:44 +02:00
vdimir
abce81058e
Add doc aspell 2022-06-08 14:25:56 +02:00
James Maidment
63f5e0b0c7 Add coordination dir root 2022-06-08 09:13:27 +10:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
mergify[bot]
ba5df6a8f9
Merge branch 'master' into nickitat-patch-2 2022-06-04 18:04:53 +00:00
Alexey Milovidov
b81a92ca8d
Merge pull request #37836 from vdimir/fix-doc-check
Fix docs check (remove git clean for yarn.lock)
2022-06-04 14:31:33 +03:00
Alexander Tokmakov
1ab5dcae38 fix for aarch64 2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f fix 2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15 fix 2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344 hotfix for minio in functional tests 2022-06-03 20:47:26 +02:00
vdimir
3bb0b286ea
git clean in docs-builder 2022-06-03 16:14:20 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster [2] (#35812) 2022-06-03 15:54:29 +02:00
vdimir
a351ed3208
Debugging docs check 2022-06-03 15:43:35 +02:00
Nikita Taranov
e41b268cc1
Fix packager 2022-06-03 14:32:29 +02:00
Kruglov Pavel
ed3bc4328e
Merge pull request #37788 from ClickHouse/Avogar-patch-5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-03 13:09:04 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check 2022-06-02 13:33:27 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
jinjunzh
1d3ae2d88c fixed unable to find library -ldl in docker build 2022-05-31 17:14:08 -04:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
jinjunzh
822cef10b3 add nasm into more docker configuration 2022-05-30 21:16:06 -04:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
mergify[bot]
df9f7c59a2
Merge branch 'master' into try_fix_tests 2022-05-29 15:04:48 +00:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e500ec5fd8
Update run-fuzzer.sh 2022-05-28 21:25:20 +03:00
Alexander Tokmakov
1ae919a18a Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
This reverts commit 18d094d79d, reversing
changes made to 224f4dc620.
2022-05-28 19:23:58 +02:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
tchepavel
42cd854688
Merge branch 'master' into nats-integration 2022-05-27 16:05:08 +03:00
Azat Khuzhin
827e73a2f4 tests/fasttest: simplify waiting of the server
Note, thiat removes "ability to run fasttest locally", but other jobs
cannot do this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
2570136e5e tests/sqlancer: remove superior wait of the server stop
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
d90f21a569 tests/stateful: properly wait the server
v2: fix permissions for /var/run/clickhouse-server?
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
478b03c5cb tests/fuzzer: use "clickhouse stop" to stop the server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
28e0bb78db tests/stateless: properly wait for server
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:

    Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html

So use proper wait via "clickhouse stop"

v2: Fix permissions pid file for replicated database servers
    They do not use default, /var/run/clickhouse-server, that do not have
    proper permissions.

Fixes: #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Alexey Milovidov
207ffc0f92 Merge branch 'master' into llvm-14 2022-05-27 01:18:51 +02:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Alexey Milovidov
94e693f96e Fix Docker 2022-05-24 23:40:10 +02:00
Alexey Milovidov
516fba27dc Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-24 23:31:14 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes
Do computations on the raw input data without copying to Eigen::Matrix
2022-05-24 20:59:04 +02:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Vladimir C
b9bea7d803
Merge pull request #37436 from vdimir/add_parallel_hash_stress 2022-05-24 14:59:48 +02:00
Mikhail f. Shiryaev
3ab5390327
Trigger rebuild for docs-release docker image 2022-05-24 11:14:15 +02:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
Mikhail f. Shiryaev
bc145294a6
Merge pull request #37441 from ClickHouse/website-content
Release website content
2022-05-23 12:51:14 +02:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Mikhail f. Shiryaev
fd217da123
Restore website release 2022-05-23 11:42:51 +02:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test 2022-05-23 10:18:22 +02:00
Alexey Milovidov
f614c139f4 Maybe better 2022-05-23 02:06:03 +02:00
Alexey Milovidov
7ad8d48771 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-23 01:09:08 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Alexey Milovidov
d0d0807a10 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-20 02:37:15 +02:00
Michael Nutt
e0c14dfc01 fix includes 2022-05-18 20:16:43 -04:00
Mikhail f. Shiryaev
79c30f5e58
Do not fail if output and workspace are the same 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
ec3246ea4f
Run binary-builder as a current user 2022-05-18 01:38:45 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
8507a4ddbf
Update nfpm version, prepare UID/GID workdir 2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
96859ec678
Remove unused packager code for deb packages 2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
d2e5ab0f6c
Improve packager script a little bit 2022-05-18 01:38:42 +02:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration 2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch 2022-05-16 22:42:09 +02:00
tchepavel
35cbe48ca3 Fixing; preparing test 2022-05-16 13:03:28 +03:00
Nikolai Kochetov
f1bc2bc615 Merge branch 'master' into llvm-14 2022-05-16 12:03:26 +02:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration 2022-05-15 14:41:22 +03:00
jasperzhu
5e607e6cf5
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-15 10:59:07 +08:00
Alexey Milovidov
7ce409da52
Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-15 04:33:59 +03:00
tchepavel
cc94378698 Add nats-io cmake; finally fix publishing 2022-05-12 19:11:32 +03:00
Mikhail Artemenko
12717f2417 fix <Breaking changes> in Meilisearch v0.27.0 2022-05-12 16:51:00 +03:00
jasperzhu
c74732ae79
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-12 21:28:13 +08:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions 2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash
Wyhash
2022-05-11 09:57:09 -04:00
qieqieplus
6903b3d33c fix ci fast test 2022-05-11 17:16:23 +08:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
Changelog script
2022-05-11 10:54:29 +02:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch 2022-05-11 08:49:19 +00:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
Alexey Milovidov
e40396a0e5 Fix Docker 2022-05-11 03:21:08 +02:00
Alexey Milovidov
f3c3935df3 Fix shellcheck 2022-05-11 03:18:28 +02:00
Alexey Milovidov
a8506f6604 Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-11 03:14:28 +02:00
alesapin
3cc8e2af51
Merge pull request #37079 from ClickHouse/disable_thread_fuzzer
Disable thread fuzzer after server restart
2022-05-10 23:24:34 +02:00
Mikhail f. Shiryaev
3802944cc0
Merge pull request #36863 from ClickHouse/tests-result-for-not-finished
Replace `Timeout` with `Tests not finished`
2022-05-10 19:23:34 +02:00
Mikhail f. Shiryaev
e31ac2e717
Fix cleaning up integration-runner docker volume 2022-05-10 17:41:49 +02:00
alesapin
af99183950 Disable thread fuzzer after server restart 2022-05-10 15:16:21 +02:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7 fix shellcheck 2022-05-10 11:48:55 +02:00
Mikhail f. Shiryaev
d78709c656
Add dependencies and CI for changelogs generator 2022-05-10 11:25:38 +02:00
Alexander Tokmakov
92d423c478 print stacks if wa cannot terminate server in stress tests 2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh 2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh 2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit 2022-05-09 10:17:40 +02:00
Alexey Milovidov
c95f22e64d
Merge branch 'master' into allow-setuid-inside-clickhouse 2022-05-07 00:21:47 +03:00
Mikhail f. Shiryaev
cad69ad30d
Rebuild docs-builder 2022-05-06 14:53:33 +02:00
jinjunzh
fd5085c290 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-05-05 12:00:30 -04:00
jinjunzh
c4bce5234e add nasm source into contrib for nasm compiler 2022-05-05 11:56:11 -04:00
Mikhail f. Shiryaev
37533eb14b
Improve comment FIXME for errors report 2022-05-04 16:56:43 +02:00
Mikhail f. Shiryaev
2b67208dea
Ignore slow query as errors in performance tests report 2022-05-04 13:02:48 +02:00
Alexander Tokmakov
c3f177f0ac
Merge pull request #36885 from ClickHouse/fix_system_logs_saving
Save system logs in functionsl tests if server crashed
2022-05-04 01:12:41 +03:00
Alexander Tokmakov
7a9c9da0bd
Update run.sh 2022-05-04 01:10:40 +03:00
Alexander Tokmakov
193a50a688
Update run.sh 2022-05-03 23:17:03 +03:00
Alexander Tokmakov
3baf72f1d4 save system logs in func tests if server crashed 2022-05-03 20:10:07 +02:00
Mikhail f. Shiryaev
6197934e14
Replace Timeout with Tests not finished 2022-05-03 10:45:29 +02:00
jasperzhu
7f47e9b934
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-03 15:47:57 +08:00
Alexey Milovidov
88826e2da5 Remove "preconditions" from performance tests (overengineering, unneeded feature) 2022-05-02 02:33:22 +02:00
Mikhail Artemenko
6830b74925 fix ref after merge & change runner dockerfile 2022-05-01 23:57:44 +03:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch 2022-05-01 10:01:56 +03:00
jinjunzh
34934b80a9 update qpl deflate supporting test script and docs 2022-04-29 11:40:08 -04:00
Mikhail f. Shiryaev
5a8fcafc5e
Fix GIT_DOCS_BRANCH with the same branch as checked out 2022-04-29 15:23:25 +02:00