Commit Graph

2662 Commits

Author SHA1 Message Date
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh 2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls 2022-07-19 14:58:01 +02:00
kssenii
df17df67c2 Fix checks 2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
kssenii
274457e5cf Allow cache over azure blob storage, add tests 2022-07-18 16:15:04 +02:00
kssenii
8ad26b3111 Merge master 2022-07-16 22:50:03 +02:00
Alexander Tokmakov
b770f9903d
Update run.sh 2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c fix stacktraces in gdb in bc check 2022-07-15 12:23:28 +02:00
Anton Popov
efed134758 fix test 2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23 Fix checks 2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh 2022-07-14 17:29:08 +03:00
Alexander Tokmakov
991493e6fc
Update run.sh 2022-07-13 15:22:36 +03:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls 2022-07-12 22:36:04 +02:00
Kseniia Sumarokova
f69ec635d0
Merge pull request #39110 from ClickHouse/kssenii-patch-4
Fix meilisearch tests
2022-07-12 18:32:49 +02:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml 2022-07-12 15:50:35 +02:00
Alexander Tokmakov
948f15eff3
Update run.sh 2022-07-12 14:01:53 +03:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too 2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml 2022-07-11 21:41:15 +02:00
Arthur Passos
7b626da080 remove cpp-dns and udns from fasttest 2022-07-11 12:43:56 -03:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
jinjunzh
7cb5b35bef remove qpl from fasttest 2022-07-09 13:54:23 -04:00
Vladimir C
bfba67cf88
Update docker/test/performance-comparison/compare.sh 2022-07-08 17:13:20 +02:00
Alexander Tokmakov
2b886ddc2e
Update run.sh 2022-07-08 16:47:54 +03:00
Vladimir C
9555d72dfc
Remove head ci-checks.tsv 2022-07-08 15:26:07 +02:00
Alexander Tokmakov
57b8a6a542
Update run.sh 2022-07-08 13:53:35 +03:00
Dmitry Novik
0b18b4ed43 Use group_by_use_nulls in tests more often 2022-07-07 18:58:46 +00:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls 2022-07-07 20:54:38 +02:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join 2022-07-07 19:16:49 +02:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check
Try to improve backward compatibility check
2022-07-07 18:52:34 +02:00
vdimir
b0c0ec370d
Add join_algorithm='full_sorting_merge' to stress tests 2022-07-06 14:27:34 +00:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test 2022-07-06 14:32:17 +02:00
mergify[bot]
e746760e41
Merge branch 'master' into improve-bc-check 2022-07-06 11:53:43 +00:00
jinjunzh
ba38969e9c enable qpl for clickhouse-keeper build 2022-07-05 15:28:41 -04:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload 2022-07-05 14:24:58 +02:00
vdimir
e4917914ae
Revert "show grants in compare.sh"
This reverts commit 4d3a64b318aa665bf1494cca6ae94e58dc8d361e.
2022-07-05 14:00:27 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest"
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
2022-07-05 14:00:26 +02:00
vdimir
051dd63a62
Fix types in ci-checks.tsv in compare.sh 2022-07-05 14:00:26 +02:00
vdimir
c1d44fee9f
upd compare.sh 2022-07-05 14:00:26 +02:00
vdimir
b1ee16ef77
show grants in compare.sh 2022-07-05 14:00:26 +02:00
vdimir
18dc718e4e
do not create tables for perf tests 2022-07-05 14:00:25 +02:00
vdimir
f8fa10578c
Use default database for perf tests 2022-07-05 14:00:25 +02:00
vdimir
7352c26e89
create tables for perf tests 2022-07-05 14:00:25 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results 2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest 2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion 2022-07-05 14:00:24 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Kruglov Pavel
45ac74617b
Fix 2022-07-04 20:38:21 +02:00
Dmitry Novik
614ce26ee7 Add group_be_use_nulls setting to stress tests 2022-07-04 18:09:48 +00:00
Kruglov Pavel
65dd81586b
Update run.sh 2022-07-04 17:30:22 +02:00
Arthur Passos
6c987fb28e Minor adjustments 2022-07-04 10:13:50 -03:00
Arthur Passos
52c5d7e0f9 Add cpp-dns and udns to docker/test/fasttest 2022-07-04 10:06:26 -03:00
avogar
17da24b584 Try to improve backward compatibility check 2022-07-04 13:02:22 +00:00
Azat Khuzhin
8e9c1eaa73 tests/stress: redirect gdb output on stop hang to gdb.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-03 14:46:17 +03:00
Alexander Tokmakov
b238ed4093 fix stress tests 2022-07-01 17:19:00 +02:00
Alexander Tokmakov
4dde5a6165
Merge pull request #38568 from ClickHouse/tavplubix-patch-1
Allow Ordinary database in Stress Tests
2022-06-30 16:23:08 +03:00
Alexander Tokmakov
4bf1443dae
Update download.sh 2022-06-30 01:00:08 +03:00
Alexander Tokmakov
cd2cb10f60
another try to fix performance tests 2022-06-29 20:55:46 +03:00
Alexander Tokmakov
baeb1811e1
try to fix performance tests 2022-06-29 16:59:16 +03:00
Alexander Tokmakov
3ff26939fc
Update run.sh 2022-06-29 15:46:40 +03:00
mergify[bot]
3f266954f0
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 18:13:36 +00:00
Alexander Tokmakov
0bb036dd21
Update Dockerfile 2022-06-28 20:35:20 +03:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:49:52 +00:00
Alexander Tokmakov
66cf6da35c
Merge pull request #38518 from ClickHouse/tavplubix-patch-1
Fix `_csv.Error: field larger than field limit`
2022-06-28 18:46:43 +03:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1
Fix application errors grep in stress test
2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh 2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test 2022-06-28 13:12:21 +02:00
Alexander Tokmakov
456e03758b
Update process_functional_tests_result.py 2022-06-28 13:52:39 +03:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
Alexander Tokmakov
7c37079a96 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 14:46:59 +02:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
jasperzhu
b2f98fa73b
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-27 10:21:21 +08:00
Mikhail f. Shiryaev
848ae7b130
Update docker-compose to try get rid of v1 errors 2022-06-24 16:49:48 +02:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method" 2022-06-24 12:19:41 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
lgbo-ustc
eddb6443f2 rollback dockerd-entrypoint.sh 2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06 tests/stress: fix TSan detection
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
    /run.sh: line 13: test: too many arguments

Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca tests: add no-stress tag
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda docker/test/stress/stress: apply black
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6 tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh 2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957 tests: avoid "_csv.Error: field larger than field limit (131072)" error
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00 docker/test/util/process_functional_tests_result.py: fix typo
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image 2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too 2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell 2022-06-09 11:01:25 +02:00
Mikhail f. Shiryaev
145c916e65
Update pylint 2022-06-08 15:15:13 +02:00
vdimir
27ebad89c5
Add doc_spell_output.txt to process_style_check_result.py 2022-06-08 14:28:44 +02:00
vdimir
abce81058e
Add doc aspell 2022-06-08 14:25:56 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
Alexander Tokmakov
1ab5dcae38 fix for aarch64 2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f fix 2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15 fix 2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344 hotfix for minio in functional tests 2022-06-03 20:47:26 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster [2] (#35812) 2022-06-03 15:54:29 +02:00
Kruglov Pavel
ed3bc4328e
Merge pull request #37788 from ClickHouse/Avogar-patch-5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-03 13:09:04 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check 2022-06-02 13:33:27 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3 2022-06-01 12:02:33 +00:00
jinjunzh
1d3ae2d88c fixed unable to find library -ldl in docker build 2022-05-31 17:14:08 -04:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
jinjunzh
822cef10b3 add nasm into more docker configuration 2022-05-30 21:16:06 -04:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
mergify[bot]
df9f7c59a2
Merge branch 'master' into try_fix_tests 2022-05-29 15:04:48 +00:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e500ec5fd8
Update run-fuzzer.sh 2022-05-28 21:25:20 +03:00
Alexander Tokmakov
1ae919a18a Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
This reverts commit 18d094d79d, reversing
changes made to 224f4dc620.
2022-05-28 19:23:58 +02:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
Azat Khuzhin
827e73a2f4 tests/fasttest: simplify waiting of the server
Note, thiat removes "ability to run fasttest locally", but other jobs
cannot do this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
2570136e5e tests/sqlancer: remove superior wait of the server stop
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
d90f21a569 tests/stateful: properly wait the server
v2: fix permissions for /var/run/clickhouse-server?
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
478b03c5cb tests/fuzzer: use "clickhouse stop" to stop the server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
28e0bb78db tests/stateless: properly wait for server
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:

    Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html

So use proper wait via "clickhouse stop"

v2: Fix permissions pid file for replicated database servers
    They do not use default, /var/run/clickhouse-server, that do not have
    proper permissions.

Fixes: #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes
Do computations on the raw input data without copying to Eigen::Matrix
2022-05-24 20:59:04 +02:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test 2022-05-23 10:18:22 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Michael Nutt
e0c14dfc01 fix includes 2022-05-18 20:16:43 -04:00
Mikhail f. Shiryaev
79c30f5e58
Do not fail if output and workspace are the same 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration 2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch 2022-05-16 22:42:09 +02:00