Commit Graph

1899 Commits

Author SHA1 Message Date
tavplubix
dd02106a08
Update run.sh 2021-02-17 12:01:41 +03:00
Alexander Tokmakov
6c9771484b add hung check to stress test 2021-02-16 22:39:25 +03:00
Yatsishin Ilya
61abc27ac3 Merge remote-tracking branch 'origin/master' into integration-2 2021-02-16 17:18:05 +03:00
Yatsishin Ilya
8603855f5f fix 2021-02-16 17:16:15 +03:00
Yatsishin Ilya
e4b3511d28 no more separate compose files for materialize mysql 2021-02-16 10:37:35 +03:00
Alexander Tokmakov
bf6f64a3fb Merge branch 'master' into database_replicated 2021-02-16 01:28:19 +03:00
Alexander Tokmakov
9c7cf9e92e remove some debug code 2021-02-15 13:26:34 +03:00
Yatsishin Ilya
06e1188d9e wip 2021-02-15 12:35:45 +03:00
kssenii
d255b63364 Slightly better 2021-02-12 21:13:01 +00:00
kssenii
b842ce114b Initial sync into ReplacingMergeTree table, select via nested table 2021-02-12 21:11:09 +00:00
Yatsishin Ilya
8aca6e9cd0 update runner 2021-02-12 18:50:52 +03:00
alesapin
5f32f65211 Merge branch 'master' into in_memory_raft 2021-02-11 23:09:29 +03:00
Alexander Kuzmenkov
308fbd2ba5
Update run-fuzzer.sh 2021-02-11 10:45:51 +03:00
Alexander Kuzmenkov
2571dac984
Merge pull request #20111 from ClickHouse/aku/window-prototype
RANGE OFFSET window frame
2021-02-11 10:39:21 +03:00
Ivan
be831d09f7
Update Pytest check (#18972)
* [WIP]

* Update skip-list

* Update ci_config.json

* Do not sync inserts for test

* Fix more tests

* Fix another test

* Enable one more test

* More fixed tests

* More test fixes

* Do not absolutize server path for now

* More test fixes

* Unset CLICKHOUSE_LOG_COMMENT where necessary

* Remove debugging set -e

* Fix more tests

* Fix test reference

* Fix style check
2021-02-10 21:09:13 +03:00
Alexander Kuzmenkov
739990d075 fix fast test 2021-02-10 15:44:07 +03:00
Alexander Kuzmenkov
c18749a704 fix a bug and add some tests 2021-02-09 17:44:04 +03:00
Alexander Tokmakov
5e0cbfe972 Merge branch 'master' into database_replicated 2021-02-08 23:01:12 +03:00
alesapin
d5ee7d33e9 Merge branch 'master' into in_memory_raft 2021-02-08 10:30:31 +03:00
alesapin
6247d59c32 Use fixed version 2021-02-05 18:30:45 +03:00
alesapin
92a4c4e318 Add librdkafka to integration tests runner 2021-02-05 18:28:20 +03:00
alesapin
9c04d912ec Merge branch 'master' into in_memory_raft 2021-02-04 11:50:32 +03:00
Alexey Milovidov
82ab793731 Fix missing type check in StorageEmbeddedRocksDB 2021-02-03 20:35:23 +03:00
Alexander Tokmakov
d010f97db0 Merge branch 'master' into database_replicated 2021-02-03 20:13:25 +03:00
alexey-milovidov
830b0eb36e
Merge pull request #19974 from qoega/kerberized-hdfs-port-clash
Fixed port clash from test_storage_kerberized_hdfs test.
2021-02-03 10:16:14 +03:00
Yatsishin Ilya
19d6e867c6 HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
alesapin
0aca40d8cb Merge branch 'master' into in_memory_raft 2021-02-01 14:30:11 +03:00
robot-clickhouse
cd82eed093 Auto version update to [21.3.1.1] [54448] 2021-02-01 12:50:56 +03:00
Alexey Milovidov
ddd4a7b1b5 Add exception for fast test 2021-01-31 08:33:41 +03:00
Azat Khuzhin
2430551f1c style-check: count stderr as an error too
Since there were precedents
2021-01-29 22:30:56 +03:00
Azat Khuzhin
3001608f2c check-style: fix typo (s/pytest/pylint) in docker image 2021-01-29 22:30:37 +03:00
alesapin
8116d039f9 Merge branch 'master' into in_memory_raft 2021-01-29 18:55:46 +03:00
alesapin
048938effe
Merge pull request #19806 from ClickHouse/dont_run_all_tests_in_parallel
Don't run all stateless tests in parallel
2021-01-29 18:34:56 +03:00
alesapin
941f60a7b5 Temporary retrun dicttoxml to integration tests runner 2021-01-29 16:17:17 +03:00
alesapin
e4f9a4ea65 Merge branch 'master' into in_memory_raft 2021-01-29 15:56:54 +03:00
alesapin
626a23afc7 Fix option 2021-01-29 15:51:10 +03:00
alesapin
bcc3c4193e
Merge pull request #19697 from qoega/easier-macro-xml-generate
No more dicttoxml with excessive logs in integration tests
2021-01-29 12:00:20 +03:00
sundy-li
7083ef45a6 Merge remote-tracking branch 'origin/master' into system-querylog-map 2021-01-29 09:26:02 +08:00
Alexander Kuzmenkov
348bbe85b2
Merge pull request #19715 from ClickHouse/aku/flaky-parallel
Run tests in parallel in flaky check
2021-01-28 19:16:28 +03:00
alexey-milovidov
9f95fd9c62
Merge pull request #19752 from ClickHouse/fuzzer-more-reliable
Make Fuzzer more reliable
2021-01-28 18:06:27 +03:00
alexey-milovidov
77e86901b8
Merge pull request #19751 from azat/docker-lsof
Add missing lsof for fasttest docker image
2021-01-28 12:06:43 +03:00
alesapin
c3db529543 Merge branch 'master' into in_memory_raft 2021-01-28 12:01:54 +03:00
Alexey Milovidov
4c0c2d03fb Make Fuzzer more reliable 2021-01-28 10:22:18 +03:00
Azat Khuzhin
d9ca77d90e Add missing lsof for fasttest docker image 2021-01-28 09:58:35 +03:00
sundyli
77194e4a5d
Merge branch 'master' into system-querylog-map 2021-01-28 09:59:41 +08:00
Alexey Milovidov
442c6d758a Fuzzer: better messages. 2021-01-28 04:09:47 +03:00
Alexander Kuzmenkov
8070562bd0 Run tests in parallel in flaky check 2021-01-27 18:24:39 +03:00
alesapin
dd54e5afe8 Merge branch 'master' into in_memory_raft 2021-01-27 15:32:16 +03:00
alexey-milovidov
3296ad29e2
Merge pull request #19676 from azat/clickhouse-test-fix
clickhouse-test tiny cleanup
2021-01-27 15:12:18 +03:00
Yatsishin Ilya
d21d838604 No more dicttoxml with excessive logs 2021-01-27 12:50:11 +03:00
Azat Khuzhin
93d375f67a Check clickhouse-test with pylint during style check 2021-01-27 00:14:23 +03:00
alesapin
6441d3200b Merge branch 'master' into in_memory_raft 2021-01-26 14:14:39 +03:00
Amos Bird
a2ceca3fa1
Fix recursive propagation 2021-01-26 10:29:12 +08:00
Alexander Tokmakov
3146a1a954 fix 2021-01-25 21:59:23 +03:00
alesapin
46ca832aa1 Enable nuraft in fast test 2021-01-25 18:53:13 +03:00
alesapin
eccd9a29de Build NuRaft even in fast test 2021-01-25 18:32:59 +03:00
alesapin
18fb642e45 Check for hung queries in fast test 2021-01-25 11:53:04 +03:00
sundyli
ddd2233d0c
Merge branch 'master' into system-querylog-map 2021-01-25 16:31:32 +08:00
alexey-milovidov
9e34739b0e
Update run-fuzzer.sh 2021-01-25 05:45:58 +03:00
Alexey Milovidov
716594fc8d Maybe better 2021-01-24 19:42:37 +03:00
Alexey Milovidov
a69911a2dc More diagnostics in fuzzer #19108 2021-01-24 02:59:00 +03:00
Alexey Milovidov
47b4b94cc4 More diagnostics in fuzzer #19108 2021-01-24 00:45:17 +03:00
alexey-milovidov
ab6343ff1f
Merge pull request #19474 from ClickHouse/aes-fix-strange-code
Fix insufficient args check in AES functions
2021-01-23 22:05:01 +03:00
Alexey Milovidov
d1bd4ef793 Merge branch 'master' of github.com:yandex/ClickHouse into blns 2021-01-23 12:08:38 +03:00
sundy-li
685210e02b Merge branch 'master' into system-querylog-map 2021-01-23 11:28:22 +08:00
Alexey Milovidov
6b06fbe791 Fix fast test 2021-01-23 05:43:33 +03:00
alexey-milovidov
feebf64cb1
Merge pull request #19397 from ClickHouse/aes-msan
Fix MSan report in AES functions
2021-01-23 04:47:36 +03:00
Alexey Milovidov
f7db6e10d3 Fix very strange code in AES functions 2021-01-23 02:35:40 +03:00
Alexey Milovidov
4452abf0fc Merge branch 'master' into aes-remove-complications 2021-01-23 02:30:09 +03:00
Alexander Kuzmenkov
6027827974
Update run-fuzzer.sh 2021-01-23 02:05:18 +03:00
Alexey Milovidov
bbe3c54f34 Merge branch 'aes-msan' into aes-remove-complications 2021-01-23 00:48:45 +03:00
alexey-milovidov
819483fd9a
Merge pull request #19396 from ClickHouse/fuzz-limit-memory
Limit max memory usage in fuzz testing
2021-01-22 21:09:25 +03:00
Alexey Milovidov
76ef420d15 Update fast test 2021-01-22 21:05:25 +03:00
alexey-milovidov
136e9652d0
Update query-fuzzer-tweaks-users.xml 2021-01-22 17:16:08 +03:00
Ilya Yatsishin
41a4f54bcc
Update docker/test/fuzzer/query-fuzzer-tweaks-users.xml 2021-01-22 15:36:15 +03:00
Alexander Kuzmenkov
3048fa8414
Update run-fuzzer.sh 2021-01-22 13:21:29 +03:00
Alexander Kuzmenkov
8c0e207c9c
Update run-fuzzer.sh 2021-01-22 13:20:45 +03:00
Ilya Yatsishin
c54c47405b
Merge pull request #19363 from qoega/sqlancer-rename
SQLancer binary changed its name
2021-01-22 12:35:06 +03:00
sundy-li
339133f32a Support Map for OpenTelemetrySpanLog && improve docs update 2021-01-22 13:16:13 +08:00
Alexey Milovidov
af5c3a5034 Limit max memory usage in fuzz testing 2021-01-22 03:13:47 +03:00
Alexander Kuzmenkov
963699d9c8
Update run-fuzzer.sh 2021-01-22 02:26:49 +03:00
Alexander Kuzmenkov
b0fca03d79
Update run-fuzzer.sh 2021-01-22 01:13:48 +03:00
Alexander Kuzmenkov
56687b2d84
Update run.sh 2021-01-21 23:29:01 +03:00
Alexander Kuzmenkov
e9e3314026
Update run-fuzzer.sh 2021-01-21 23:05:35 +03:00
Yatsishin Ilya
a623084eb0 Merge remote-tracking branch 'origin' into sqlancer-rename 2021-01-21 20:36:52 +03:00
Yatsishin Ilya
4ac080b2ca SQLancer binary changed its name 2021-01-21 17:53:28 +03:00
alesapin
fe6b964b32 Revert "Revert "Auto version update to [21.2.1.1] [54446]""
This reverts commit 42f63e14b5.
2021-01-21 12:39:46 +03:00
Alexander Kuzmenkov
7b4d1fba6a
Update run-fuzzer.sh 2021-01-20 20:18:02 +03:00
Alexey Milovidov
ea0052aba5 Fix error in fuzzer 2021-01-20 03:02:58 +03:00
Alexander Kuzmenkov
20dd97b4b4
Update run-fuzzer.sh 2021-01-19 21:02:31 +03:00
Alexander Kuzmenkov
f5931a2289
Merge pull request #19236 from ClickHouse/aku/echo-leading
Make `-- { echo }` hint preserve leading comments
2021-01-19 20:20:58 +03:00
Yatsishin Ilya
a565638129 stop server 2021-01-19 17:37:27 +03:00
Yatsishin Ilya
2e9c27eaf6 fix tar 2021-01-19 14:42:56 +03:00
Yatsishin Ilya
2a924c1186 ls 2021-01-19 13:31:23 +03:00
Yatsishin Ilya
3ae8d37e83 better 2021-01-19 12:48:05 +03:00
Yatsishin Ilya
b32f6cdf10 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-19 11:20:12 +03:00
alexey-milovidov
eabc90075c
Update run-fuzzer.sh 2021-01-18 21:57:45 +03:00
alexey-milovidov
179158ac5a
Update run-fuzzer.sh 2021-01-18 18:24:05 +03:00
Yatsishin Ilya
e590509d67 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-18 17:24:59 +03:00
Alexander Kuzmenkov
c153268da7 Make -- { echo } hint preserve leading comments. 2021-01-18 15:15:46 +03:00
Alexey Milovidov
3289078ead Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-18 14:04:00 +03:00
Alexey Milovidov
2c96fc53f5 Make symbolizers available in fuzzer Docker image 2021-01-17 23:54:00 +03:00
alexey-milovidov
b3d137471e
Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-16 23:56:44 +03:00
Alexey Milovidov
909873b45c Prepare Fuzzer to run with different builds 2021-01-16 23:54:39 +03:00
alexey-milovidov
ea5e7d98a4
Update run-fuzzer.sh 2021-01-16 23:47:01 +03:00
alexey-milovidov
41c77b4775
Update run-fuzzer.sh 2021-01-16 22:01:29 +03:00
alexey-milovidov
b226a4ed4d
Update run-fuzzer.sh 2021-01-16 19:36:08 +03:00
Alexey Milovidov
52a05f4b5d Extreme fuzzing of newly added tests 2021-01-16 18:03:32 +03:00
Alexander Kuzmenkov
1b37d7716f
Update run-fuzzer.sh 2021-01-15 18:06:51 +03:00
Yatsishin Ilya
fd309086c6 add logs to output 2021-01-15 17:36:27 +03:00
Yatsishin Ilya
28b1447738 fix 2021-01-15 16:01:22 +03:00
Yatsishin Ilya
ea1f15f619 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-15 15:25:46 +03:00
Yatsishin Ilya
ea853cea6c fix 2021-01-15 14:03:59 +03:00
alesapin
dfc1e8ef1d Also upload query log 2021-01-15 10:53:37 +03:00
alesapin
cabfa3b7df
Merge pull request #19055 from ClickHouse/more_debug_for_writer
More debug for stateless tests writer
2021-01-15 00:26:42 +03:00
alesapin
b6170c1326 No logs 2021-01-15 00:18:50 +03:00
alesapin
8da81a4791 No errors 2021-01-15 00:15:48 +03:00
alesapin
490326e6b0 Fix symlinks 2021-01-14 19:24:06 +03:00
Yatsishin Ilya
8b2768fbb0 More tests 2021-01-14 18:37:15 +03:00
Mikhail Filimonov
6bec839ab3
Touch dockerfiles to trigger rebuild 2021-01-14 12:46:24 +01:00
alesapin
29685aac3c More debug for stateless tests writer 2021-01-14 13:42:51 +03:00
alexey-milovidov
7d7af00afb
Merge pull request #19015 from nikitamikhaylov/defaults-for-file-engine
Added tests for defaults in URL and File engine
2021-01-14 10:12:27 +03:00
Nikita Mikhailov
3d62d6503b better 2021-01-13 18:34:16 +03:00
Yatsishin Ilya
3f17fac469 Add docker to run SQLancer in CI 2021-01-13 12:49:52 +03:00
Alexey Milovidov
42f63e14b5 Revert "Auto version update to [21.2.1.1] [54446]"
This reverts commit bc2593688e.
2021-01-11 11:32:52 +03:00
robot-clickhouse
bc2593688e Auto version update to [21.2.1.1] [54446] 2021-01-11 11:12:11 +03:00
Alexey Milovidov
c7d4d12f72 Auto version update to [21.1.0] [54445] 2021-01-11 03:51:08 +03:00
alexey-milovidov
fdff71a36f
Merge pull request #18770 from ClickHouse/fix-query-fuzzer
Query Fuzzer: fix some cultural issues
2021-01-06 20:02:30 +03:00
alexey-milovidov
279d6720ec
Update run.sh 2021-01-06 07:20:33 +03:00
alexey-milovidov
b608047fdf
Update run.sh 2021-01-06 07:20:12 +03:00
alexey-milovidov
289c0f1a20
Update Dockerfile 2021-01-06 07:19:48 +03:00
Alexey Milovidov
ad9cd724e0 Merge branch 'master' into random_timezone_for_stateless_tests 2021-01-06 05:45:23 +03:00
Alexey Milovidov
4f726784c9 Fix shellcheck 2021-01-06 04:56:10 +03:00
Alexey Milovidov
b6a733c2dd Do not allow Fuzzer to enable LLVM 2021-01-06 04:07:59 +03:00
Alexey Milovidov
822682f2f8 Fix exit code 2021-01-06 03:56:51 +03:00
Alexey Milovidov
7f074cb491 Remove half of strange code from query fuzzer 2021-01-06 00:20:39 +03:00
Alexey Milovidov
6ecf4fe921 More robust stateful test 2021-01-05 03:02:40 +03:00
Azat Khuzhin
de7909211d Try using top_level_domains from the patched performance archive
If there is top_level_domains list in the upstream/master, use from the
patched version (this is required to run all performance tests for
upstream/master in the PR).
2021-01-02 17:27:03 +03:00
Azat Khuzhin
469b631ca6 Fix performance comparison
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).

But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.

This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.

Cc: @akuzm
2021-01-02 17:09:20 +03:00
Yatsishin Ilya
011d2b4631 disable couple checks for now 2020-12-29 17:57:12 +03:00
Yatsishin Ilya
a25fa1996b fix style checks 2020-12-29 17:57:12 +03:00
alesapin
c9bbde649c
Merge pull request #18312 from ClickHouse/simplier_coverage
Make single image for building coverage report
2020-12-25 10:18:39 +03:00
Yatsishin Ilya
ce1e2b18a3 Fix codespell warnings. Split style checks. Update style checks docker 2020-12-24 13:17:52 +03:00
alesapin
e68bafd508 Merge branch 'master' into simplier_coverage 2020-12-24 12:39:33 +03:00
alesapin
58d0e8901e Remove hardcoded tests 2020-12-23 14:05:59 +03:00
alesapin
41229b8bc9 Run small tests 2020-12-22 14:52:48 +03:00
alesapin
b184141e20 Collect client coverage 2020-12-22 12:22:49 +03:00
alesapin
2d28c8cb60 Better runner 2020-12-22 11:20:57 +03:00
alesapin
b10f13f34a More thread fuzzer 2020-12-21 23:24:16 +03:00
alesapin
8bbb678758 Correctly forward env 2020-12-21 23:12:01 +03:00
alesapin
8f2d4f2d1e Fix user 2020-12-21 18:46:36 +03:00
alesapin
24cb824bfe Simplify coverage images 2020-12-21 15:09:27 +03:00
alesapin
fdf18ceec0 Remove new line 2020-12-21 13:08:06 +03:00
alesapin
643739df6b Trying to enable thread fuzzer in flaky check 2020-12-21 13:06:36 +03:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
Ivan
57763e6867
Enable Pytest framework for stateless tests (#17902) 2020-12-18 16:26:11 +03:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148
HDFS configuration and Kerberos Authenticaiton
2020-12-17 23:16:58 +03:00
Ilya Golshtein
832d99515b tag for yandex/clickhouse-kerberized-hadoop 2020-12-17 12:05:49 +03:00
Alexander Kuzmenkov
170cd132da
Merge pull request #18113 from azat/tld-list-symlink-fix
Avoid using symlinks for top_level_domains
2020-12-16 20:49:43 +03:00
Ilya Golshtein
a5a33f1963 rpm rebuilddb and yum update in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
39877b1a6f yum clean all in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
a4dad0acb7 CentOS 6 became too old 2020-12-16 14:48:33 +03:00
Ilya Golshtein
09d1e89674 yandex/clickhouse-kerberized-hadoop + missed header 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
alesapin
86fc9ea4df Update base image to 20.04 2020-12-15 23:18:53 +03:00
Azat Khuzhin
95c35b318e Avoid using symlinks for top_level_domains
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
2020-12-15 21:58:46 +03:00
alesapin
554fd738e9 Remove strange line 2020-12-15 18:22:21 +03:00
Alexander Kuzmenkov
5f424f7c5c
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 20:08:32 +03:00
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 17:45:58 +03:00
Azat Khuzhin
653ddab63e Remove test_keeper_server in perf tests
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
Azat Khuzhin
6f2c559398 Convert top_level_domains_lists.xml into regular file
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
2020-12-09 21:08:31 +03:00
Azat Khuzhin
8a4b29495b perf: override top_level_domains_path via command line arguments 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922 Add top_level_domains into perf tests
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Alexander Kuzmenkov
fa64d314df
Merge pull request #17907 from azat/perf-tiny-fix
Perf tests fixes
2020-12-09 12:29:57 +03:00
Azat Khuzhin
79e6348282 perf: load overrides last of all 2020-12-09 07:31:54 +03:00
Azat Khuzhin
d33b0ad33b Use interserver_http_port remove=remove over auto-port
Revert "perf: fix port conflict for tcp_with_proxy_port"

This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2 perf: fix port conflict for tcp_with_proxy_port
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Azat Khuzhin
f1ac8775db perf: override config directives via command line over sed by config.xml 2020-12-08 21:25:03 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
alesapin
7c2a04d77d
Merge pull request #17671 from ClickHouse/update_integration_tests_image
Update docker image in integration tests runner
2020-12-04 15:51:08 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Alexey Milovidov
00dc21b0b9 Better tests 2020-12-03 13:02:20 +03:00
alesapin
031ddaedd4 Update docker image in integration tests runner 2020-12-01 14:32:33 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
alesapin
1d179dac22
Merge pull request #17486 from ClickHouse/fix_more_flaky_tests
Fix more flaky integration tests
2020-11-28 10:43:29 +03:00
Alexander Kuzmenkov
8e855dc887
Merge pull request #17460 from azat/perf-tests-settings
Fail queries on unknown settings in perf tests
2020-11-27 22:42:37 +03:00
tavplubix
aaaa7ad59f
Merge pull request #16806 from TCeason/add_test_for_materialize_mysql
add network partition integration test for MaterializeMySQL
2020-11-27 20:39:06 +03:00
alesapin
239ed12458 Better defaults 2020-11-27 14:50:33 +03:00
Azat Khuzhin
3696916f44 perf: add setuptools into docker image (to built clikchouse-driver) 2020-11-27 07:20:41 +03:00
taichong
c8f7a56a25 fix CI timeout err 2020-11-27 11:34:49 +08:00
Azat Khuzhin
b390786a2e Cleanup fasttest/run.sh
- align functions
- align subshells ()
2020-11-27 00:38:49 +03:00
Azat Khuzhin
04a93f18e8 perf: fail on unknown settings 2020-11-27 00:16:41 +03:00
Azat Khuzhin
a591886740 perf: remove outdated comments from perf.py
Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709
2020-11-27 00:16:41 +03:00
Azat Khuzhin
a38628d967 perf: use the latest available clickhouse-driver (from git)
Since later setting_is_important will be used, but there is no release
with this feature included.
2020-11-27 00:16:41 +03:00
Alexander Kuzmenkov
15a0f14445
Merge pull request #15419 from myrrc/improvement/diff-types-in-avg-weighted
Allow different types in avgWeighted. Allow avg and avgWeighed to operate on extended integral types.
2020-11-26 17:16:48 +03:00
Alexander Kuzmenkov
394b81ac46 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-25 23:38:55 +03:00
nikitamikhaylov
f764332070 better merge 2020-11-25 20:51:06 +03:00
Vitaly Baranov
3856ae1a5e Fix PVS Error "Unable to start the analysis on this file" for files
which include protobuf-generates files.
2020-11-24 17:53:34 +03:00
myrrc
fbb0e6e6aa Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov
a543c8e468 Add an option to use existing tables to perf.py 2020-11-23 21:05:54 +03:00
taichong
a6c2a90756 modify integration test materialize mysql database
1. fix asan test err

2. reset pymysql conn if ping err

3. finish mysql & ck killed test

4. modify check_query
2020-11-23 17:55:07 +08:00
alesapin
255c446c5d Merge branch 'random_timezone_for_stateless_tests' of github.com:ClickHouse/ClickHouse into random_timezone_for_stateless_tests 2020-11-23 11:40:14 +03:00
alesapin
4a23c7906d Merge with master 2020-11-23 11:39:40 +03:00
robot-clickhouse
dc19fba36f Auto version update to [20.13.1.1] [54444] 2020-11-23 10:29:26 +03:00
alesapin
9c8b0da382
Merge pull request #16033 from nvartolomei/nv/parts-uuid
Add unique identifiers IMergeTreeDataPart structure
2020-11-22 16:13:19 +03:00
Azat Khuzhin
d676e2f5c5 Pass settings for perf tests via protocol over SET query
Thus they will be applied on reconnects, since clickhouse-driver may
implicitly do it if the connection has been failed.
2020-11-21 14:02:33 +03:00
Azat Khuzhin
3ddb0ac53e Configure logging for perf test runner 2020-11-21 14:02:33 +03:00
Azat Khuzhin
f6d16ee43e Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image 2020-11-21 14:02:33 +03:00
alesapin
78860bf2bd Improvements in coverage images 2020-11-20 11:48:06 +03:00
a.palagashvili
1d09a67e9f empty commit for force run 2020-11-19 23:06:41 +03:00
alesapin
a15b8afa73 Don't add tons of client coverage files in stateful tests with coverage 2020-11-19 19:07:36 +03:00
Nicolae Vartolomei
b6a330de77 Allow running subset of tests in fasttest 2020-11-19 13:18:03 +00:00
a.palagashvili
0c4acef558 added zstd to docker image 2020-11-19 12:23:05 +03:00
Vitaliy Zakaznikov
dbb5f6722e Moving to using TestFlows version 1.6.65
Fixing unstable test in tests/testflows/ldap/external_user_directory/tests/authentications.py
2020-11-17 20:22:43 -05:00
Nikolai Kochetov
86395e11a2
Merge pull request #17006 from azat/fix-distributed-queries-finish
Fix Distributed queries finishing (avoid connection resets)
2020-11-17 11:11:27 +03:00
Alexander Kuzmenkov
b0e660651a cleanup 2020-11-16 19:09:58 +03:00
alesapin
7b784fb925 Fix stateful with coverage test download script 2020-11-16 16:05:00 +03:00
Azat Khuzhin
ed64f2ad67 Add a test for Distributed query finish does not produce any NETWORK_ERROR 2020-11-14 18:35:15 +03:00
Alexander Kuzmenkov
7313691140 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 20:31:17 +03:00
alexey-milovidov
ff29b2d2ee
Merge pull request #15073 from sundy-li/storage-rocksdb
StorageEmbeddedRocksDB
2020-11-12 13:17:58 +03:00
Alexander Kuzmenkov
91f88c79f9 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 11:20:09 +03:00
zhang2014
b13189baec Try fix fasttest submodule clone 2020-11-12 12:45:08 +08:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
a.palagashvili
55d05c95bf fixed style, xz check fasttest skipped, removed fast-lzma2 2020-11-11 15:34:28 +03:00
Alexander Kuzmenkov
f31d7869ac Merge remote-tracking branch 'origin/master' into HEAD 2020-11-11 14:51:35 +03:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
sundy-li
46c01eb7a2 improve unbundle build 2020-11-11 09:08:53 +08:00
sundy-li
fb7066d73d * fix fasttest and cmake && pipline for all_scan
* unique the keys
* add inputstream && outputstream
2020-11-11 09:08:53 +08:00
sundy-li
84dab52e45 skip rocksdb test in fasttest 2020-11-11 09:08:52 +08:00
Danila Kutenin
a489f65c02
Merge branch 'master' into master 2020-11-10 20:16:29 +03:00
alesapin
c0ae61e306 Fix stress test script 2020-11-10 10:33:31 +03:00
Danila Kutenin
5d138f3475 Fix submodules for fast test 2020-11-10 01:31:24 +03:00
Alexander Kuzmenkov
030419db90 Try 12 threads max in perf test.
This will allow us to use more machines, not only Gold 6320.
2020-11-09 19:14:05 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
alexey-milovidov
4e85d6a4c3
Merge pull request #16273 from Avogar/collation-support
Support collate in LowCardinality, Nullable, Array and Tuple, where nested type is String
2020-11-06 21:52:52 +03:00
Alexander Kuzmenkov
dc665d7c43
Update compare.sh 2020-11-06 13:45:42 +03:00
alexey-milovidov
e1a01edf29
Merge pull request #16719 from MyroTk/master
RBAC Testflows - Server log intrumentation for debug and new ALTER tests
2020-11-06 12:40:31 +03:00
Alexander Kuzmenkov
ccf57300eb
Merge pull request #16620 from ClickHouse/aku/perf-upload
Upload perf test results to the CI database
2020-11-05 23:47:29 +03:00
Alexander Kuzmenkov
ac487ab26a
Update compare.sh 2020-11-05 23:45:58 +03:00
robot-clickhouse
f7b7854ace Auto version update to [20.12.1.1] [54443] 2020-11-05 21:52:50 +03:00
MyroTk
02a071e88f RBAC Testflows - Instrumenting server log for debug and new ALTER tests 2020-11-05 17:51:17 +01:00
Alexander Kuzmenkov
9e2d7aa274 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-05 11:34:10 +03:00
Kruglov Pavel
c494f6f5ff
Merge branch 'master' into collation-support 2020-11-05 01:28:30 +03:00
alexey-milovidov
fa929b0312
Replace duplicate development config files with symlinks. (#16486)
* Fix test "max_memory_usage_for_user"

* Update test

* Update annoying boilerplate

* Support symlinks in tarballs

* Fix Fuzzer

* Remove "secondary" user

* Remove "secondary" user
2020-11-04 23:45:06 +03:00
a.palagashvili
ceda5cb9c5 fix codestyle, resolvec conflict 2020-11-04 19:47:04 +03:00
Alexander Kuzmenkov
8d5fe1148c add client config 2020-11-04 18:07:34 +03:00
Alexey Milovidov
5b9d48c715 Remove garbage from docs 2020-11-04 17:39:18 +03:00
Alexander Kuzmenkov
5cb708a50a fixup 2020-11-04 04:19:53 +03:00
alexey-milovidov
8a3f38f332
Merge branch 'master' into errorCode-v2 2020-11-04 01:40:41 +03:00
a.palagashvili
8ecf1d07c1 attempt to update fasttest version 2020-11-04 01:37:05 +03:00
Alexander Kuzmenkov
31ad6c8d48 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-03 17:38:08 +03:00
Alexander Kuzmenkov
4245c470ac fixes 2020-11-03 17:37:54 +03:00
Pavel Kruglov
4d399fff3e Support collation for Array and Tuple 2020-11-03 17:09:37 +03:00
Pavel Kruglov
97a6e3dde2 Skip collate test in fasttest 2020-11-03 17:08:40 +03:00
Alexander Kuzmenkov
268c80520f
Update run-fuzzer.sh 2020-11-03 11:09:14 +03:00
Alexander Kuzmenkov
a25996ed8d Upload perf test results to the CI database 2020-11-03 02:10:19 +03:00
a.palagashvili
8098f86e3e added record for fasttest 2020-11-03 01:05:50 +03:00
Azat Khuzhin
b2e2322895 Add system.errors table
Contains error codes with number of times they have been triggered.

Columns:

-   `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
-   `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
-   `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.

**Example**

``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1

┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │   76 │     1 │
└──────────────────┴──────┴───────┘
2020-10-29 10:55:38 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum
Fix typos reported by codespell
2020-10-28 08:07:18 +03:00
Vitaliy Zakaznikov
d4e640daae Updating TestFlows to 1.6.59
Updating AES encryption requirements.py to include Specification
Updating AES regression.py to link Specification
Fixing typos in LDAP authentication SRS
2020-10-27 18:50:59 -04:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd performance comparison 2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
60db7c2aa5 fix a typo in test name 2020-10-26 19:17:54 +03:00
alesapin
6226377ac3
Merge pull request #16261 from ClickHouse/check_flaky_test
Checking flaky stateless tests
2020-10-26 18:07:36 +03:00
alesapin
1be7a182de
Revert "Revert "Optionally upload clickhouse binary in fast test"" 2020-10-26 14:08:37 +03:00
alesapin
7b456e6663 Merge branch 'check_flaky_test' of github.com:ClickHouse/ClickHouse into check_flaky_test 2020-10-26 09:23:52 +03:00
alesapin
265f84fd88 Merge branch 'master' into check_flaky_test 2020-10-26 09:23:21 +03:00
alexey-milovidov
e00f6c4a0d
Merge branch 'master' into total_memory_tracker-by-default 2020-10-24 21:17:53 +03:00
Nikita Mikhaylov
58b4342998
Merge pull request #15874 from nikitamikhaylov/welch-t-test
Student and Welch t-test
2020-10-24 15:13:12 +03:00
alexey-milovidov
1a1a6350aa
Merge pull request #16285 from sundy-li/cmake-roaring
try use cmake version for croaring instead of amalgamation.sh
2020-10-24 11:07:32 +03:00
alexey-milovidov
0748377ab1
Revert "Optionally upload clickhouse binary in fast test" 2020-10-24 07:59:08 +03:00
alexey-milovidov
fe0f6a9e01
Merge pull request #16288 from ClickHouse/upload_binary_in_fasttest
Optionally upload clickhouse binary in fast test
2020-10-24 07:27:32 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
2020-10-24 02:27:29 +03:00
nikitamikhaylov
0064a75916 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-23 23:06:15 +03:00
Azat Khuzhin
3f594ed3ad Add a test for memory drift in user memory tracker (max_memory_usage_for_user) 2020-10-23 22:13:34 +03:00
Azat Khuzhin
6c42ad564c Add a test for MemoryTracking drift
v2: disable query profiling and logging in 01540_MemoryTracking
    (This should make MemoryTracker drift zero).
2020-10-23 21:11:22 +03:00
alesapin
f0ef7dd1e9 Change default to zero 2020-10-23 16:31:45 +03:00
alesapin
a73a908264 Optionally upload clickhouse binary 2020-10-23 16:31:00 +03:00
Alexander Tokmakov
b29cfa7f82 fix test with uuid 2020-10-23 15:32:57 +03:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Alexander Kuzmenkov
4476117ac6
Merge pull request #15144 from ClickHouse/aku/numa-perf
Perf test: bind server to one NUMA node
2020-10-23 14:10:35 +03:00
Alexander Kuzmenkov
acc5e3906a
Merge pull request #15476 from ClickHouse/aku/fasttest-debug
fix some tests for split build
2020-10-23 14:05:03 +03:00
alesapin
0abb62107a Exclude some tests from flaky check run 2020-10-23 13:18:06 +03:00
alexey-milovidov
121ebfdc81
Merge pull request #16249 from traceon/access-storage-added-log
Add a log message after an access storage is added
2020-10-23 09:17:10 +03:00
Vitaliy Zakaznikov
e743d2fd26 * Fixing tests in the tests/testflows/ldap/external_user_directory/tests/authentications.py suite
* Moving TestFlows runs to use classic output format for stdout
* Moving to TestFlows 1.6.57
* Updating LDAP test code styling
2020-10-22 19:14:58 -04:00
Alexander Kuzmenkov
b77e776db4 fixes 2020-10-22 20:30:50 +03:00
Alexander Kuzmenkov
0275e9c010 work around docker weirdness 2020-10-22 19:42:31 +03:00
alesapin
d91db2473e Fix bash 2020-10-22 17:33:23 +03:00
Alexander Kuzmenkov
ac7af67ede fixup 2020-10-22 15:52:43 +03:00
alesapin
369365bdb0 Fix run.sh 2020-10-21 23:11:35 +03:00
alesapin
dcf9a8cff0 Remove comment 2020-10-21 19:39:39 +03:00
Alexander Kuzmenkov
8cd560d5ad Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 19:13:56 +03:00
Alexander Kuzmenkov
6293d1dbbe Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov
a678f03229 fixup 2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov
c10dada3d4 try node 1 2020-10-21 18:06:42 +03:00
alesapin
ad655bcfc0 Add stateless flaky check 2020-10-21 17:23:45 +03:00
alesapin
a7f989193a Merge branch 'master' into stateless_test_flaky_check 2020-10-21 17:21:25 +03:00
alexey-milovidov
2b00b5391a
Merge pull request #11844 from Enmk/AES_encrypt_decrypt
encrypt and decrypt functions
2020-10-20 22:57:35 +03:00
Alexander Kuzmenkov
7f7e6e809d debug and -Og again 2020-10-20 20:48:55 +03:00
Alexander Kuzmenkov
abcb3c2ff9
Update report.py 2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov
6b0225ab8c
Update README.md 2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov
4080ad3cba Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 15:32:32 +03:00
Alexander Kuzmenkov
242ec7e56c make some tests faster 2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov
c4acb227e4 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 00:44:05 +03:00
nikitamikhaylov
8a39b65fa2 fix build and tests 2020-10-19 19:15:22 +03:00
nikitamikhaylov
7a97329209 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-19 18:54:26 +03:00
Nikita Mikhaylov
846492d7a5
Revert "scipy" 2020-10-19 18:41:57 +03:00
Alexander Kuzmenkov
764f19820b max threads 2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov
38a2dd55ce fix numactl parameters 2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov
1829bd09cb Merge remote-tracking branch 'origin/master' into HEAD 2020-10-19 17:27:36 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets
Minor improvements of stress test
2020-10-19 16:12:30 +03:00
Alexander Kuzmenkov
0c1f8e6018
Merge pull request #16086 from ClickHouse/aku/integration-warnings
remove warnings in integration tests
2020-10-19 15:58:15 +03:00
Vasily Nemkov
4124538b56 Merge remote-tracking branch 'upstream/master' into AES_encrypt_decrypt 2020-10-18 00:00:13 +03:00
Alexander Kuzmenkov
12bb7a05ba
Merge pull request #16034 from ClickHouse/aku/fasttest-improve
Make the Fast Test easier to run locally
2020-10-16 23:29:04 +03:00
tavplubix
eb483fc72f
Update run.sh 2020-10-16 20:31:05 +03:00
Nikita Mikhaylov
650fe9a9c5
Merge pull request #16093 from nikitamikhaylov/fasttest
scipy
2020-10-16 19:53:34 +03:00
nikitamikhaylov
c65a2d638f done 2020-10-16 19:50:35 +03:00
Alexander Kuzmenkov
7581267c01 remove warnings in integration tests 2020-10-16 18:27:45 +03:00
Alexander Kuzmenkov
2241ea9f33 not sure what's going on... 2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov
0825b8f4c2 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-16 17:41:40 +03:00
tavplubix
149c74b2b8
trigger CI 2020-10-15 23:48:10 +03:00
nikitamikhaylov
a80bbf6e0e fasttest + rm .py 2020-10-15 22:54:17 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Alexander Kuzmenkov
f46887dcaa improve fasttest usability 2020-10-15 20:29:07 +03:00
alesapin
e6650ed642 Fix options passing to functional tests scripts 2020-10-15 14:56:12 +03:00
tavplubix
04206db7da
Merge pull request #15974 from ClickHouse/merging_14295
Merging #14295
2020-10-14 23:51:42 +03:00
nikitamikhaylov
b1e1553061 style + docker + tests 2020-10-14 22:43:08 +03:00
nikitamikhaylov
2d29eab934 better 2020-10-14 22:00:20 +03:00
Alexander Kuzmenkov
aafec3d777 fixup 2020-10-14 21:53:35 +03:00
nikitamikhaylov
575354a6d3 add scipy to dockerfile 2020-10-14 21:52:23 +03:00
Alexander Kuzmenkov
c6a30e3b3f fixup 2020-10-14 18:53:14 +03:00
Alexander Kuzmenkov
4f14d40489 Fix server logs in fast test 2020-10-14 17:12:04 +03:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata""
This reverts commit c65d1e5c70.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
robot-clickhouse
554fa482e6 Auto version update to [20.11.1.1] [54442] 2020-10-10 18:39:58 +03:00
nvartolomei
0e4fd5f24b
Use https protocol for llvm repository in fasttest 2020-10-05 16:27:03 +01:00
alesapin
0b67ee8e54 Trying with clang-9 2020-10-05 14:35:23 +03:00
alesapin
a940298eb4 One more fix 2020-10-05 13:54:36 +03:00
alesapin
0c73b3b99f Fix woboq codebrowser image 2020-10-05 13:20:06 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
9bbc962c83 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 19:19:09 +03:00
Alexander Kuzmenkov
72c3ee74e8
Merge pull request #15479 from ClickHouse/aku/docker-shellcheck
Check docker scripts with shellcheck
2020-10-01 18:27:59 +03:00
Alexander Kuzmenkov
13c325597a Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov
74f8e41b55 calculate on all nodes 2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
eb3669e82f more fixes 2020-09-30 20:39:38 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov
c5d1f51f58 just split 2020-09-30 19:14:20 +03:00
Alexander Kuzmenkov
af051ec2d9 fasttest compat with old script 2020-09-30 18:13:53 +03:00
Alexander Kuzmenkov
22a0ec0892 try split debug -Og build in fasttest 2020-09-30 17:55:40 +03:00
Alexander Kuzmenkov
8cfe24ac56 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-30 17:51:52 +03:00
Alexander Kuzmenkov
9194f1d7e5 fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
0516af03ce fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
aa543a2d3d quotes 2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov
2523101302
Merge pull request #15230 from ClickHouse/aku/debug-perf
debug perf test run time
2020-09-30 15:05:32 +03:00
Alexander Kuzmenkov
9f63e882c7 fixup 2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov
1617442242 fixup 2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov
824d5b093c bind everything to node 0 2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov
b1abed7d37 Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-30 14:22:20 +03:00
alesapin
14d9e40408 Merge branch 'master' into random_timezone_for_stateless_tests 2020-09-30 13:30:01 +03:00
Alexander Kuzmenkov
b204bcd4b4 fasttest fixup 2 2020-09-29 23:11:20 +03:00
Alexander Kuzmenkov
f8047102fe fixup 2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov
6062c55569 fasttest fixup 2020-09-29 21:59:45 +03:00
Alexander Kuzmenkov
e943a22d28 allow fast test to run locally 2020-09-29 21:02:44 +03:00
Alexander Kuzmenkov
dc15bceadc Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov
ac4f0cdf22 fix 2020-09-29 14:07:31 +03:00
alesapin
a1f4d38019 Add ability to run tests multiple time in stateless image 2020-09-29 12:44:28 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
Alexander Kuzmenkov
6671b26f20 fixes 2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov
3d1456a55d Merge remote-tracking branch 'origin/master' into HEAD 2020-09-28 21:19:53 +03:00
alesapin
071ff6c9af
Merge pull request #15063 from azat/symbolizers-settings-for-non-server
Set sanitizers options in the current shell too
2020-09-28 17:44:39 +03:00
alesapin
e24c646dd1
bump CI 2020-09-28 17:18:46 +03:00
alesapin
d965199feb Deduplicated code and use random timezone 2020-09-28 15:11:36 +03:00
Alexander Kuzmenkov
c48d212320 performance comparison 2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov
1e7a0f0e5f typo 2020-09-28 14:44:49 +03:00
alesapin
fff9e5d592 Merge branch 'master' into azat-symbolizers-settings-for-non-server 2020-09-28 12:31:05 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Kuzmenkov
425150e783
bind to different nodes 2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov
3ff16325d8 fix the profiler 2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov
40209f9ed2 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-25 11:28:47 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Alexander Kuzmenkov
4ed4205647
Update run.sh 2020-09-24 19:54:09 +03:00
tavplubix
1c9398c5ee
Merge pull request #15215 from ClickHouse/better_image_for_stateless
Better images for CI tests
2020-09-24 18:54:34 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
Alexander Kuzmenkov
651518566a performance comparison 2020-09-24 16:24:44 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
cc305cf886 Fix fuzzer image 2020-09-24 15:34:03 +03:00
Alexander Kuzmenkov
dee34a834f debug perf test run time 2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov
41ad365eaf
Increase fast test threads to 8
Tests don't often fail in parallel (1/10 runs), so we can make them faster.
2020-09-24 14:11:59 +03:00
Alexander Kuzmenkov
26abe8cb30
Update compare.sh 2020-09-24 12:24:30 +03:00
alesapin
4f3eb4532a Add missed changes 2020-09-24 11:37:20 +03:00
alesapin
bb8a2e1617 Better clickhouse-configs 2020-09-24 11:18:36 +03:00
alesapin
a85bb16c66 Remove zookeeper from CI images 2020-09-24 10:33:22 +03:00
Alexander Kuzmenkov
c2b11221a3 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov
21f9cc65c9 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov
179807b0b4 performance comparison 2020-09-23 23:45:39 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh 2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh 2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb Parallel create/fill in perf test 2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
5eaa2a08d4
Update report.py 2020-09-23 10:28:28 +03:00
alesapin
01237170af Fix fast test CMakeOptions 2020-09-22 17:25:48 +03:00
Alexander Kuzmenkov
0b01e62050 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
Alexander Tokmakov
639466afdb fix docker images 2020-09-22 10:45:08 +03:00
Azat Khuzhin
3fd85430f2 Set sanitizers options in the current shell too
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Kuzmenkov
4696e22799
Update perf.py 2020-09-21 22:08:41 +03:00
alexey-milovidov
5e56f14d5f
Merge pull request #15027 from ClickHouse/perf-test-separate-profiler
Separate profile runs in performance test
2020-09-21 21:07:14 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
alesapin
084b40affe
Merge pull request #15069 from ClickHouse/fix_test_images
Use llvm-symbolizer-11 in all test images.
2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov
679c5278e4 reword the diagnostic about short queries in perf test 2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208 fix the conditions 2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c Back to 19.10 2020-09-21 12:05:10 +03:00
alesapin
fd469f1266 Remove redundant file 2020-09-21 10:41:23 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083 Perf test: development 2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6 Calculate profiler data in separate query runs 2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec Remove obsolete code from performance test 2020-09-19 19:27:37 +03:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py 2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py 2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
alesapin
d144421214 Disable lto for glibc-compatibility 2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a Moving to TestFlows version 1.6.46 2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov
bb1d126ce5 Updating TestFlows to 1.6.45 to fix stability issues with multi line commands. 2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014 fixup 2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b faster 2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216 Add a test for DistributedFilesToInsert 2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806 Switch docker tests to use test-base 2020-08-27 13:17:17 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
alexey-milovidov
5d31442fa8
Delete perf.py.orig 2020-08-26 03:26:54 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641 performance comparison 2020-08-24 17:15:11 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775 Add docker test base separately to have :latest build available 2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov
3a0bdfa5f3 Publish list of tests that failed the concurrent fast test 2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e warn on undefined shell variables 2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362 shellcheck 2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627 Avoid timeouts in perf test 2020-08-19 18:08:23 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea Fix server restart in fasttest
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.

Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b Install codespell 2020-08-16 14:59:16 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
Alexey Milovidov
0140093b17 Fix fast test 2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI 2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a Add docker for style check 2020-08-14 16:09:23 +03:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0 fix 2020-08-12 15:22:31 +03:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694 performance comparison 2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180 performance comparison 2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov
7547b850d6 performance comparison 2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e performance comparison 2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a fix 2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371 Auto version update to [20.8.1.1] [54438] 2020-08-07 21:45:49 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov
11727864dd performance comparison 2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov
dbb65a8bd7 performance comparison 2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov
a92438eff2 performance comparison 2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov
88aa371e0c performance comparison 2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec Merge remote-tracking branch 'origin/master' into HEAD 2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a try to rebuild package for 2b7c0167cb 2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov
9cac8a7244 performance comparison 2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov
7945041a9a perf test error summary 2020-08-05 18:56:51 +03:00
alesapin
63391bbb66
Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 17:47:33 +03:00
alesapin
a18461091f
Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill
Better kill in fast test
2020-08-05 17:42:52 +03:00
alesapin
87c56f9556 Symlink for server logs 2020-08-05 16:15:06 +03:00
alesapin
c862ae93d1 Replace backticks with modern alternative 2020-08-05 16:10:47 +03:00
alesapin
68a9499e92 Simplier kill clickhouse server 2020-08-05 15:59:52 +03:00
alesapin
cdad1e718f Better kill in fast test 2020-08-05 15:37:54 +03:00
Vasily Nemkov
baed365c19 Keep original query_masking_rules.xml when performing fasttests 2020-08-05 15:14:20 +03:00
alexey-milovidov
d94e556455
Merge pull request #13321 from ClickHouse/restart_server_with_timeout
Restart server in stress test with timeout
2020-08-05 00:43:45 +03:00
alexey-milovidov
18ef0c0c96
Update run.sh, thanks @azat 2020-08-04 20:54:09 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
b69e6b935b
Wait with retries in fast test (#13284) 2020-08-03 21:05:35 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Azat Khuzhin
8cbcd4027a Exclude 01413_rows_events from the fasttest (TRUNCATE query_log) 2020-08-02 13:30:00 +03:00
Azat Khuzhin
37c3f44dbe fasttest: use arrays for skip list (to make it more patch friendly)
Plus it looks better.
2020-08-02 13:29:31 +03:00
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings
Implement custom settings
2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov
dd475fe82c
Update report.py 2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov
a317f995be performance comparison 2020-07-31 22:58:38 +03:00
Vitaly Baranov
0fcee34322 Add test. 2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
6f861294f4 query fuzzer 2020-07-31 18:57:01 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov
e2e4fc9848 align numbers to the right in perf report 2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh 2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e70e21b58
Update run-fuzzer.sh 2020-07-30 22:04:15 +03:00
Alexander Kuzmenkov
3d13da1c24 query fuzzer 2020-07-30 20:07:10 +03:00
Alexander Kuzmenkov
96125111fe
Merge pull request #13085 from ClickHouse/aku/fuzzer-error-code
Fix the AST fuzzer error message
2020-07-30 19:53:21 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh 2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
f0fda359de pipefail 2020-07-30 16:43:22 +03:00
Alexander Kuzmenkov
b2b94ba13d
Update run-fuzzer.sh 2020-07-30 16:35:24 +03:00
Alexander Kuzmenkov
65771ad516 Fix the AST fuzzer error message 2020-07-29 20:05:38 +03:00
alesapin
5c1aa52f40 Better check for failed tests 2020-07-29 14:39:08 +03:00
alesapin
26ff008898 Remove test 2020-07-29 14:34:42 +03:00
alesapin
3a0d44b5b9 Merge branch 'master' into rerun_failed_in_fast_test 2020-07-29 12:54:18 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
Alexander Kuzmenkov
e0c207d6b4
Update entrypoint.sh 2020-07-28 16:15:41 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
Yatsishin Ilya
7ca2a54e74 fix 2020-07-28 16:08:08 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
alesapin
d39318c8fe Grep in correct file 2020-07-28 14:23:49 +03:00
alesapin
3eb77ab076 Better kill 2020-07-28 14:22:25 +03:00
alesapin
a75657d88e Better 2020-07-28 14:18:08 +03:00
alesapin
8ff9e6c9de Rerun tests in fast test 2020-07-28 14:16:06 +03:00
alesapin
ff358be3d6
Merge pull request #12739 from ClickHouse/qoega-patch-1
Fix MySQL broken link
2020-07-27 19:51:01 +03:00
Alexander Kuzmenkov
b6f2fde37e performance comparison 2020-07-27 14:20:45 +03:00
Ilya Yatsishin
0517449e28
Update docker/test/integration/base/Dockerfile 2020-07-27 13:01:26 +03:00
alexey-milovidov
49beef860d
Merge pull request #12733 from ClickHouse/aku/perf-version
Choose proper old version for perf comparison
2020-07-24 15:24:00 +03:00
Alexander Kuzmenkov
9475b27936
Update run-fuzzer.sh 2020-07-24 00:07:23 +03:00
Ilya Yatsishin
c2e0954f26
Fix MySQL broken link 2020-07-23 22:33:55 +03:00
Alexander Kuzmenkov
acf1e5fe7e Choose proper old version for perf comparison 2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh 2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh 2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
c25348ded9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-22 16:19:20 +03:00
Alexander Kuzmenkov
72167aa746
Update Dockerfile 2020-07-22 16:18:57 +03:00
alesapin
26a6f7993d
Merge pull request #12637 from qoega/helper_container
Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI
2020-07-22 11:50:51 +03:00
Alexander Kuzmenkov
9f49bf2d82 fixup 2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov
9956285091
Update run-fuzzer.sh 2020-07-22 01:02:05 +03:00
Yatsishin Ilya
9633215684 Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI 2020-07-21 17:40:48 +03:00
Alexander Kuzmenkov
b26de8d2d1 Query fuzzer 2020-07-21 16:53:50 +03:00
Alexander Kuzmenkov
3d89f0e9df Perf test: bind server to one NUMA node 2020-07-21 15:41:14 +03:00
alesapin
e7a4bc8dae Even less tests in fasttest 2020-07-20 19:55:36 +03:00
alesapin
619f5f6180 Less tests in fast test 2020-07-20 19:44:48 +03:00
Alexander Kuzmenkov
abec684daf query fuzzer 2020-07-20 14:57:16 +03:00
Alexander Kuzmenkov
37b3cef4cb
Update run-fuzzer.sh 2020-07-17 21:41:33 +03:00
Alexander Kuzmenkov
039cf36acb Minor fixes for query fuzzer 2020-07-16 21:05:34 +03:00
alesapin
a4666df090 Even less tests in fasttest 2020-07-16 14:16:08 +03:00
alesapin
f7ffd2da36 Remove memory limiting tests 2020-07-16 14:12:47 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
f7792d0145
Merge pull request #12294 from ClickHouse/fasttest
Add image for fast tests run (with clone, build, etc.)
2020-07-16 11:21:53 +03:00
alesapin
c86b2a407f
Merge pull request #12526 from Enmk/test_config_fix
Retain existing config.d/query_masking_rules.xml from server package
2020-07-16 11:16:56 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Vitaliy Zakaznikov
0ef9fc9022 Moving to TestFlows version 1.6.39 2020-07-15 22:13:43 +02:00
alesapin
e35c49faa2 Merge branch 'master' into fasttest 2020-07-15 22:35:46 +03:00
alesapin
d6da417e71 Disable live view tests 2020-07-15 22:34:44 +03:00
alexey-milovidov
e7cf3f4e70
Merge pull request #12464 from ianton-ru/s3_profile_events
add profiling events from S3 request to system.events and system.quer…
2020-07-15 19:33:15 +03:00
alesapin
74181a30ae One more test to skip 2020-07-15 17:56:21 +03:00
alesapin
4892706d95 Simplify build configuration 2020-07-15 17:40:51 +03:00
alesapin
54255c10e1
Merge pull request #12496 from ClickHouse/restart_server_after_stress
Check server able to restart after stress
2020-07-15 17:23:27 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Vasily Nemkov
78f69bbfc4 Retain existing config.d/query_masking_rules.xml that come from server package 2020-07-15 16:11:43 +03:00
alesapin
3ab7bdbbbb One more test to skip 2020-07-15 15:16:59 +03:00
alesapin
ba05bb1b39 Better tests for parallel run 2020-07-15 14:47:51 +03:00
Anton Ivashkin
4c8498c115 Merge master 2020-07-15 14:16:10 +03:00
alesapin
530ad951bc Less tests 2020-07-15 12:29:31 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
ecea1e0292 Run tests in parallel 2020-07-15 11:49:50 +03:00
alesapin
00d2219808 Merge branch 'master' into fasttest 2020-07-15 11:35:15 +03:00
alesapin
43ba417132 Better submodules update 2020-07-15 11:34:38 +03:00
alesapin
a31109f023 Better submdoules 2020-07-14 21:44:57 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
Alexander Kuzmenkov
57ad000c62
Update README.md 2020-07-14 16:46:19 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
alesapin
0740b88d6b Merge branch 'master' into fasttest 2020-07-14 15:19:05 +03:00
alesapin
86a6a5e2c6 Less tests to run 2020-07-14 15:17:35 +03:00
robot-clickhouse
0f23642a3d Auto version update to [20.7.1.1] [54437] 2020-07-13 18:26:03 +03:00
Alexander Kuzmenkov
d9ac91b34d query fuzzer 2020-07-13 18:16:54 +03:00
Alexander Kuzmenkov
028abb9dc4 query fuzzer 2020-07-13 16:58:48 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-13 14:29:10 +03:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Pavel Kovalenko
5a42dca252 Trigger integration-test-runner image rebuild. 2020-07-11 12:16:10 +03:00
Pavel Kovalenko
d4826a3df7 Replace build with proper images in docker_compose_minio.yml 2020-07-10 23:38:48 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
alesapin
d69f925c30 Fix build 2020-07-10 22:28:21 +03:00
alesapin
d2fcbe1f4e Fix build 2020-07-10 22:27:12 +03:00
alesapin
69d6ad0a62 Disable bunch of tests 2020-07-10 22:12:25 +03:00
alesapin
a9824fd650 Better cmake and less libraries 2020-07-10 22:08:18 +03:00
alesapin
df176c633e Disable msgpack 2020-07-10 21:27:10 +03:00