Commit Graph

1899 Commits

Author SHA1 Message Date
Yatsishin Ilya
9115fd8cec wip 2021-04-07 15:22:53 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
dc42d5189d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-05 15:36:35 +00:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
Yatsishin Ilya
b395838415 Merge remote-tracking branch 'origin' into integration-2 2021-04-05 09:49:11 +03:00
alesapin
76d0e60e26 Merge branch 'master' into jepsen_for_ci 2021-04-04 16:07:53 +03:00
alexey-milovidov
89db2b1ffc
Merge pull request #22542 from azat/fuzzer-fix
Filter removed/renamed tests from ci-changed-files.txt for fuzzer
2021-04-03 22:05:47 +03:00
Azat Khuzhin
2e8e116d4c Filter removed/renamed tests from ci-changed-files.txt for fuzzer 2021-04-03 12:30:27 +03:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
robot-clickhouse
39b5674bef Auto version update to [21.5.1.1] [54450] 2021-04-02 18:34:29 +03:00
Alexander Kuzmenkov
e7df8893df
Merge pull request #22300 from ClickHouse/trying_parallel_func_tests
Trying parallel func tests
2021-04-02 18:09:58 +03:00
Yatsishin Ilya
9f5a527df7 Merge remote-tracking branch 'origin' into integration-2 2021-04-02 13:34:49 +03:00
alesapin
14a1344c62 Normal tests count 2021-04-02 11:26:10 +03:00
Alexander Kuzmenkov
b9fe91fcff fixup 2021-04-02 00:04:59 +03:00
Alexander Kuzmenkov
db2e9c870f cleanup 2021-04-02 00:04:46 +03:00
Alexander Kuzmenkov
95cd9b0b37 cleanup 2021-04-01 23:28:53 +03:00
Alexander Kuzmenkov
fda70f97c3 not so deep 2021-04-01 21:44:43 +03:00
Alexander Kuzmenkov
8e26998376 fixup 2021-04-01 21:05:09 +03:00
Alexander Kuzmenkov
bd7cc80d4b try clang 11 in fast test 2021-04-01 21:03:06 +03:00
Alexander Kuzmenkov
31c8edf06a disable parallel run for DatabaseReplicated 2021-04-01 20:57:31 +03:00
kssenii
99f0b08ac3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-01 13:48:33 +00:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
7dfcef9846 Add forgotten files 2021-03-31 21:46:07 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
alesapin
1c8717b042 Fix run 2021-03-31 18:19:38 +03:00
Alexander Kuzmenkov
b67f48999c Merge remote-tracking branch 'origin/master' into HEAD 2021-03-31 16:27:19 +03:00
alesapin
2de47d84d8 Some fixes 2021-03-31 15:30:28 +03:00
tavplubix
6c1e2a0d87
Merge pull request #21690 from ClickHouse/test_multiple_nodes
Run three nodes with Replicated database and NuKeeper in CI
2021-03-31 12:31:13 +03:00
alesapin
019d4b3ebd Run with ssh socket 2021-03-31 11:36:23 +03:00
alesapin
7c04b17ed0 Merge branch 'master' into jepsen_for_ci 2021-03-31 11:16:49 +03:00
alexey-milovidov
0c70b06960
Merge branch 'master' into system-querylog-map 2021-03-31 04:54:30 +03:00
alesapin
7172202bf5 More fixes 2021-03-30 23:51:41 +03:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
alesapin
41da6076b1 Json logging 2021-03-30 19:22:20 +03:00
alesapin
45c1ba8c69
Revert "quick fix for broken resolution of apt.llvm.org on Yandex infra" 2021-03-30 19:03:55 +03:00
alesapin
132c2f6f22 Add jepsen docker image 2021-03-30 18:42:53 +03:00
Alexander Tokmakov
500a20f30d Merge branch 'master' into test_multiple_nodes 2021-03-30 16:23:33 +03:00
Alexander Kuzmenkov
0696ed390d
Merge pull request #22181 from ClickHouse/aku/flaky-stateless
less flaky functional tests
2021-03-30 14:40:07 +03:00
Alexander Kuzmenkov
f2325b62f4 Merge remote-tracking branch 'origin/aku/flaky-stateless' into HEAD 2021-03-30 14:04:02 +03:00
Alexander Kuzmenkov
bd5ddf0524 fixes 2021-03-30 13:49:43 +03:00
Alexander Tokmakov
9925110713 rename other occurrances 2021-03-29 23:04:50 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
Alexander Tokmakov
a5b07f2f03 Merge branch 'master' into test_multiple_nodes 2021-03-29 22:43:25 +03:00
Alexander Kuzmenkov
653b930e54 random order in flaky check 2021-03-29 22:12:20 +03:00
Alexander Kuzmenkov
23198059f3 save query log 2021-03-29 22:12:20 +03:00
alesapin
0cb85b9ea8 Trying parallel functional tests one more time 2021-03-29 17:26:48 +03:00
alesapin
a423540452 Merge remote-tracking branch 'origin/aku/flaky-stateless' into trying_parallel_func_tests 2021-03-29 17:25:23 +03:00
Alexander Kuzmenkov
7df765e4b4 save query log 2021-03-29 14:47:57 +03:00
alesapin
be132a32a2 More renames 2021-03-29 11:24:56 +03:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
f141f027f4 Make common class for external storages 2021-03-27 17:12:47 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
Ilya Yatsishin
d01af5e9f8
touch to rebuild 2021-03-26 22:44:40 +03:00
Yatsishin Ilya
322a737051 Merge remote-tracking branch 'origin' into try-llvm-12 2021-03-26 22:27:05 +03:00
Yatsishin Ilya
fb3078a863 Merge remote-tracking branch 'origin' into integration-2 2021-03-26 13:08:39 +03:00
Alexander Kuzmenkov
0675f9403c
Merge pull request #21895 from ClickHouse/aku/laglead
float RANGE OFFSET and lag/lead_in_frame
2021-03-25 23:00:22 +03:00
alexey-milovidov
52396acba1
Merge pull request #22064 from ClickHouse/fix-overflow-aes
Fix missing check in decrypt for AEAD mode
2021-03-25 16:01:44 +03:00
Alexey Milovidov
6341b083fb Add test to skip list 2021-03-24 22:35:22 +03:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
Yatsishin Ilya
7e6cd00cee Try to switch to llvm-12/clang-12 2021-03-24 17:17:59 +03:00
Ilya Yatsishin
4f8e3af0f7
Merge pull request #22015 from qoega/longer-sqlancer-run
Longer SQLancer run
2021-03-24 13:44:14 +03:00
Yatsishin Ilya
21b0f2bf02 Merge remote-tracking branch 'origin' into integration-2 2021-03-24 13:37:56 +03:00
Alexander Kuzmenkov
4c2278c215 Merge pull request #22047 from ClickHouse/aku/llvm-cloudflare-21.3
21.3: quick fix for broken resolution of apt.llvm.org on Yandex infra

(cherry picked from commit 12f5753e5f)
2021-03-23 19:41:09 +03:00
Yatsishin Ilya
af1c14b4ee try other network 2021-03-23 18:42:36 +03:00
Yatsishin Ilya
e79b5b57fd try export dockerd.log 2021-03-23 14:35:45 +03:00
Yatsishin Ilya
c18018ae06 Longer SQLancer run 2021-03-23 07:26:30 +03:00
Alexander Kuzmenkov
b0284f20c3
Merge branch 'master' into aku/laglead 2021-03-22 21:16:27 +03:00
Alexander Kuzmenkov
5ae5134147
Merge pull request #21846 from ClickHouse/aku/perf-test-error
more robust error handling in perf test
2021-03-22 17:18:37 +03:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
alexey-milovidov
0bad6adc48
Merge pull request #21551 from vzakaznikov/testflows_use_yandex_docker_repo
Updating docker/test/testflows/runner/dockerd-entrypoint.sh to use Yandex dockerhub-proxy
2021-03-22 02:27:50 +03:00
kssenii
619f0f51fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-20 09:47:05 +00:00
Yatsishin Ilya
5ae47bd2b4 Merge remote-tracking branch 'origin/master' into integration-2 2021-03-19 15:33:14 +03:00
Alexander Kuzmenkov
1beba597ca Merge remote-tracking branch 'origin/master' into HEAD 2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d float frames and lag/lead_in_frame 2021-03-19 02:05:43 +03:00
Alexander Kuzmenkov
8ab778e26a
Merge pull request #21754 from ClickHouse/aku/fuzzer-ci-sources
make the fuzzer use sources from the CI
2021-03-18 18:02:13 +03:00
Alexander Kuzmenkov
f2ac17cfba
Update compare.sh 2021-03-18 17:59:49 +03:00
Alexander Tokmakov
343b8c906d Merge branch 'master' into test_multiple_nodes 2021-03-18 16:01:04 +03:00
Alexander Tokmakov
fdae70df6c fix tests 2021-03-18 15:50:03 +03:00
Alexander Kuzmenkov
ebd20e6052
Update run-fuzzer.sh 2021-03-18 05:09:38 +03:00
Alexander Kuzmenkov
065faf1318 more robust error handling in perf test 2021-03-18 01:32:55 +03:00
Alexander Kuzmenkov
51cd10c8eb
Update run-fuzzer.sh 2021-03-18 00:22:36 +03:00
Alexander Kuzmenkov
a3c1096fdb
Update run-fuzzer.sh 2021-03-17 21:59:03 +03:00
Alexander Kuzmenkov
5dcddbd468
boop 2021-03-17 19:52:50 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities
Support replicas priority for postgres dictionary source
2021-03-17 16:02:00 +03:00
Alexander Tokmakov
ff79be8af9 fix 2021-03-16 23:01:20 +03:00
Alexander Tokmakov
2d34bbb4b2 Merge branch 'master' into test_multiple_nodes 2021-03-16 21:29:26 +03:00
Alexander Tokmakov
735acf27d8 try run stateful tests 2021-03-16 19:39:31 +03:00
Yatsishin Ilya
579d865aac merge remote-tracking branch 'origin' into integration-2 2021-03-16 13:26:51 +03:00
kssenii
a03e849a8f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-16 10:06:10 +00:00
alexey-milovidov
65d46b54fa
Merge pull request #21673 from vzakaznikov/update_testflows_to_1.6.74
Updating TestFlows to 1.6.74
2021-03-15 22:36:27 +03:00
Alexander Kuzmenkov
a78b234a6d fixes 2021-03-15 21:45:57 +03:00
Alexander Tokmakov
ab07b3b516 Merge branch 'distributed_ddl_improvements' into test_multiple_nodes 2021-03-15 21:22:24 +03:00
Alexander Kuzmenkov
dec1e9eb6f make the fuzzer use sources from the CI 2021-03-15 19:40:48 +03:00
Alexander Tokmakov
d7c43291b1 improve hung check in stress test 2021-03-15 17:23:04 +03:00
kssenii
bd38a7a021 Fix tests 2021-03-15 06:37:07 +00:00
kssenii
8688ae9346 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-14 19:32:21 +00:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Alexander Tokmakov
e62e256e77 fix 2021-03-13 13:22:48 +03:00
Alexander Tokmakov
8e00ff7898 try run two nodes with Replicated db and NuKeeper 2021-03-13 04:25:13 +03:00
Vitaliy Zakaznikov
3269e1d331 Updating TestFlows to 1.6.74 2021-03-12 12:32:32 -05:00
tavplubix
a10c4c9ded
Update Dockerfile 2021-03-12 18:26:35 +03:00
kssenii
571590fcfb Update tests, dockerfile 2021-03-12 09:20:18 +00:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
kssenii
9e0101e5fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-12 07:47:22 +00:00
kssenii
fd4a19bbf8 Update dockerfile and config.d 2021-03-11 21:21:14 +00:00
Vitaliy Zakaznikov
7a26707dbf Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_use_yandex_docker_repo 2021-03-10 07:17:27 -05:00
Maksim Kita
43ba554191
Merge pull request #20595 from kitaisreal/cache-dictionaries-lru-cache
Cache dictionaries lru cache
2021-03-09 19:14:30 +03:00
Vitaliy Zakaznikov
d261777060 Updating docker/test/testflows/runner/dockerd-entrypoint.sh
to configure to use Yandex dockerhub-proxy.
2021-03-09 06:53:14 -05:00
Yatsishin Ilya
7bfa4bb64b Merge remote-tracking branch 'origin' into integration-2 2021-03-09 10:33:15 +03:00
Yatsishin Ilya
e6f90298bb wip 2021-03-09 10:32:10 +03:00
alesapin
b2c12f3762 Upload coordination log after stress test 2021-03-07 17:44:30 +03:00
alesapin
ef192ec310 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-07 10:31:06 +03:00
Nikolai Kochetov
47d684a5c3
Merge pull request #21442 from traceon/row-policy-with-prewhere-perf-test-fix
Adjust prewhere_with_row_level_filter performance test
2021-03-06 22:59:00 +03:00
robot-clickhouse
4e61f45dbb Auto version update to [21.4.1.1] [54449] 2021-03-06 14:43:30 +03:00
Maksim Kita
1628c9b6c4 Fix fast test 2021-03-06 14:36:37 +03:00
Denis Glazachev
6f4e883d8d Factor out settings
Enable parallel insert select
Reduce the amount of data to process
2021-03-06 15:09:45 +04:00
Yatsishin Ilya
534500ef84 wip 2021-03-05 16:39:51 +03:00
alesapin
652c6cdc50 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-05 16:14:37 +03:00
Nikolai Kochetov
a195e783d2 Try fix perftests. 2021-03-04 13:25:49 +03:00
Yatsishin Ilya
4443fd4ba4 Merge remote-tracking branch 'origin' into integration-2 2021-03-04 12:10:18 +03:00
alesapin
76e10a4fb1 Missed files for tests 2021-03-03 23:05:33 +03:00
Alexander Kuzmenkov
f169be740a
Merge pull request #21381 from ClickHouse/aku/perf-negative
fix a rare false negative in perf tests
2021-03-03 15:55:14 +03:00
Nikolai Kochetov
019513d869 Try fix perftests. 2021-03-03 13:42:44 +03:00
Yatsishin Ilya
babea212c7 Merge remote-tracking branch 'origin' into integration-2 2021-03-03 11:56:15 +03:00
Alexander Kuzmenkov
08148e062f Fix a rare false negative in perf tests 2021-03-02 19:21:30 +03:00
kssenii
a3c7402200 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-02 07:07:56 +00:00
alexey-milovidov
467fcbec06
Merge pull request #21292 from ClickHouse/extract-text-from-html
Rewrite extractTextFromHTML function
2021-02-28 16:36:18 +03:00
Alexey Milovidov
107d8ec811 Merge branch 'master' into extract-text-from-html 2021-02-28 04:03:32 +03:00
alexey-milovidov
9f0400f015
Merge pull request #21171 from azat/tests-bump-zookeeper
Bump zookeeper version to 3.6.2 in tests
2021-02-28 02:35:58 +03:00
alexey-milovidov
b8fba768e5
Merge pull request #21264 from ClickHouse/fix_zookeeper_update
Fix several bugs with ZooKeeper client
2021-02-28 01:57:04 +03:00
Alexey Milovidov
fd1cf49e92 Rewrite extractTextFromHTML function 2021-02-27 22:22:38 +03:00
Alexander Tokmakov
fb42dec355 fix 2021-02-27 01:20:49 +03:00
Azat Khuzhin
bc1a316b28 Bump zookeeper version to 3.6.2 in tests
3.4.12 was released 1.05.2018
2021-02-26 23:41:43 +03:00
alesapin
a48bb7e3a0 Fix redundant zookeeper reconnect and possibility of multiple zookeeper session for a single ClickHouse server 2021-02-26 22:05:25 +03:00
Alexander Tokmakov
5ee1ec5bed move more code 2021-02-26 15:58:13 +03:00
Alexander Tokmakov
422e083c96 move more code 2021-02-26 14:43:58 +03:00
alesapin
56d9d99d1c Fix style and bayan 2021-02-26 09:59:40 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
alesapin
84102a22e7 Trying to make testkeeper better in single server mode 2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Yatsishin Ilya
de20de8a2f Merge remote-tracking branch 'origin' into integration-2 2021-02-25 12:53:49 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Yatsishin Ilya
7c61f6c957 Merge remote-tracking branch 'origin' into integration-2 2021-02-24 15:42:20 +03:00
alesapin
5b888e1193 Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-22 23:52:26 +03:00
Alexey Milovidov
c46c300e9d Merge branch 'master' into random_timezone_for_stateless_tests 2021-02-22 19:07:26 +03:00
tavplubix
72b67c07c4
trigger CI 2021-02-22 17:43:06 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
kssenii
4cdb55babe Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-22 12:39:35 +00:00
Azat Khuzhin
91c4ebaf0b Merge remote-tracking branch 'upstream/master' into yamllint 2021-02-22 08:52:54 +03:00
alexey-milovidov
e1c4ba0169
Merge pull request #21016 from azat/integration-test_materialize_mysql_database
Preserve mysql logs in test_materialize_mysql_database
2021-02-21 22:28:19 +03:00
Azat Khuzhin
9a26409147 Fix performance tests (by avoid sharding status file for right and left server)
Since cp -al (hard links):

    2021.02.21 01:09:09.991771 [ 243 ] {} <Information> StatusFile: Status file right/db/status already exists - unclean restart. Contents:
    PID: 241
    Started at: 2021-02-21 01:09:09
    Revision: 54448

    2021.02.21 01:09:09.992007 [ 243 ] {} <Error> Application: DB::Exception: Cannot lock file right/db/status. Another server instance in same directory is already running.
2021-02-21 10:56:48 +03:00
Azat Khuzhin
e922690453 Fix yamllint issues 2021-02-20 23:25:21 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
Azat Khuzhin
e1bc8bb587 Wrap lines in Dockerfile for style image 2021-02-20 22:20:52 +03:00
Azat Khuzhin
d909adc8b9 Add yamllint into style docker image 2021-02-20 22:20:52 +03:00
Azat Khuzhin
4784d09d17 tests/integration: increase verbosity for test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Azat Khuzhin
6873ad1983 tests/integration: fix yamllint issues in docker-compose.yaml for mysql 2021-02-20 22:09:01 +03:00
kssenii
d590c32708 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-20 18:31:26 +00:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
Alexander Tokmakov
6d9990f378 Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results 2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81 fix 2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f Merge branch 'master' into stress_test_results 2021-02-20 16:22:43 +03:00
Alexander Tokmakov
863c099254 fix 2021-02-20 15:57:07 +03:00
alesapin
c61769311e Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-20 10:22:22 +03:00
alesapin
a860e3e758
Merge pull request #20864 from azat/fasttest-backtrace-on-failure
Improve backtrace catching on server failures in CI for fast-tests
2021-02-20 10:20:56 +03:00
tavplubix
f5fc082ed0
Update run.sh 2021-02-19 22:39:42 +03:00
Yatsishin Ilya
65a55b1010 Merge remote-tracking branch 'origin' into integration-2 2021-02-19 20:07:16 +03:00
tavplubix
3509fe88d8
Merge pull request #20878 from ClickHouse/fix_18926
Fix COM_FIELD_LIST response in MySQL protocol
2021-02-19 19:25:54 +03:00
kssenii
79d5b40a99 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-19 16:02:31 +00:00
Yatsishin Ilya
d45cab4228 wip 2021-02-19 17:42:43 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
alexey-milovidov
ceacae4ee4
Merge pull request #20462 from azat/stress-backtrace-on-failure
Improve backtrace catching on server failures in CI for stress tests
2021-02-19 17:33:29 +03:00
alesapin
068c9cfbf7 Fix logs level 2021-02-19 17:13:29 +03:00
alesapin
ea27c3ca32 Add gdb to fasttest image 2021-02-19 16:41:46 +03:00
Yatsishin Ilya
ee955038c1 wip 2021-02-19 15:58:11 +03:00
kssenii
1c5b10de41 Use fixed version for aerospike 2021-02-19 10:42:25 +00:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
kssenii
f7a191712f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-19 09:49:50 +00:00
Alexander Tokmakov
afed8a8192 process stress test results 2021-02-19 01:08:44 +03:00
Yatsishin Ilya
2df4317aba wip 2021-02-19 00:21:50 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Alexander Tokmakov
1bad1e3a7c fix dockerfile 2021-02-18 17:37:51 +03:00
Alexander Tokmakov
97f4c457ec fix MySQL COMM_FIELD_LIST response 2021-02-18 16:27:51 +03:00
Yatsishin Ilya
872e36c207 wip 2021-02-18 15:57:45 +03:00
alesapin
1245710aed Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-18 15:27:01 +03:00
zlx19950903
c92e613b82
Add a function htmlOrXmlCoarseParse to extract content from html or xml format string. (#19600)
* add html and xml coarse parse

* add test file

* add conditional check: hyperscan

* fix style error

* add conditional check

* bug fix

* delete unit

* typos check fix

* add unit test

* style check fix

* fix build error: case style

* acradis_skip test fix

* LINT error fix

* Remove comments

Co-authored-by: guojiantao <guojiantao15@mails.ucas.ac.cn>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
Co-authored-by: Ivan Lezhankin <ilezhankin@yandex-team.ru>
2021-02-18 15:05:55 +03:00
alesapin
abe5d9df1e
Merge pull request #20627 from ClickHouse/fix_fast_test_retry
Fix fasttest retry for failed tests
2021-02-18 11:41:21 +03:00
Vitaly Baranov
3cbb325913
Merge pull request #20506 from vitlibar/refactor-protobuf-format-io
Improved serialization in Protobuf format.
2021-02-18 11:31:37 +03:00
Alexey Milovidov
0d2d2dc2ed Merge branch 'master' into sundy-li/system-querylog-map 2021-02-18 00:47:54 +03:00
Azat Khuzhin
ee18f6a7ec test/fasttest: collect diagnosis by attaching with gdb in background
Otherwise sometimes stacktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/20477/8ad20fcee5aaa642c2a2dd873d02103692d554f4/fast_test.html#fail1
2021-02-18 00:14:00 +03:00
Azat Khuzhin
65f2b6a044 test/fasttest: add gdb into docker image 2021-02-18 00:14:00 +03:00
Azat Khuzhin
770c3406df test/stress: fix permissions for clickhouse directories 2021-02-18 00:13:03 +03:00
Azat Khuzhin
63eff6e8c8 test/stress: improve backtrace catching on server failures
Otherwise sometimes stracktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/19580/6aecb62416ece880cbb8ee3a803e14d841388dde/stress_test_(thread).html#fail1
2021-02-18 00:13:03 +03:00
Azat Khuzhin
f483cd091a test/stress: use clickhouse builtin start/stop to run server from the same user
This will allow to attach with gdb for better diagnosis.
2021-02-18 00:13:03 +03:00
kssenii
e2973e6b49 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-17 19:11:39 +00:00
Vitaly Baranov
18e036d19b Improved serialization for data types combined of Arrays and Tuples.
Improved matching enum data types to protobuf enum type.
Fixed serialization of the Map data type.
Omitted values are now set by default.
2021-02-17 20:50:09 +03:00
Yatsishin Ilya
677528326f postgres 2021-02-17 18:40:01 +03:00
alesapin
bb4ced05f9 Fix fast test 2021-02-17 17:52:32 +03:00
alesapin
e0980fd0b7 Fix fasttest retry for failed tests 2021-02-17 17:41:21 +03:00
tavplubix
dd02106a08
Update run.sh 2021-02-17 12:01:41 +03:00
Alexander Tokmakov
6c9771484b add hung check to stress test 2021-02-16 22:39:25 +03:00
Yatsishin Ilya
61abc27ac3 Merge remote-tracking branch 'origin/master' into integration-2 2021-02-16 17:18:05 +03:00
Yatsishin Ilya
8603855f5f fix 2021-02-16 17:16:15 +03:00
Yatsishin Ilya
e4b3511d28 no more separate compose files for materialize mysql 2021-02-16 10:37:35 +03:00
Alexander Tokmakov
bf6f64a3fb Merge branch 'master' into database_replicated 2021-02-16 01:28:19 +03:00
Alexander Tokmakov
9c7cf9e92e remove some debug code 2021-02-15 13:26:34 +03:00
Yatsishin Ilya
06e1188d9e wip 2021-02-15 12:35:45 +03:00
kssenii
d255b63364 Slightly better 2021-02-12 21:13:01 +00:00
kssenii
b842ce114b Initial sync into ReplacingMergeTree table, select via nested table 2021-02-12 21:11:09 +00:00
Yatsishin Ilya
8aca6e9cd0 update runner 2021-02-12 18:50:52 +03:00
alesapin
5f32f65211 Merge branch 'master' into in_memory_raft 2021-02-11 23:09:29 +03:00
Alexander Kuzmenkov
308fbd2ba5
Update run-fuzzer.sh 2021-02-11 10:45:51 +03:00
Alexander Kuzmenkov
2571dac984
Merge pull request #20111 from ClickHouse/aku/window-prototype
RANGE OFFSET window frame
2021-02-11 10:39:21 +03:00
Ivan
be831d09f7
Update Pytest check (#18972)
* [WIP]

* Update skip-list

* Update ci_config.json

* Do not sync inserts for test

* Fix more tests

* Fix another test

* Enable one more test

* More fixed tests

* More test fixes

* Do not absolutize server path for now

* More test fixes

* Unset CLICKHOUSE_LOG_COMMENT where necessary

* Remove debugging set -e

* Fix more tests

* Fix test reference

* Fix style check
2021-02-10 21:09:13 +03:00
Alexander Kuzmenkov
739990d075 fix fast test 2021-02-10 15:44:07 +03:00
Alexander Kuzmenkov
c18749a704 fix a bug and add some tests 2021-02-09 17:44:04 +03:00
Alexander Tokmakov
5e0cbfe972 Merge branch 'master' into database_replicated 2021-02-08 23:01:12 +03:00
alesapin
d5ee7d33e9 Merge branch 'master' into in_memory_raft 2021-02-08 10:30:31 +03:00
alesapin
6247d59c32 Use fixed version 2021-02-05 18:30:45 +03:00
alesapin
92a4c4e318 Add librdkafka to integration tests runner 2021-02-05 18:28:20 +03:00
alesapin
9c04d912ec Merge branch 'master' into in_memory_raft 2021-02-04 11:50:32 +03:00
Alexey Milovidov
82ab793731 Fix missing type check in StorageEmbeddedRocksDB 2021-02-03 20:35:23 +03:00
Alexander Tokmakov
d010f97db0 Merge branch 'master' into database_replicated 2021-02-03 20:13:25 +03:00
alexey-milovidov
830b0eb36e
Merge pull request #19974 from qoega/kerberized-hdfs-port-clash
Fixed port clash from test_storage_kerberized_hdfs test.
2021-02-03 10:16:14 +03:00
Yatsishin Ilya
19d6e867c6 HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
alesapin
0aca40d8cb Merge branch 'master' into in_memory_raft 2021-02-01 14:30:11 +03:00
robot-clickhouse
cd82eed093 Auto version update to [21.3.1.1] [54448] 2021-02-01 12:50:56 +03:00
Alexey Milovidov
ddd4a7b1b5 Add exception for fast test 2021-01-31 08:33:41 +03:00
Azat Khuzhin
2430551f1c style-check: count stderr as an error too
Since there were precedents
2021-01-29 22:30:56 +03:00
Azat Khuzhin
3001608f2c check-style: fix typo (s/pytest/pylint) in docker image 2021-01-29 22:30:37 +03:00
alesapin
8116d039f9 Merge branch 'master' into in_memory_raft 2021-01-29 18:55:46 +03:00
alesapin
048938effe
Merge pull request #19806 from ClickHouse/dont_run_all_tests_in_parallel
Don't run all stateless tests in parallel
2021-01-29 18:34:56 +03:00
alesapin
941f60a7b5 Temporary retrun dicttoxml to integration tests runner 2021-01-29 16:17:17 +03:00
alesapin
e4f9a4ea65 Merge branch 'master' into in_memory_raft 2021-01-29 15:56:54 +03:00
alesapin
626a23afc7 Fix option 2021-01-29 15:51:10 +03:00
alesapin
bcc3c4193e
Merge pull request #19697 from qoega/easier-macro-xml-generate
No more dicttoxml with excessive logs in integration tests
2021-01-29 12:00:20 +03:00
sundy-li
7083ef45a6 Merge remote-tracking branch 'origin/master' into system-querylog-map 2021-01-29 09:26:02 +08:00
Alexander Kuzmenkov
348bbe85b2
Merge pull request #19715 from ClickHouse/aku/flaky-parallel
Run tests in parallel in flaky check
2021-01-28 19:16:28 +03:00
alexey-milovidov
9f95fd9c62
Merge pull request #19752 from ClickHouse/fuzzer-more-reliable
Make Fuzzer more reliable
2021-01-28 18:06:27 +03:00
alexey-milovidov
77e86901b8
Merge pull request #19751 from azat/docker-lsof
Add missing lsof for fasttest docker image
2021-01-28 12:06:43 +03:00
alesapin
c3db529543 Merge branch 'master' into in_memory_raft 2021-01-28 12:01:54 +03:00
Alexey Milovidov
4c0c2d03fb Make Fuzzer more reliable 2021-01-28 10:22:18 +03:00
Azat Khuzhin
d9ca77d90e Add missing lsof for fasttest docker image 2021-01-28 09:58:35 +03:00
sundyli
77194e4a5d
Merge branch 'master' into system-querylog-map 2021-01-28 09:59:41 +08:00
Alexey Milovidov
442c6d758a Fuzzer: better messages. 2021-01-28 04:09:47 +03:00
Alexander Kuzmenkov
8070562bd0 Run tests in parallel in flaky check 2021-01-27 18:24:39 +03:00
alesapin
dd54e5afe8 Merge branch 'master' into in_memory_raft 2021-01-27 15:32:16 +03:00
alexey-milovidov
3296ad29e2
Merge pull request #19676 from azat/clickhouse-test-fix
clickhouse-test tiny cleanup
2021-01-27 15:12:18 +03:00
Yatsishin Ilya
d21d838604 No more dicttoxml with excessive logs 2021-01-27 12:50:11 +03:00
Azat Khuzhin
93d375f67a Check clickhouse-test with pylint during style check 2021-01-27 00:14:23 +03:00
alesapin
6441d3200b Merge branch 'master' into in_memory_raft 2021-01-26 14:14:39 +03:00
Amos Bird
a2ceca3fa1
Fix recursive propagation 2021-01-26 10:29:12 +08:00
Alexander Tokmakov
3146a1a954 fix 2021-01-25 21:59:23 +03:00
alesapin
46ca832aa1 Enable nuraft in fast test 2021-01-25 18:53:13 +03:00
alesapin
eccd9a29de Build NuRaft even in fast test 2021-01-25 18:32:59 +03:00
alesapin
18fb642e45 Check for hung queries in fast test 2021-01-25 11:53:04 +03:00
sundyli
ddd2233d0c
Merge branch 'master' into system-querylog-map 2021-01-25 16:31:32 +08:00
alexey-milovidov
9e34739b0e
Update run-fuzzer.sh 2021-01-25 05:45:58 +03:00
Alexey Milovidov
716594fc8d Maybe better 2021-01-24 19:42:37 +03:00
Alexey Milovidov
a69911a2dc More diagnostics in fuzzer #19108 2021-01-24 02:59:00 +03:00
Alexey Milovidov
47b4b94cc4 More diagnostics in fuzzer #19108 2021-01-24 00:45:17 +03:00
alexey-milovidov
ab6343ff1f
Merge pull request #19474 from ClickHouse/aes-fix-strange-code
Fix insufficient args check in AES functions
2021-01-23 22:05:01 +03:00
Alexey Milovidov
d1bd4ef793 Merge branch 'master' of github.com:yandex/ClickHouse into blns 2021-01-23 12:08:38 +03:00
sundy-li
685210e02b Merge branch 'master' into system-querylog-map 2021-01-23 11:28:22 +08:00
Alexey Milovidov
6b06fbe791 Fix fast test 2021-01-23 05:43:33 +03:00
alexey-milovidov
feebf64cb1
Merge pull request #19397 from ClickHouse/aes-msan
Fix MSan report in AES functions
2021-01-23 04:47:36 +03:00
Alexey Milovidov
f7db6e10d3 Fix very strange code in AES functions 2021-01-23 02:35:40 +03:00
Alexey Milovidov
4452abf0fc Merge branch 'master' into aes-remove-complications 2021-01-23 02:30:09 +03:00
Alexander Kuzmenkov
6027827974
Update run-fuzzer.sh 2021-01-23 02:05:18 +03:00
Alexey Milovidov
bbe3c54f34 Merge branch 'aes-msan' into aes-remove-complications 2021-01-23 00:48:45 +03:00
alexey-milovidov
819483fd9a
Merge pull request #19396 from ClickHouse/fuzz-limit-memory
Limit max memory usage in fuzz testing
2021-01-22 21:09:25 +03:00
Alexey Milovidov
76ef420d15 Update fast test 2021-01-22 21:05:25 +03:00
alexey-milovidov
136e9652d0
Update query-fuzzer-tweaks-users.xml 2021-01-22 17:16:08 +03:00
Ilya Yatsishin
41a4f54bcc
Update docker/test/fuzzer/query-fuzzer-tweaks-users.xml 2021-01-22 15:36:15 +03:00
Alexander Kuzmenkov
3048fa8414
Update run-fuzzer.sh 2021-01-22 13:21:29 +03:00
Alexander Kuzmenkov
8c0e207c9c
Update run-fuzzer.sh 2021-01-22 13:20:45 +03:00
Ilya Yatsishin
c54c47405b
Merge pull request #19363 from qoega/sqlancer-rename
SQLancer binary changed its name
2021-01-22 12:35:06 +03:00
sundy-li
339133f32a Support Map for OpenTelemetrySpanLog && improve docs update 2021-01-22 13:16:13 +08:00
Alexey Milovidov
af5c3a5034 Limit max memory usage in fuzz testing 2021-01-22 03:13:47 +03:00
Alexander Kuzmenkov
963699d9c8
Update run-fuzzer.sh 2021-01-22 02:26:49 +03:00
Alexander Kuzmenkov
b0fca03d79
Update run-fuzzer.sh 2021-01-22 01:13:48 +03:00
Alexander Kuzmenkov
56687b2d84
Update run.sh 2021-01-21 23:29:01 +03:00
Alexander Kuzmenkov
e9e3314026
Update run-fuzzer.sh 2021-01-21 23:05:35 +03:00
Yatsishin Ilya
a623084eb0 Merge remote-tracking branch 'origin' into sqlancer-rename 2021-01-21 20:36:52 +03:00
Yatsishin Ilya
4ac080b2ca SQLancer binary changed its name 2021-01-21 17:53:28 +03:00
alesapin
fe6b964b32 Revert "Revert "Auto version update to [21.2.1.1] [54446]""
This reverts commit 42f63e14b5.
2021-01-21 12:39:46 +03:00
Alexander Kuzmenkov
7b4d1fba6a
Update run-fuzzer.sh 2021-01-20 20:18:02 +03:00
Alexey Milovidov
ea0052aba5 Fix error in fuzzer 2021-01-20 03:02:58 +03:00
Alexander Kuzmenkov
20dd97b4b4
Update run-fuzzer.sh 2021-01-19 21:02:31 +03:00
Alexander Kuzmenkov
f5931a2289
Merge pull request #19236 from ClickHouse/aku/echo-leading
Make `-- { echo }` hint preserve leading comments
2021-01-19 20:20:58 +03:00
Yatsishin Ilya
a565638129 stop server 2021-01-19 17:37:27 +03:00
Yatsishin Ilya
2e9c27eaf6 fix tar 2021-01-19 14:42:56 +03:00
Yatsishin Ilya
2a924c1186 ls 2021-01-19 13:31:23 +03:00
Yatsishin Ilya
3ae8d37e83 better 2021-01-19 12:48:05 +03:00
Yatsishin Ilya
b32f6cdf10 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-19 11:20:12 +03:00
alexey-milovidov
eabc90075c
Update run-fuzzer.sh 2021-01-18 21:57:45 +03:00
alexey-milovidov
179158ac5a
Update run-fuzzer.sh 2021-01-18 18:24:05 +03:00
Yatsishin Ilya
e590509d67 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-18 17:24:59 +03:00
Alexander Kuzmenkov
c153268da7 Make -- { echo } hint preserve leading comments. 2021-01-18 15:15:46 +03:00
Alexey Milovidov
3289078ead Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-18 14:04:00 +03:00
Alexey Milovidov
2c96fc53f5 Make symbolizers available in fuzzer Docker image 2021-01-17 23:54:00 +03:00
alexey-milovidov
b3d137471e
Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-16 23:56:44 +03:00
Alexey Milovidov
909873b45c Prepare Fuzzer to run with different builds 2021-01-16 23:54:39 +03:00
alexey-milovidov
ea5e7d98a4
Update run-fuzzer.sh 2021-01-16 23:47:01 +03:00
alexey-milovidov
41c77b4775
Update run-fuzzer.sh 2021-01-16 22:01:29 +03:00
alexey-milovidov
b226a4ed4d
Update run-fuzzer.sh 2021-01-16 19:36:08 +03:00
Alexey Milovidov
52a05f4b5d Extreme fuzzing of newly added tests 2021-01-16 18:03:32 +03:00
Alexander Kuzmenkov
1b37d7716f
Update run-fuzzer.sh 2021-01-15 18:06:51 +03:00
Yatsishin Ilya
fd309086c6 add logs to output 2021-01-15 17:36:27 +03:00
Yatsishin Ilya
28b1447738 fix 2021-01-15 16:01:22 +03:00
Yatsishin Ilya
ea1f15f619 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-15 15:25:46 +03:00
Yatsishin Ilya
ea853cea6c fix 2021-01-15 14:03:59 +03:00
alesapin
dfc1e8ef1d Also upload query log 2021-01-15 10:53:37 +03:00
alesapin
cabfa3b7df
Merge pull request #19055 from ClickHouse/more_debug_for_writer
More debug for stateless tests writer
2021-01-15 00:26:42 +03:00
alesapin
b6170c1326 No logs 2021-01-15 00:18:50 +03:00
alesapin
8da81a4791 No errors 2021-01-15 00:15:48 +03:00
alesapin
490326e6b0 Fix symlinks 2021-01-14 19:24:06 +03:00
Yatsishin Ilya
8b2768fbb0 More tests 2021-01-14 18:37:15 +03:00
Mikhail Filimonov
6bec839ab3
Touch dockerfiles to trigger rebuild 2021-01-14 12:46:24 +01:00
alesapin
29685aac3c More debug for stateless tests writer 2021-01-14 13:42:51 +03:00
alexey-milovidov
7d7af00afb
Merge pull request #19015 from nikitamikhaylov/defaults-for-file-engine
Added tests for defaults in URL and File engine
2021-01-14 10:12:27 +03:00
Nikita Mikhailov
3d62d6503b better 2021-01-13 18:34:16 +03:00
Yatsishin Ilya
3f17fac469 Add docker to run SQLancer in CI 2021-01-13 12:49:52 +03:00
Alexey Milovidov
42f63e14b5 Revert "Auto version update to [21.2.1.1] [54446]"
This reverts commit bc2593688e.
2021-01-11 11:32:52 +03:00
robot-clickhouse
bc2593688e Auto version update to [21.2.1.1] [54446] 2021-01-11 11:12:11 +03:00
Alexey Milovidov
c7d4d12f72 Auto version update to [21.1.0] [54445] 2021-01-11 03:51:08 +03:00
alexey-milovidov
fdff71a36f
Merge pull request #18770 from ClickHouse/fix-query-fuzzer
Query Fuzzer: fix some cultural issues
2021-01-06 20:02:30 +03:00
alexey-milovidov
279d6720ec
Update run.sh 2021-01-06 07:20:33 +03:00
alexey-milovidov
b608047fdf
Update run.sh 2021-01-06 07:20:12 +03:00
alexey-milovidov
289c0f1a20
Update Dockerfile 2021-01-06 07:19:48 +03:00
Alexey Milovidov
ad9cd724e0 Merge branch 'master' into random_timezone_for_stateless_tests 2021-01-06 05:45:23 +03:00
Alexey Milovidov
4f726784c9 Fix shellcheck 2021-01-06 04:56:10 +03:00
Alexey Milovidov
b6a733c2dd Do not allow Fuzzer to enable LLVM 2021-01-06 04:07:59 +03:00
Alexey Milovidov
822682f2f8 Fix exit code 2021-01-06 03:56:51 +03:00
Alexey Milovidov
7f074cb491 Remove half of strange code from query fuzzer 2021-01-06 00:20:39 +03:00
Alexey Milovidov
6ecf4fe921 More robust stateful test 2021-01-05 03:02:40 +03:00
Azat Khuzhin
de7909211d Try using top_level_domains from the patched performance archive
If there is top_level_domains list in the upstream/master, use from the
patched version (this is required to run all performance tests for
upstream/master in the PR).
2021-01-02 17:27:03 +03:00
Azat Khuzhin
469b631ca6 Fix performance comparison
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).

But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.

This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.

Cc: @akuzm
2021-01-02 17:09:20 +03:00
Yatsishin Ilya
011d2b4631 disable couple checks for now 2020-12-29 17:57:12 +03:00
Yatsishin Ilya
a25fa1996b fix style checks 2020-12-29 17:57:12 +03:00
alesapin
c9bbde649c
Merge pull request #18312 from ClickHouse/simplier_coverage
Make single image for building coverage report
2020-12-25 10:18:39 +03:00
Yatsishin Ilya
ce1e2b18a3 Fix codespell warnings. Split style checks. Update style checks docker 2020-12-24 13:17:52 +03:00
alesapin
e68bafd508 Merge branch 'master' into simplier_coverage 2020-12-24 12:39:33 +03:00
alesapin
58d0e8901e Remove hardcoded tests 2020-12-23 14:05:59 +03:00
alesapin
41229b8bc9 Run small tests 2020-12-22 14:52:48 +03:00
alesapin
b184141e20 Collect client coverage 2020-12-22 12:22:49 +03:00
alesapin
2d28c8cb60 Better runner 2020-12-22 11:20:57 +03:00
alesapin
b10f13f34a More thread fuzzer 2020-12-21 23:24:16 +03:00
alesapin
8bbb678758 Correctly forward env 2020-12-21 23:12:01 +03:00
alesapin
8f2d4f2d1e Fix user 2020-12-21 18:46:36 +03:00
alesapin
24cb824bfe Simplify coverage images 2020-12-21 15:09:27 +03:00
alesapin
fdf18ceec0 Remove new line 2020-12-21 13:08:06 +03:00
alesapin
643739df6b Trying to enable thread fuzzer in flaky check 2020-12-21 13:06:36 +03:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
Ivan
57763e6867
Enable Pytest framework for stateless tests (#17902) 2020-12-18 16:26:11 +03:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148
HDFS configuration and Kerberos Authenticaiton
2020-12-17 23:16:58 +03:00
Ilya Golshtein
832d99515b tag for yandex/clickhouse-kerberized-hadoop 2020-12-17 12:05:49 +03:00
Alexander Kuzmenkov
170cd132da
Merge pull request #18113 from azat/tld-list-symlink-fix
Avoid using symlinks for top_level_domains
2020-12-16 20:49:43 +03:00
Ilya Golshtein
a5a33f1963 rpm rebuilddb and yum update in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
39877b1a6f yum clean all in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
a4dad0acb7 CentOS 6 became too old 2020-12-16 14:48:33 +03:00
Ilya Golshtein
09d1e89674 yandex/clickhouse-kerberized-hadoop + missed header 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
alesapin
86fc9ea4df Update base image to 20.04 2020-12-15 23:18:53 +03:00
Azat Khuzhin
95c35b318e Avoid using symlinks for top_level_domains
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
2020-12-15 21:58:46 +03:00
alesapin
554fd738e9 Remove strange line 2020-12-15 18:22:21 +03:00
Alexander Kuzmenkov
5f424f7c5c
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 20:08:32 +03:00
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 17:45:58 +03:00
Azat Khuzhin
653ddab63e Remove test_keeper_server in perf tests
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
Azat Khuzhin
6f2c559398 Convert top_level_domains_lists.xml into regular file
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
2020-12-09 21:08:31 +03:00
Azat Khuzhin
8a4b29495b perf: override top_level_domains_path via command line arguments 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922 Add top_level_domains into perf tests
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Alexander Kuzmenkov
fa64d314df
Merge pull request #17907 from azat/perf-tiny-fix
Perf tests fixes
2020-12-09 12:29:57 +03:00
Azat Khuzhin
79e6348282 perf: load overrides last of all 2020-12-09 07:31:54 +03:00
Azat Khuzhin
d33b0ad33b Use interserver_http_port remove=remove over auto-port
Revert "perf: fix port conflict for tcp_with_proxy_port"

This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2 perf: fix port conflict for tcp_with_proxy_port
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Azat Khuzhin
f1ac8775db perf: override config directives via command line over sed by config.xml 2020-12-08 21:25:03 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
alesapin
7c2a04d77d
Merge pull request #17671 from ClickHouse/update_integration_tests_image
Update docker image in integration tests runner
2020-12-04 15:51:08 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Alexey Milovidov
00dc21b0b9 Better tests 2020-12-03 13:02:20 +03:00
alesapin
031ddaedd4 Update docker image in integration tests runner 2020-12-01 14:32:33 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
alesapin
1d179dac22
Merge pull request #17486 from ClickHouse/fix_more_flaky_tests
Fix more flaky integration tests
2020-11-28 10:43:29 +03:00
Alexander Kuzmenkov
8e855dc887
Merge pull request #17460 from azat/perf-tests-settings
Fail queries on unknown settings in perf tests
2020-11-27 22:42:37 +03:00
tavplubix
aaaa7ad59f
Merge pull request #16806 from TCeason/add_test_for_materialize_mysql
add network partition integration test for MaterializeMySQL
2020-11-27 20:39:06 +03:00
alesapin
239ed12458 Better defaults 2020-11-27 14:50:33 +03:00
Azat Khuzhin
3696916f44 perf: add setuptools into docker image (to built clikchouse-driver) 2020-11-27 07:20:41 +03:00
taichong
c8f7a56a25 fix CI timeout err 2020-11-27 11:34:49 +08:00
Azat Khuzhin
b390786a2e Cleanup fasttest/run.sh
- align functions
- align subshells ()
2020-11-27 00:38:49 +03:00
Azat Khuzhin
04a93f18e8 perf: fail on unknown settings 2020-11-27 00:16:41 +03:00
Azat Khuzhin
a591886740 perf: remove outdated comments from perf.py
Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709
2020-11-27 00:16:41 +03:00
Azat Khuzhin
a38628d967 perf: use the latest available clickhouse-driver (from git)
Since later setting_is_important will be used, but there is no release
with this feature included.
2020-11-27 00:16:41 +03:00
Alexander Kuzmenkov
15a0f14445
Merge pull request #15419 from myrrc/improvement/diff-types-in-avg-weighted
Allow different types in avgWeighted. Allow avg and avgWeighed to operate on extended integral types.
2020-11-26 17:16:48 +03:00
Alexander Kuzmenkov
394b81ac46 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-25 23:38:55 +03:00
nikitamikhaylov
f764332070 better merge 2020-11-25 20:51:06 +03:00
Vitaly Baranov
3856ae1a5e Fix PVS Error "Unable to start the analysis on this file" for files
which include protobuf-generates files.
2020-11-24 17:53:34 +03:00
myrrc
fbb0e6e6aa Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov
a543c8e468 Add an option to use existing tables to perf.py 2020-11-23 21:05:54 +03:00
taichong
a6c2a90756 modify integration test materialize mysql database
1. fix asan test err

2. reset pymysql conn if ping err

3. finish mysql & ck killed test

4. modify check_query
2020-11-23 17:55:07 +08:00
alesapin
255c446c5d Merge branch 'random_timezone_for_stateless_tests' of github.com:ClickHouse/ClickHouse into random_timezone_for_stateless_tests 2020-11-23 11:40:14 +03:00
alesapin
4a23c7906d Merge with master 2020-11-23 11:39:40 +03:00
robot-clickhouse
dc19fba36f Auto version update to [20.13.1.1] [54444] 2020-11-23 10:29:26 +03:00
alesapin
9c8b0da382
Merge pull request #16033 from nvartolomei/nv/parts-uuid
Add unique identifiers IMergeTreeDataPart structure
2020-11-22 16:13:19 +03:00
Azat Khuzhin
d676e2f5c5 Pass settings for perf tests via protocol over SET query
Thus they will be applied on reconnects, since clickhouse-driver may
implicitly do it if the connection has been failed.
2020-11-21 14:02:33 +03:00
Azat Khuzhin
3ddb0ac53e Configure logging for perf test runner 2020-11-21 14:02:33 +03:00
Azat Khuzhin
f6d16ee43e Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image 2020-11-21 14:02:33 +03:00
alesapin
78860bf2bd Improvements in coverage images 2020-11-20 11:48:06 +03:00
a.palagashvili
1d09a67e9f empty commit for force run 2020-11-19 23:06:41 +03:00
alesapin
a15b8afa73 Don't add tons of client coverage files in stateful tests with coverage 2020-11-19 19:07:36 +03:00
Nicolae Vartolomei
b6a330de77 Allow running subset of tests in fasttest 2020-11-19 13:18:03 +00:00
a.palagashvili
0c4acef558 added zstd to docker image 2020-11-19 12:23:05 +03:00
Vitaliy Zakaznikov
dbb5f6722e Moving to using TestFlows version 1.6.65
Fixing unstable test in tests/testflows/ldap/external_user_directory/tests/authentications.py
2020-11-17 20:22:43 -05:00
Nikolai Kochetov
86395e11a2
Merge pull request #17006 from azat/fix-distributed-queries-finish
Fix Distributed queries finishing (avoid connection resets)
2020-11-17 11:11:27 +03:00
Alexander Kuzmenkov
b0e660651a cleanup 2020-11-16 19:09:58 +03:00
alesapin
7b784fb925 Fix stateful with coverage test download script 2020-11-16 16:05:00 +03:00
Azat Khuzhin
ed64f2ad67 Add a test for Distributed query finish does not produce any NETWORK_ERROR 2020-11-14 18:35:15 +03:00
Alexander Kuzmenkov
7313691140 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 20:31:17 +03:00
alexey-milovidov
ff29b2d2ee
Merge pull request #15073 from sundy-li/storage-rocksdb
StorageEmbeddedRocksDB
2020-11-12 13:17:58 +03:00
Alexander Kuzmenkov
91f88c79f9 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 11:20:09 +03:00
zhang2014
b13189baec Try fix fasttest submodule clone 2020-11-12 12:45:08 +08:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
a.palagashvili
55d05c95bf fixed style, xz check fasttest skipped, removed fast-lzma2 2020-11-11 15:34:28 +03:00
Alexander Kuzmenkov
f31d7869ac Merge remote-tracking branch 'origin/master' into HEAD 2020-11-11 14:51:35 +03:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
sundy-li
46c01eb7a2 improve unbundle build 2020-11-11 09:08:53 +08:00
sundy-li
fb7066d73d * fix fasttest and cmake && pipline for all_scan
* unique the keys
* add inputstream && outputstream
2020-11-11 09:08:53 +08:00
sundy-li
84dab52e45 skip rocksdb test in fasttest 2020-11-11 09:08:52 +08:00
Danila Kutenin
a489f65c02
Merge branch 'master' into master 2020-11-10 20:16:29 +03:00
alesapin
c0ae61e306 Fix stress test script 2020-11-10 10:33:31 +03:00
Danila Kutenin
5d138f3475 Fix submodules for fast test 2020-11-10 01:31:24 +03:00
Alexander Kuzmenkov
030419db90 Try 12 threads max in perf test.
This will allow us to use more machines, not only Gold 6320.
2020-11-09 19:14:05 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
alexey-milovidov
4e85d6a4c3
Merge pull request #16273 from Avogar/collation-support
Support collate in LowCardinality, Nullable, Array and Tuple, where nested type is String
2020-11-06 21:52:52 +03:00
Alexander Kuzmenkov
dc665d7c43
Update compare.sh 2020-11-06 13:45:42 +03:00
alexey-milovidov
e1a01edf29
Merge pull request #16719 from MyroTk/master
RBAC Testflows - Server log intrumentation for debug and new ALTER tests
2020-11-06 12:40:31 +03:00
Alexander Kuzmenkov
ccf57300eb
Merge pull request #16620 from ClickHouse/aku/perf-upload
Upload perf test results to the CI database
2020-11-05 23:47:29 +03:00
Alexander Kuzmenkov
ac487ab26a
Update compare.sh 2020-11-05 23:45:58 +03:00
robot-clickhouse
f7b7854ace Auto version update to [20.12.1.1] [54443] 2020-11-05 21:52:50 +03:00
MyroTk
02a071e88f RBAC Testflows - Instrumenting server log for debug and new ALTER tests 2020-11-05 17:51:17 +01:00
Alexander Kuzmenkov
9e2d7aa274 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-05 11:34:10 +03:00
Kruglov Pavel
c494f6f5ff
Merge branch 'master' into collation-support 2020-11-05 01:28:30 +03:00
alexey-milovidov
fa929b0312
Replace duplicate development config files with symlinks. (#16486)
* Fix test "max_memory_usage_for_user"

* Update test

* Update annoying boilerplate

* Support symlinks in tarballs

* Fix Fuzzer

* Remove "secondary" user

* Remove "secondary" user
2020-11-04 23:45:06 +03:00
a.palagashvili
ceda5cb9c5 fix codestyle, resolvec conflict 2020-11-04 19:47:04 +03:00
Alexander Kuzmenkov
8d5fe1148c add client config 2020-11-04 18:07:34 +03:00
Alexey Milovidov
5b9d48c715 Remove garbage from docs 2020-11-04 17:39:18 +03:00
Alexander Kuzmenkov
5cb708a50a fixup 2020-11-04 04:19:53 +03:00
alexey-milovidov
8a3f38f332
Merge branch 'master' into errorCode-v2 2020-11-04 01:40:41 +03:00
a.palagashvili
8ecf1d07c1 attempt to update fasttest version 2020-11-04 01:37:05 +03:00
Alexander Kuzmenkov
31ad6c8d48 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-03 17:38:08 +03:00
Alexander Kuzmenkov
4245c470ac fixes 2020-11-03 17:37:54 +03:00
Pavel Kruglov
4d399fff3e Support collation for Array and Tuple 2020-11-03 17:09:37 +03:00
Pavel Kruglov
97a6e3dde2 Skip collate test in fasttest 2020-11-03 17:08:40 +03:00
Alexander Kuzmenkov
268c80520f
Update run-fuzzer.sh 2020-11-03 11:09:14 +03:00
Alexander Kuzmenkov
a25996ed8d Upload perf test results to the CI database 2020-11-03 02:10:19 +03:00
a.palagashvili
8098f86e3e added record for fasttest 2020-11-03 01:05:50 +03:00
Azat Khuzhin
b2e2322895 Add system.errors table
Contains error codes with number of times they have been triggered.

Columns:

-   `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
-   `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
-   `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.

**Example**

``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1

┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │   76 │     1 │
└──────────────────┴──────┴───────┘
2020-10-29 10:55:38 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum
Fix typos reported by codespell
2020-10-28 08:07:18 +03:00
Vitaliy Zakaznikov
d4e640daae Updating TestFlows to 1.6.59
Updating AES encryption requirements.py to include Specification
Updating AES regression.py to link Specification
Fixing typos in LDAP authentication SRS
2020-10-27 18:50:59 -04:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd performance comparison 2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
60db7c2aa5 fix a typo in test name 2020-10-26 19:17:54 +03:00
alesapin
6226377ac3
Merge pull request #16261 from ClickHouse/check_flaky_test
Checking flaky stateless tests
2020-10-26 18:07:36 +03:00
alesapin
1be7a182de
Revert "Revert "Optionally upload clickhouse binary in fast test"" 2020-10-26 14:08:37 +03:00
alesapin
7b456e6663 Merge branch 'check_flaky_test' of github.com:ClickHouse/ClickHouse into check_flaky_test 2020-10-26 09:23:52 +03:00
alesapin
265f84fd88 Merge branch 'master' into check_flaky_test 2020-10-26 09:23:21 +03:00
alexey-milovidov
e00f6c4a0d
Merge branch 'master' into total_memory_tracker-by-default 2020-10-24 21:17:53 +03:00
Nikita Mikhaylov
58b4342998
Merge pull request #15874 from nikitamikhaylov/welch-t-test
Student and Welch t-test
2020-10-24 15:13:12 +03:00
alexey-milovidov
1a1a6350aa
Merge pull request #16285 from sundy-li/cmake-roaring
try use cmake version for croaring instead of amalgamation.sh
2020-10-24 11:07:32 +03:00
alexey-milovidov
0748377ab1
Revert "Optionally upload clickhouse binary in fast test" 2020-10-24 07:59:08 +03:00
alexey-milovidov
fe0f6a9e01
Merge pull request #16288 from ClickHouse/upload_binary_in_fasttest
Optionally upload clickhouse binary in fast test
2020-10-24 07:27:32 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
2020-10-24 02:27:29 +03:00
nikitamikhaylov
0064a75916 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-23 23:06:15 +03:00
Azat Khuzhin
3f594ed3ad Add a test for memory drift in user memory tracker (max_memory_usage_for_user) 2020-10-23 22:13:34 +03:00
Azat Khuzhin
6c42ad564c Add a test for MemoryTracking drift
v2: disable query profiling and logging in 01540_MemoryTracking
    (This should make MemoryTracker drift zero).
2020-10-23 21:11:22 +03:00
alesapin
f0ef7dd1e9 Change default to zero 2020-10-23 16:31:45 +03:00
alesapin
a73a908264 Optionally upload clickhouse binary 2020-10-23 16:31:00 +03:00
Alexander Tokmakov
b29cfa7f82 fix test with uuid 2020-10-23 15:32:57 +03:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Alexander Kuzmenkov
4476117ac6
Merge pull request #15144 from ClickHouse/aku/numa-perf
Perf test: bind server to one NUMA node
2020-10-23 14:10:35 +03:00
Alexander Kuzmenkov
acc5e3906a
Merge pull request #15476 from ClickHouse/aku/fasttest-debug
fix some tests for split build
2020-10-23 14:05:03 +03:00
alesapin
0abb62107a Exclude some tests from flaky check run 2020-10-23 13:18:06 +03:00
alexey-milovidov
121ebfdc81
Merge pull request #16249 from traceon/access-storage-added-log
Add a log message after an access storage is added
2020-10-23 09:17:10 +03:00
Vitaliy Zakaznikov
e743d2fd26 * Fixing tests in the tests/testflows/ldap/external_user_directory/tests/authentications.py suite
* Moving TestFlows runs to use classic output format for stdout
* Moving to TestFlows 1.6.57
* Updating LDAP test code styling
2020-10-22 19:14:58 -04:00
Alexander Kuzmenkov
b77e776db4 fixes 2020-10-22 20:30:50 +03:00
Alexander Kuzmenkov
0275e9c010 work around docker weirdness 2020-10-22 19:42:31 +03:00
alesapin
d91db2473e Fix bash 2020-10-22 17:33:23 +03:00