Commit Graph

324 Commits

Author SHA1 Message Date
Azat Khuzhin
2cf931e08b clickhouse-test: add missing whitespace before printing database on error 2021-04-30 21:30:02 +03:00
Azat Khuzhin
56774f9c49 clickhouse-test: print database name on failures
Useful for debugging, i.e. to distingiush test failures for flaky check
2021-04-22 22:30:01 +03:00
Alexander Tokmakov
51d2932fe8 print errors on db creation in clickhouse-test 2021-04-19 14:03:20 +03:00
alexey-milovidov
e1e2f534e8
Merge pull request #22646 from azat/clickhouse-test-log-comment
Add log_comment setting for DROP/CREATE DATABASE in clickhouse-test
2021-04-06 14:48:04 +03:00
Azat Khuzhin
624b2632cc Add log_comment setting for DROP/CREATE DATABASE in clickhouse-test 2021-04-05 06:58:54 +03:00
Alexey Milovidov
1bd4febfd5 Better retries on ZK errors in sh tests 2021-04-05 05:17:17 +03:00
Alexander Kuzmenkov
b67f48999c Merge remote-tracking branch 'origin/master' into HEAD 2021-03-31 16:27:19 +03:00
tavplubix
049019bdb2
Update clickhouse-test 2021-03-30 20:27:58 +03:00
Alexander Tokmakov
500a20f30d Merge branch 'master' into test_multiple_nodes 2021-03-30 16:23:33 +03:00
Alexander Kuzmenkov
f2325b62f4 Merge remote-tracking branch 'origin/aku/flaky-stateless' into HEAD 2021-03-30 14:04:02 +03:00
Alexander Kuzmenkov
27635fd381 create two batches per process in clickhouse-test 2021-03-30 14:03:00 +03:00
Alexander Kuzmenkov
6bd483f9d4 individual tmp dir matching the database for each test run 2021-03-30 03:39:33 +03:00
Alexander Kuzmenkov
58987a973d flush 2021-03-30 01:42:37 +03:00
Alexander Kuzmenkov
47cc8938f9 faster 2021-03-29 22:12:20 +03:00
Alexander Kuzmenkov
2b7d2fab82 less flaky functional tests 2021-03-29 22:12:20 +03:00
Alexander Kuzmenkov
72f8b42d63 more info 2021-03-29 21:19:13 +03:00
Alexander Kuzmenkov
112cd107aa print elapsed time per test group 2021-03-29 21:14:06 +03:00
Alexander Kuzmenkov
fe2a364e09 faster 2021-03-29 19:26:50 +03:00
Alexander Kuzmenkov
0dfd091011 less flaky functional tests 2021-03-26 19:40:26 +03:00
Alexander Tokmakov
fdae70df6c fix tests 2021-03-18 15:50:03 +03:00
Alexander Tokmakov
735acf27d8 try run stateful tests 2021-03-16 19:39:31 +03:00
Alexander Tokmakov
ab07b3b516 Merge branch 'distributed_ddl_improvements' into test_multiple_nodes 2021-03-15 21:22:24 +03:00
alexey-milovidov
c9f14052bc
Merge pull request #21700 from azat/clickhouse-test-fix-log-comment
Fix log_comment for *.sh in clickhouse-test
2021-03-14 12:29:57 +03:00
Azat Khuzhin
334520557c Fix log_comment for *.sh in clickhouse-test
setdefault will set it only once
2021-03-13 18:15:16 +03:00
Alexander Tokmakov
e62e256e77 fix 2021-03-13 13:22:48 +03:00
Azat Khuzhin
eb3710c164 Fix error message in clickhouse-test
{} was not replaced:

    Cannot get server pid with {}, got {}: {} lsof -i tcp:9000 -s tcp:LISTEN -Fp | awk '/^p[0-9]+$/{print substr($0, 2)}' b'306\n1025011\n' invalid literal for int() with base 10: b'306\n1025011\n'
2021-03-13 08:43:41 +03:00
Alexander Tokmakov
8e00ff7898 try run two nodes with Replicated db and NuKeeper 2021-03-13 04:25:13 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
Alexander Tokmakov
9c7cf9e92e remove some debug code 2021-02-15 13:26:34 +03:00
Alexander Tokmakov
5e0cbfe972 Merge branch 'master' into database_replicated 2021-02-08 23:01:12 +03:00
Alexander Kuzmenkov
858043cd53 detect unmarked long tests in flaky check 2021-02-04 15:06:48 +03:00
Alexander Tokmakov
d010f97db0 Merge branch 'master' into database_replicated 2021-02-03 20:13:25 +03:00
Alexander Tokmakov
9da445e740 execute initial query in the same thread 2021-02-01 22:29:47 +03:00
Alexey Milovidov
feeb1243ec Fix Python 2021-01-29 06:26:53 +03:00
Alexey Milovidov
93f58257e4 Fix mistake 2021-01-29 04:45:24 +03:00
Alexey Milovidov
d6e34deeee Fix Python 2021-01-29 03:53:21 +03:00
Alexey Milovidov
a121a5250b Add log comment when running .sh tests 2021-01-28 20:31:34 +03:00
Alexander Kuzmenkov
348bbe85b2
Merge pull request #19715 from ClickHouse/aku/flaky-parallel
Run tests in parallel in flaky check
2021-01-28 19:16:28 +03:00
alesapin
879adc5437 Add new line to status 2021-01-28 11:55:20 +03:00
Alexander Kuzmenkov
f4f66e9537 try to use predictable names for stdout/err when possible 2021-01-27 21:37:28 +03:00
Alexander Kuzmenkov
8070562bd0 Run tests in parallel in flaky check 2021-01-27 18:24:39 +03:00
Azat Khuzhin
1ef38148ac Fix all pylint warnings in clickhouse-test 2021-01-26 23:36:04 +03:00
Azat Khuzhin
c4454ab095 Fix colored() usage in clickhouse-test 2021-01-26 23:23:00 +03:00
Alexander Tokmakov
f20d5e3b41 fix 2021-01-26 20:51:25 +03:00
Alexey Milovidov
9f8ab99dd1 Use log_comment in clickhouse-test 2021-01-25 22:29:29 +03:00
alesapin
18fb642e45 Check for hung queries in fast test 2021-01-25 11:53:04 +03:00
Alexander Kuzmenkov
eb7b87ee8d update tests 2021-01-21 21:01:32 +03:00
Alexander Kuzmenkov
ec8ff21526 Reconnect after client errors 2021-01-21 17:28:46 +03:00
Alexander Kuzmenkov
33b941b216 not sure why it doesn't like my f-strings 2021-01-20 10:01:26 +03:00
Alexander Kuzmenkov
107d83b654 Avoid mixing output from parallel test runs.
Also mark some tests as sequential-only.
2021-01-20 08:31:41 +03:00
Alexander Kuzmenkov
d0922e2985 Merge remote-tracking branch 'origin/master' into tmp 2021-01-18 23:23:49 +03:00
Alexey Milovidov
897d51b6e7 Usability improvement of clickhouse-test 2021-01-18 14:38:44 +03:00
Alexander Kuzmenkov
9d6730a846 small fixes 2021-01-16 00:33:53 +03:00
Ivan
35d62b73a7
Check for CLICKHOUSE_CLIENT_OPT env before setting it (#18574) 2020-12-28 18:47:44 +03:00
Ivan
ff80c1f3ce
Move --antlr arg outside of parser group 2020-12-25 15:59:02 +03:00
Ivan
5fd6f260ac
Add support for ANTLR inside clickhouse-test (#18319) 2020-12-22 15:24:46 +03:00
Alexey Milovidov
e6ab6badf9 Fix clickhouse-test 2020-12-22 00:03:41 +03:00
alesapin
ce2028e3ce Fix clickhouse-test 2020-12-21 14:19:12 +03:00
alesapin
30c98adde4 Fix local variable in clickhouse-test 2020-12-17 23:13:49 +03:00
alesapin
d873439846
Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel
Collect list of non-parallel test
2020-12-16 19:29:32 +03:00
alesapin
2e4aa6b9e1 Kill not only database proc 2020-12-15 19:20:09 +03:00
alesapin
873d9d1e1e Better 2020-12-15 16:34:53 +03:00
alesapin
9bb0326fc6 Fix database drop timeout in clickhouse-test 2020-12-15 16:33:14 +03:00
alesapin
b68aa1c76d Merge branch 'master' into run_func_tests_in_parallel 2020-12-03 17:22:09 +03:00
myrrc
9ca35c0b44 Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-10-30 17:22:24 +03:00
alesapin
362b2c1cb2 Merge branch 'master' into run_func_tests_in_parallel 2020-10-28 14:12:45 +03:00
tavplubix
381af53d4a
Update clickhouse-test 2020-10-27 11:44:58 +03:00
myrrc
4d11bd036b Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-10-26 17:42:47 +03:00
alesapin
df4620b7bd Merge branch 'master' into run_func_tests_in_parallel 2020-10-20 17:15:56 +03:00
Alexander Kuzmenkov
f46887dcaa improve fasttest usability 2020-10-15 20:29:07 +03:00
myrrc
8e7e232387 wip dealing with template magic 2020-10-15 13:36:00 +03:00
myrrc
d48114b79a Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-10-12 14:17:44 +03:00
myrrc
09862fb1ba typo 2020-10-12 14:17:35 +03:00
alesapin
2b66180c70 Merge branch 'master' into run_func_tests_in_parallel 2020-10-09 10:25:35 +03:00
Anton Popov
e0bc669423 run check with wide parts 2020-10-07 21:53:34 +03:00
alesapin
d8f7dce286 Merge branch 'master' into run_func_tests_in_parallel 2020-10-02 21:45:43 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
alesapin
91ba9c2e5f Merge branch 'master' into run_func_tests_in_parallel 2020-10-02 10:44:34 +03:00
alexey-milovidov
adb83d920a
Merge pull request #15267 from ClickHouse/clickhouse-test-fail-early
Fail more quickly in clickhouse-test if server does not respond
2020-09-26 07:28:34 +03:00
alesapin
bedab199af Fix category name 2020-09-25 16:20:16 +03:00
alesapin
987a46faee Merge branch 'master' into run_func_tests_in_parallel 2020-09-25 16:16:42 +03:00
alexey-milovidov
049f21091e
Update clickhouse-test 2020-09-25 08:05:50 +03:00
Alexey Milovidov
161ee1df3e Fail more quickly in clickhouse-test if server does not respond 2020-09-25 05:27:13 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
alesapin
8e9013561d Trying to split tests in sequential and parallel 2020-09-24 17:54:10 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
Anton Popov
8a201a28c0 remove skip list for tests with polymorphic parts 2020-09-11 03:14:35 +03:00
alexey-milovidov
aa3a19d8c0
Update clickhouse-test 2020-08-27 15:20:59 +03:00
alesapin
d40e203ecd Add ability to add comments in skip-list.json 2020-08-27 11:17:01 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Alexander Kuzmenkov
2a2775b378
Merge pull request #13615 from myrrc/docs/ci
CI checks md file
2020-08-20 23:48:51 +03:00
Alexander Kuzmenkov
cac3fa3e45 review fixes 2020-08-20 22:44:00 +03:00
Alexey Milovidov
88f4bad0db Better diagnostics in clickhouse-test 2020-08-15 13:03:51 +03:00
Alexander Kuzmenkov
0349b75cb4 some updates 2020-08-13 21:45:55 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
alesapin
46991b8c66 Flush stdout in tests 2020-07-15 12:59:45 +03:00
alesapin
ecea1e0292 Run tests in parallel 2020-07-15 11:49:50 +03:00
alesapin
0d5c747b86 Return strange line from clickhouse-test 2020-07-09 21:59:32 +03:00
alesapin
069880a003 Prototype 2020-07-08 16:06:35 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
alesapin
cd9a71b19c
Update clickhouse-test 2020-07-03 16:01:02 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
alesapin
07cbb427a8 More verbose message about skip 2020-07-03 14:05:27 +03:00
alesapin
d015a4d646 Move skip lists to clickhouse-test 2020-07-03 13:57:16 +03:00
Alexander Kuzmenkov
c678708c0c Put clickhouse-local data to /tmp by default
This fixes https://github.com/ClickHouse/ClickHouse/issues/9848
Also fixes https://github.com/ClickHouse/ClickHouse/issues/11926
2020-06-24 22:03:28 +03:00
Alexey Milovidov
d5d3251d3f Stop tests on fatal errors 2020-06-22 22:32:33 +03:00
Alexey Milovidov
293241cc22 Better check for hung queries in clickhouse-test 2020-05-31 17:57:29 +03:00
alexey-milovidov
94887f0c74
Merge pull request #11285 from ClickHouse/fix_fixed_database_tests
Add retries in clickhouse-test before server start
2020-05-29 23:54:36 +03:00
alesapin
bd03d1acb9 Remove hardcoded database from some tests and add retries to clickhouse-test 2020-05-29 13:08:11 +03:00
Alexey Milovidov
025c1a8830 Added another check #11170 2020-05-29 03:46:42 +03:00
Alexey Milovidov
5548c9d1ad Repeat test on curl timeout 2020-05-29 01:53:15 +03:00
alesapin
3d9ba9ff8a Revert #11023 2020-05-25 13:06:27 +03:00
Azat Khuzhin
e9dc2cbcf7 Add missing SYSTEM FLUSH LOGS before TRUNCATE TABLE in clickhouse-test
Suggested-by: @filimonov
2020-05-19 01:12:51 +03:00
Azat Khuzhin
bdbfa08e02 Truncate system.*_log by default in tests
Enable it by default due to:
- it is a sane default
- avoids modifying docker images
2020-05-18 21:18:37 +03:00
Alexey Milovidov
0faf7bc39b clickhouse-test: create unique database for every test (part 2) 2020-05-13 23:17:12 +03:00
Alexey Milovidov
6c671eb6a6 clickhouse-test: recreate database for every test (part 1) 2020-05-13 23:03:10 +03:00
Azat Khuzhin
989ae58a0c Force clickhouse-test to use python2 2020-04-28 22:45:22 +03:00
alesapin
0afd361933 Fix subprocess call in clickhouse-test 2020-04-20 17:20:06 +03:00
Alexander Kuzmenkov
1927212f67 Filter out some tests that require Zookeeper. 2020-04-17 23:36:08 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00