Commit Graph

537 Commits

Author SHA1 Message Date
vdimir
b64ed8b5d0
fix tests/clickhouse-test file perm 2023-02-16 11:29:17 +01:00
Azat Khuzhin
810a624f71 Fix parse_args() in clickhouse-test 2023-02-15 22:20:18 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress"
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Anton Popov
4af836a592 Merge remote-tracking branch 'upstream/master' into HEAD 2023-02-14 18:42:03 +00:00
Azat Khuzhin
96c8c783f5 One more trim of stdout in clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 16:50:12 +01:00
Azat Khuzhin
72f61ae399 Do not polute logs in clickhouse-test
In case of there are less then 100 lines, there is no need to split
lines with '#', and in fact, it will only looks it odd and hard to
interpret.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 16:46:56 +01:00
Alexander Tokmakov
8e145450bd
Revert "Beter diagnostics from http in clickhouse-test" 2023-02-11 21:01:50 +03:00
Alexander Tokmakov
b2870d3e0c
Update clickhouse-test 2023-02-10 19:34:13 +03:00
Alexander Tokmakov
681baa10b7
Update clickhouse-test 2023-02-10 18:56:22 +03:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
16f35b6a6c
Update clickhouse-test 2023-02-09 00:42:08 +03:00
Alexander Tokmakov
c1c278ab9d make a bug in HTTP interface less annoying 2023-02-08 20:46:37 +01:00
Anton Popov
fe48ab2b1d randomize setting 'ratio_of_defaults_for_sparse_serialization' 2023-02-07 14:59:15 +00:00
Alexey Milovidov
6a389eef32
Add a comment 2023-02-06 22:27:46 +03:00
Azat Khuzhin
ad3b4da488 Add also last messages from stdout/stderr/debuglog in clickhouse-test
First lines not very helpful usually, since the problem usually happens
at the end [1], though some tricky stuff may happens at the beginning,
so let's output both.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/1716af465d376f5335720b5045bcccdd9e1823aa/fast_test.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-06 19:47:44 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings
Allow to randomize merge tree settings in tests
2023-02-04 02:59:52 +01:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Vladimir C
05ba4112e3
Fix style 2023-02-01 13:01:58 +01:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
Alexey Milovidov
ca181afc8f Fix Flaky Check 2023-01-30 02:51:21 +01:00
Azat Khuzhin
e7df64df77 clickhouse-test: replace NUL byte to avoid breaking CSV parser
On CI [1]:

    022-12-12 12:49:55 01910_client_replxx_container_overflow_long:                            [ FAIL ] 2.25 sec. - return code: 1
    2022-12-12 12:49:55 send: spawn id exp4 not open
    2022-12-12 12:49:55     while executing
    ...
    Traceback (most recent call last):
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 327, in <module>
        state, description, test_results, additional_logs = process_results(
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 173, in process_results
        test_results = list(csv.reader(results_file, delimiter="\t"))  # type: ignore
    _csv.Error: line contains NUL
    INFO:root:Update Mergeable Check by Stateless tests (asan)
    Error: Process completed with exit code 1.

      [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/3669487007/jobs/6221215715

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Azat Khuzhin
d5f7adb4cd clickhouse-test: trim debuglog to the first 100 lines as other logs
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Saulius Valatka
ac2c921bdf add initial io_uring support 2023-01-28 21:54:44 +02:00
Azat Khuzhin
9456f4f83f Add missing SYSTEM FLUSH LOGS for clickhouse-test
CI: https://s3.amazonaws.com/clickhouse-test-reports/45150/718ad72871e7d6788242b06822918057723939f7/bugfix_validate_check.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:09:13 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings 2023-01-27 16:03:00 +01:00
Anton Popov
92fa39798b Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-26 13:29:23 +00:00
Vladimir C
25f32d5abb
Print warnings for client and extract_from_config options in clickhouse-test 2023-01-26 11:43:54 +01:00
Alexander Tokmakov
a584ad0eb1 forbid runtime strings 2023-01-26 10:52:47 +01:00
Alexander Tokmakov
9b670946db Merge branch 'master' into exception_message_patterns5 2023-01-26 00:41:32 +01:00
Alexander Tokmakov
3744fa2c63 format more messages 2023-01-25 21:16:42 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Alexander Tokmakov
381c5a62b8 fix 2023-01-25 17:33:34 +01:00
Alexander Tokmakov
c19110e186
Merge pull request #43396 from azat/tests/improve-hung-check
RFC: tests: add stacktraces for hunged queries
2023-01-25 18:35:39 +03:00
Alexander Tokmakov
ae795d87b2 fix 2023-01-25 16:06:40 +01:00
Alexander Tokmakov
6eb557b2ba Merge branch 'master' into exception_message_patterns4 2023-01-25 13:49:17 +01:00
Alexander Tokmakov
527156c104 fix 2023-01-25 12:53:00 +01:00
Alexander Tokmakov
d187215d53 fix 2023-01-24 16:04:37 +01:00
vdimir
d8d3da951e
Ignore utf errors in clickhouse-test reportLogStats 2023-01-24 12:30:19 +00:00
Anton Popov
08b2e524c7 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-23 15:34:53 +00:00
Azat Khuzhin
6cc873efe0 Remove --client/--extract-from-config from clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:57:02 +01:00
Azat Khuzhin
5878f92fc2 Simplify binary locating in clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Azat Khuzhin
e20b115daa Improve binary location in clickhouse-test
Since #39520 it is not possible to not have clickhouse binary.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Azat Khuzhin
14462b17a2 Fix locating binary by clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Alexander Tokmakov
2cd0ba7fff Merge branch 'master' into tests/improve-hung-check 2023-01-17 20:09:18 +01:00
Alexander Tokmakov
5cd90c1a3e Merge branch 'master' into exception_message_patterns 2023-01-17 20:04:04 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern
Add a column with a message pattern to text_log
2023-01-17 20:19:32 +03:00
Alexander Tokmakov
4e1cf778a6
Update clickhouse-test 2023-01-17 12:17:51 +03:00
Alexander Tokmakov
1fd8cf3d7f fix 2023-01-17 01:43:13 +01:00
Alexander Tokmakov
522686f78b less empty patterns 2023-01-17 01:19:44 +01:00
Azat Khuzhin
683a51633e tests: fix clickhouse binaries detection
Previosly only clickhouse-client binary was more or less detected, but
everything else does not, since "test -x clickhouse" does not work as
expected, "test -x" need a full path to the file, it does not search in
PATH.

Also improve clickhouse-test default --binary path, by properly search
in PATH.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-15 17:05:16 +01:00
Alexander Tokmakov
d857d62a03 remove another set of macros 2023-01-13 20:34:31 +01:00
Alexander Tokmakov
2d7773fccc Merge branch 'master' into text_log_add_pattern 2023-01-13 20:33:46 +01:00
Alexander Tokmakov
19cc2e2484
Merge branch 'master' into tests/improve-hung-check 2023-01-13 17:24:45 +03:00
Alexander Tokmakov
36c282e48e
Update clickhouse-test 2023-01-13 16:29:08 +03:00
Anton Popov
ca80240d84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-12 12:13:45 +00:00
Alexander Tokmakov
2af17ec1c0
Update clickhouse-test 2023-01-10 22:19:58 +03:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
Alexander Gololobov
fc877380f2
Update clickhouse-test 2022-12-30 00:42:03 +01:00
Alexey Milovidov
60e4fb0807 Fix cases when clickhouse-server takes long time to start 2022-12-29 22:56:50 +01:00
Alexey Milovidov
90e9aab633
Merge pull request #44693 from ClickHouse/fix-log-tinylog-stripelog-race
Fix flaky test "01502_long_log_tinylog_deadlock_race"
2022-12-29 15:37:27 +03:00
alesapin
94964c44b3 Fix 4 errors in 3 lines 2022-12-28 23:18:58 +01:00
Alexey Milovidov
96b7bf5598 Fix flaky test "01502_long_log_tinylog_deadlock_race" 2022-12-28 20:32:29 +01:00
alesapin
b0d6d8b904 Remove empty line 2022-12-28 19:50:18 +01:00
alesapin
f962468404 Add retries to HTTP requests in ClickHouse test 2022-12-28 19:49:12 +01:00
Alexander Tokmakov
4d25c9b2a3
Update clickhouse-test 2022-12-23 22:40:19 +03:00
Alexander Tokmakov
f2b177880f print stats in tests 2022-12-23 16:04:29 +01:00
Nikita Taranov
34029d47f3
Randomize setting enable_memory_bound_merging_of_aggregation_results in tests (#43986)
* Randomize setting `enable_memory_bound_merging_of_aggregation_results` in tests

* fix 02343_aggregation_pipeline
2022-12-20 20:18:40 +01:00
Anton Popov
33dc0d8283 fix more tests 2022-12-16 17:50:01 +00:00
Anton Popov
b08be3e604 fix tests 2022-12-14 03:21:24 +00:00
Anton Popov
0a951db1d0 fix more tests with random merge tree settings 2022-12-02 14:16:28 +00:00
Azat Khuzhin
dd8282d922 tests: add stacktraces for hunged queries
That way problems can be more visible (if you don't have a problem in
some background/server thread).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-21 21:42:01 +01:00
Azat Khuzhin
6e714b8e57 tests: apply black for clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-21 21:31:43 +01:00
Alexander Gololobov
2dda059cbd
Revert "Randomize keeper fault injection settings in stress tests" 2022-11-14 14:09:47 +01:00
Igor Nikonov
1b7b878520 don't randomize keeper fault injection setting for inserts 2022-11-12 21:04:01 +00:00
Igor Nikonov
0208fff321 Randomize keeper fault injection settings in stress tests 2022-11-11 18:45:15 +00:00
Anton Popov
b069259125 better random settings 2022-10-28 23:54:37 +00:00
Anton Popov
c7f6a410ac fix some tests 2022-10-28 23:26:06 +00:00
Anton Popov
6a9f195390 do not randomize mt settings with 'show create table' 2022-10-28 15:54:16 +00:00
Anton Popov
d09039418f Merge remote-tracking branch 'upstream/master' into HEAD 2022-10-28 14:35:45 +00:00
Alexander Tokmakov
e4f93149ff fix another issue 2022-10-19 17:24:50 +02:00
Frank Chen
99c74d182c
Merge branch 'master' into on_cluster_dll 2022-09-22 09:58:10 +08:00
Frank Chen
4c1a062375 Fix style
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-21 14:11:10 +08:00
Frank Chen
21afe65e8e Print content if diff says inputs are binary files
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-21 10:54:40 +08:00
Kseniia Sumarokova
f3844b5e25
Update clickhouse-test 2022-09-20 12:25:51 +02:00
kssenii
eef638d58e Disable random settings for s3 && (tsan || debug) 2022-09-19 17:18:53 +02:00
Alexander Tokmakov
ecdea62cd5
Update clickhouse-test 2022-09-01 14:26:50 +03:00
Alexander Tokmakov
e659b4553d
Update clickhouse-test 2022-08-31 21:53:57 +03:00
Alexey Milovidov
e358d57184 Check for coverage 2022-08-27 18:11:16 +02:00
Alexey Milovidov
fc3514ca1a Maybe better 2022-08-27 03:13:53 +02:00
Alexey Milovidov
04dc970cb8 Even more reports 2022-08-26 23:57:14 +02:00
Alexey Milovidov
cedf1c0454 Fix output 2022-08-26 15:14:27 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
Igor Nikonov
46ed4f6cdf
Merge pull request #38719 from ClickHouse/skipping_sorting_step
SortingStep: deduce way to sort based on input stream sort description
2022-08-17 12:58:11 +02:00
Igor Nikonov
d4367de7bb Rename setting to optimize_sorting_by_input_stream_properties 2022-08-16 16:27:41 +00:00
Alexander Tokmakov
832d7c6e7c Merge branch 'master' into replicated_database_improvements 2022-08-16 15:49:13 +02:00
Igor Nikonov
7a9bdbe81a Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-15 20:59:37 +00:00
Alexey Milovidov
158332f61d clickhouse-test: enable ZooKeeper tests by default 2022-08-14 01:01:59 +02:00
Alexey Milovidov
c6bb4ae575 clickhouse-test: enable ZooKeeper tests by default 2022-08-14 00:45:59 +02:00
Igor Nikonov
d83bea626c Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-13 21:46:34 +00:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexander Tokmakov
54862cd6d5 fix 2022-08-12 15:40:35 +02:00
Alexander Tokmakov
044aa4d923 fix 2022-08-12 11:28:16 +02:00
Igor Nikonov
75f6fcfa70 Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-11 12:35:55 +00:00
Robert Schulze
e7d1012c4b
Merge pull request #40057 from azat/clickhouse-test-fix
Fix clickhouse-test hang in case of CREATE DATABASE fails
2022-08-11 09:43:31 +02:00
vdimir
9ecf1c156a
Skip newlines before Tags in clickhouse-test 2022-08-10 11:32:24 +00:00
Azat Khuzhin
36ea40ab64 Fix clickhouse-test hang in case of CREATE DATABASE fails
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-10 11:25:48 +02:00
Igor Nikonov
70b52f7cb9 Fix test, review comments 2022-08-09 16:29:56 +00:00
Anton Popov
4f2c73f9f6 Merge remote-tracking branch 'upstream/master' into HEAD 2022-08-04 23:08:15 +00:00
Alexander Tokmakov
b3732df248 Merge branch 'master' into replicated_database_improvements 2022-07-28 13:08:30 +02:00
Igor Nikonov
2dbb159b53 Add optimize_distinct_in_order in settings randomizer 2022-07-26 20:35:45 +00:00
Alexander Tokmakov
e295fd5090 Merge branch 'master' into replicated_database_improvements 2022-07-20 12:49:18 +02:00
Kruglov Pavel
9dd370e2ec
Fix typo 2022-07-18 20:15:18 +02:00
Anton Popov
90779941cd fix clickhouse-test 2022-07-14 11:42:12 +00:00
Anton Popov
97425bb167 turn on merge tree settings randomization 2022-07-13 21:07:12 +00:00
Anton Popov
54a0985c42 randomize one more setting 2022-07-13 12:50:12 +00:00
Anton Popov
50f1edabf6 add more settings for randomization 2022-07-08 19:30:54 +00:00
Anton Popov
53bb42d9ba add some merge tree settings for randomization 2022-07-08 14:47:55 +00:00
Anton Popov
499262dba9 allow to randomize merge tree settings 2022-07-07 22:16:01 +00:00
Alexander Tokmakov
2e073b5cff Merge branch 'master' into replicated_database_improvements 2022-07-04 13:53:47 +02:00
Azat Khuzhin
9b8fc6a5a6 Fix CLICKHOUSE_TMP in tests
Previous it was not updated, and always uses the first CLICKHOUSE_TMP
for all tests (that was run from one thread).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 21:47:29 +03:00
Azat Khuzhin
e4b81e6de9 Add exp_internal for expect tests
This is to catch possible issues like 01565_reconnect_after_client_error in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/38417/e33f236d502fe9f7906392f4ceffaee44e3c4ce4/stateless_tests__thread__actions__[3/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 17:08:06 +03:00
Dmitry Novik
7378f0e30f Print stacktraces if test queue is full 2022-06-30 22:33:56 +00:00
Alexander Tokmakov
c6c22409a2 Merge branch 'master' into replicated_database_improvements 2022-06-29 14:38:07 +02:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Alexander Tokmakov
851534c9f7 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 23:47:49 +02:00
Dmitry Novik
c24c041b12 Handle full queue exception in tests 2022-06-27 20:54:52 +00:00
Alexander Tokmakov
379fecf7f9 try suppress failures with MaterializedPostgreSQL 2022-06-24 17:15:15 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
Azat Khuzhin
e307a728ca tests: add no-stress tag
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
8937785551 tests/clickhouse-test: apply black
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:43:59 +03:00
Azat Khuzhin
fddd031385 Randomize settings related to in-order read/aggregation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-07 08:29:00 +03:00
Alexander Tokmakov
9af6e237e1 remove retries 2022-05-28 19:25:56 +02:00
Alexander Tokmakov
1ae919a18a Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
This reverts commit 18d094d79d, reversing
changes made to 224f4dc620.
2022-05-28 19:23:58 +02:00
Alexander Tokmakov
e33d986cf1 Revert "Merge pull request #34924 from azat/tests-overlaps"
This reverts commit f13e436d40, reversing
changes made to aa3c05e9d4.
2022-05-28 19:20:32 +02:00
Alexander Tokmakov
281027e490 do not fail to start if replica seems dropped 2022-05-13 20:05:39 +02:00
Alexey Milovidov
ad9a377f42 Add settings randomization 2022-05-11 01:30:59 +02:00
Alexander Tokmakov
222277f4f0 fix 2022-05-09 14:55:51 +02:00
Alexander Tokmakov
376398f1a9 support secure connection in clickhouse-test 2022-05-05 21:11:38 +02:00
Mikhail f. Shiryaev
c359edbd8d
Fix some linter issues 2022-05-02 18:21:39 +02:00
Mikhail f. Shiryaev
76efb83f7c
Try to fix corrupted report for died server 2022-05-02 18:21:37 +02:00
Mikhail f. Shiryaev
5e019efb7e
Try to fix corrupted report for died server 2022-05-02 17:48:40 +02:00
Mikhail f. Shiryaev
2349d3d6a6
Use f-strings, some simplifications 2022-05-02 17:48:39 +02:00
Mikhail f. Shiryaev
cd27c13331
Apply black to clickhouse-test 2022-05-02 17:48:38 +02:00
Azat Khuzhin
287c098c7e Fix clickhouse-test for server w/o is_all_data_sent in system.processes 2022-04-28 23:19:21 +03:00
Alexander Tokmakov
4f54fadd2c
Update clickhouse-test 2022-04-28 20:16:01 +03:00
Alexander Tokmakov
07925ae309
Update clickhouse-test 2022-04-28 17:29:53 +03:00