Commit Graph

559 Commits

Author SHA1 Message Date
Alexander Tokmakov
275acb756a
Merge pull request #47575 from azat/ci/log-stats
Add missing SYSTEM FLUSH LOGS for log messages statistics
2023-03-14 17:37:07 +03:00
Vasily Nemkov
d3199da1d2
Simplify clickhouse-test usage with -b
Now it is possible to run it even without `clickhouse` binary in PATH.
2023-03-14 15:31:36 +01:00
Azat Khuzhin
ad5dfc159b Add missing SYSTEM FLUSH LOGS for log messages statistics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:34:02 +01:00
Alexander Tokmakov
ba6c6255a3 hide too noisy log messages, fix some tests 2023-03-14 00:23:36 +01:00
Vladimir C
6a12bda189
Fix style tests/clickhouse-test 2023-03-09 15:23:55 +01:00
Vladimir C
1b264ad51e
Merge branch 'master' into vdimir/http_wait_end_of_query_settings 2023-03-09 13:37:56 +01:00
Ilya Yatsishin
f8eb1fad91
Disable parallel format in health check 2023-03-07 23:06:14 +01:00
Anton Popov
6f3e4d4137
Merge pull request #46118 from CurtizJ/fix-issues-with-sparse
Randomize setting `ratio_of_defaults_for_sparse_serialization`
2023-03-05 22:28:18 +01:00
Alexander Tokmakov
cadaf06829
Merge pull request #46681 from ClickHouse/fix_insert_cancellation_in_native_protocol
Fix queries cancellation when a client dies
2023-03-03 16:27:20 +03:00
Nikolai Kochetov
de6a74a907
Merge branch 'master' into add-stupid-retries-for-health-check-in-tests 2023-03-02 20:57:26 +01:00
Nikolai Kochetov
e91cdb4f8d Add stupid retries in clickhouse-test health check. 2023-03-02 19:03:17 +00:00
Alexander Tokmakov
c518f3690e Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-02 18:24:08 +01:00
vdimir
b782cba809 Add settings http_wait_end_of_query and http_response_buffer_size 2023-03-02 16:03:10 +01:00
Anton Popov
c4a999ce29 Merge remote-tracking branch 'upstream/master' into HEAD 2023-03-01 19:33:16 +00:00
Alexander Tokmakov
bb5b17fd09 make stacktraces in hung check more readable 2023-03-01 17:34:43 +01:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
Alexander Tokmakov
d5469c0ab4 fix clickhouse-test 2023-02-28 00:07:50 +01:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
Alexander Tokmakov
7122ebab4d fix clickhouse-test 2023-02-24 03:06:33 +01:00
Anton Popov
d926713cf5 Merge remote-tracking branch 'upstream/master' into HEAD 2023-02-23 23:04:22 +00:00
Alexander Tokmakov
d7cd4c6fca
Update clickhouse-test 2023-02-23 20:20:29 +03:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
vdimir
b64ed8b5d0
fix tests/clickhouse-test file perm 2023-02-16 11:29:17 +01:00
Azat Khuzhin
810a624f71 Fix parse_args() in clickhouse-test 2023-02-15 22:20:18 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress"
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Anton Popov
4af836a592 Merge remote-tracking branch 'upstream/master' into HEAD 2023-02-14 18:42:03 +00:00
Azat Khuzhin
96c8c783f5 One more trim of stdout in clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 16:50:12 +01:00
Azat Khuzhin
72f61ae399 Do not polute logs in clickhouse-test
In case of there are less then 100 lines, there is no need to split
lines with '#', and in fact, it will only looks it odd and hard to
interpret.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 16:46:56 +01:00
Alexander Tokmakov
8e145450bd
Revert "Beter diagnostics from http in clickhouse-test" 2023-02-11 21:01:50 +03:00
Alexander Tokmakov
b2870d3e0c
Update clickhouse-test 2023-02-10 19:34:13 +03:00
Alexander Tokmakov
681baa10b7
Update clickhouse-test 2023-02-10 18:56:22 +03:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
16f35b6a6c
Update clickhouse-test 2023-02-09 00:42:08 +03:00
Alexander Tokmakov
c1c278ab9d make a bug in HTTP interface less annoying 2023-02-08 20:46:37 +01:00
Anton Popov
fe48ab2b1d randomize setting 'ratio_of_defaults_for_sparse_serialization' 2023-02-07 14:59:15 +00:00
Alexey Milovidov
6a389eef32
Add a comment 2023-02-06 22:27:46 +03:00
Azat Khuzhin
ad3b4da488 Add also last messages from stdout/stderr/debuglog in clickhouse-test
First lines not very helpful usually, since the problem usually happens
at the end [1], though some tricky stuff may happens at the beginning,
so let's output both.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/1716af465d376f5335720b5045bcccdd9e1823aa/fast_test.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-06 19:47:44 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings
Allow to randomize merge tree settings in tests
2023-02-04 02:59:52 +01:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Vladimir C
05ba4112e3
Fix style 2023-02-01 13:01:58 +01:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
Alexey Milovidov
ca181afc8f Fix Flaky Check 2023-01-30 02:51:21 +01:00
Azat Khuzhin
e7df64df77 clickhouse-test: replace NUL byte to avoid breaking CSV parser
On CI [1]:

    022-12-12 12:49:55 01910_client_replxx_container_overflow_long:                            [ FAIL ] 2.25 sec. - return code: 1
    2022-12-12 12:49:55 send: spawn id exp4 not open
    2022-12-12 12:49:55     while executing
    ...
    Traceback (most recent call last):
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 327, in <module>
        state, description, test_results, additional_logs = process_results(
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 173, in process_results
        test_results = list(csv.reader(results_file, delimiter="\t"))  # type: ignore
    _csv.Error: line contains NUL
    INFO:root:Update Mergeable Check by Stateless tests (asan)
    Error: Process completed with exit code 1.

      [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/3669487007/jobs/6221215715

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Azat Khuzhin
d5f7adb4cd clickhouse-test: trim debuglog to the first 100 lines as other logs
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Saulius Valatka
ac2c921bdf add initial io_uring support 2023-01-28 21:54:44 +02:00
Azat Khuzhin
9456f4f83f Add missing SYSTEM FLUSH LOGS for clickhouse-test
CI: https://s3.amazonaws.com/clickhouse-test-reports/45150/718ad72871e7d6788242b06822918057723939f7/bugfix_validate_check.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:09:13 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings 2023-01-27 16:03:00 +01:00
Anton Popov
92fa39798b Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-26 13:29:23 +00:00
Vladimir C
25f32d5abb
Print warnings for client and extract_from_config options in clickhouse-test 2023-01-26 11:43:54 +01:00
Alexander Tokmakov
a584ad0eb1 forbid runtime strings 2023-01-26 10:52:47 +01:00
Alexander Tokmakov
9b670946db Merge branch 'master' into exception_message_patterns5 2023-01-26 00:41:32 +01:00
Alexander Tokmakov
3744fa2c63 format more messages 2023-01-25 21:16:42 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Alexander Tokmakov
381c5a62b8 fix 2023-01-25 17:33:34 +01:00
Alexander Tokmakov
c19110e186
Merge pull request #43396 from azat/tests/improve-hung-check
RFC: tests: add stacktraces for hunged queries
2023-01-25 18:35:39 +03:00
Alexander Tokmakov
ae795d87b2 fix 2023-01-25 16:06:40 +01:00
Alexander Tokmakov
6eb557b2ba Merge branch 'master' into exception_message_patterns4 2023-01-25 13:49:17 +01:00
Alexander Tokmakov
527156c104 fix 2023-01-25 12:53:00 +01:00
Alexander Tokmakov
d187215d53 fix 2023-01-24 16:04:37 +01:00
vdimir
d8d3da951e
Ignore utf errors in clickhouse-test reportLogStats 2023-01-24 12:30:19 +00:00
Anton Popov
08b2e524c7 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-23 15:34:53 +00:00
Azat Khuzhin
6cc873efe0 Remove --client/--extract-from-config from clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:57:02 +01:00
Azat Khuzhin
5878f92fc2 Simplify binary locating in clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Azat Khuzhin
e20b115daa Improve binary location in clickhouse-test
Since #39520 it is not possible to not have clickhouse binary.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Azat Khuzhin
14462b17a2 Fix locating binary by clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Alexander Tokmakov
2cd0ba7fff Merge branch 'master' into tests/improve-hung-check 2023-01-17 20:09:18 +01:00
Alexander Tokmakov
5cd90c1a3e Merge branch 'master' into exception_message_patterns 2023-01-17 20:04:04 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern
Add a column with a message pattern to text_log
2023-01-17 20:19:32 +03:00
Alexander Tokmakov
4e1cf778a6
Update clickhouse-test 2023-01-17 12:17:51 +03:00
Alexander Tokmakov
1fd8cf3d7f fix 2023-01-17 01:43:13 +01:00
Alexander Tokmakov
522686f78b less empty patterns 2023-01-17 01:19:44 +01:00
Azat Khuzhin
683a51633e tests: fix clickhouse binaries detection
Previosly only clickhouse-client binary was more or less detected, but
everything else does not, since "test -x clickhouse" does not work as
expected, "test -x" need a full path to the file, it does not search in
PATH.

Also improve clickhouse-test default --binary path, by properly search
in PATH.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-15 17:05:16 +01:00
Alexander Tokmakov
d857d62a03 remove another set of macros 2023-01-13 20:34:31 +01:00
Alexander Tokmakov
2d7773fccc Merge branch 'master' into text_log_add_pattern 2023-01-13 20:33:46 +01:00
Alexander Tokmakov
19cc2e2484
Merge branch 'master' into tests/improve-hung-check 2023-01-13 17:24:45 +03:00
Alexander Tokmakov
36c282e48e
Update clickhouse-test 2023-01-13 16:29:08 +03:00
Anton Popov
ca80240d84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-12 12:13:45 +00:00
Alexander Tokmakov
2af17ec1c0
Update clickhouse-test 2023-01-10 22:19:58 +03:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
Alexander Gololobov
fc877380f2
Update clickhouse-test 2022-12-30 00:42:03 +01:00
Alexey Milovidov
60e4fb0807 Fix cases when clickhouse-server takes long time to start 2022-12-29 22:56:50 +01:00
Alexey Milovidov
90e9aab633
Merge pull request #44693 from ClickHouse/fix-log-tinylog-stripelog-race
Fix flaky test "01502_long_log_tinylog_deadlock_race"
2022-12-29 15:37:27 +03:00
alesapin
94964c44b3 Fix 4 errors in 3 lines 2022-12-28 23:18:58 +01:00
Alexey Milovidov
96b7bf5598 Fix flaky test "01502_long_log_tinylog_deadlock_race" 2022-12-28 20:32:29 +01:00
alesapin
b0d6d8b904 Remove empty line 2022-12-28 19:50:18 +01:00
alesapin
f962468404 Add retries to HTTP requests in ClickHouse test 2022-12-28 19:49:12 +01:00
Alexander Tokmakov
4d25c9b2a3
Update clickhouse-test 2022-12-23 22:40:19 +03:00
Alexander Tokmakov
f2b177880f print stats in tests 2022-12-23 16:04:29 +01:00
Nikita Taranov
34029d47f3
Randomize setting enable_memory_bound_merging_of_aggregation_results in tests (#43986)
* Randomize setting `enable_memory_bound_merging_of_aggregation_results` in tests

* fix 02343_aggregation_pipeline
2022-12-20 20:18:40 +01:00
Anton Popov
33dc0d8283 fix more tests 2022-12-16 17:50:01 +00:00
Anton Popov
b08be3e604 fix tests 2022-12-14 03:21:24 +00:00
Anton Popov
0a951db1d0 fix more tests with random merge tree settings 2022-12-02 14:16:28 +00:00
Azat Khuzhin
dd8282d922 tests: add stacktraces for hunged queries
That way problems can be more visible (if you don't have a problem in
some background/server thread).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-21 21:42:01 +01:00
Azat Khuzhin
6e714b8e57 tests: apply black for clickhouse-test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-21 21:31:43 +01:00
Alexander Gololobov
2dda059cbd
Revert "Randomize keeper fault injection settings in stress tests" 2022-11-14 14:09:47 +01:00
Igor Nikonov
1b7b878520 don't randomize keeper fault injection setting for inserts 2022-11-12 21:04:01 +00:00
Igor Nikonov
0208fff321 Randomize keeper fault injection settings in stress tests 2022-11-11 18:45:15 +00:00
Anton Popov
b069259125 better random settings 2022-10-28 23:54:37 +00:00
Anton Popov
c7f6a410ac fix some tests 2022-10-28 23:26:06 +00:00
Anton Popov
6a9f195390 do not randomize mt settings with 'show create table' 2022-10-28 15:54:16 +00:00
Anton Popov
d09039418f Merge remote-tracking branch 'upstream/master' into HEAD 2022-10-28 14:35:45 +00:00
Alexander Tokmakov
e4f93149ff fix another issue 2022-10-19 17:24:50 +02:00
Frank Chen
99c74d182c
Merge branch 'master' into on_cluster_dll 2022-09-22 09:58:10 +08:00
Frank Chen
4c1a062375 Fix style
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-21 14:11:10 +08:00
Frank Chen
21afe65e8e Print content if diff says inputs are binary files
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-21 10:54:40 +08:00
Kseniia Sumarokova
f3844b5e25
Update clickhouse-test 2022-09-20 12:25:51 +02:00
kssenii
eef638d58e Disable random settings for s3 && (tsan || debug) 2022-09-19 17:18:53 +02:00
Alexander Tokmakov
ecdea62cd5
Update clickhouse-test 2022-09-01 14:26:50 +03:00
Alexander Tokmakov
e659b4553d
Update clickhouse-test 2022-08-31 21:53:57 +03:00
Alexey Milovidov
e358d57184 Check for coverage 2022-08-27 18:11:16 +02:00
Alexey Milovidov
fc3514ca1a Maybe better 2022-08-27 03:13:53 +02:00
Alexey Milovidov
04dc970cb8 Even more reports 2022-08-26 23:57:14 +02:00
Alexey Milovidov
cedf1c0454 Fix output 2022-08-26 15:14:27 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
Igor Nikonov
46ed4f6cdf
Merge pull request #38719 from ClickHouse/skipping_sorting_step
SortingStep: deduce way to sort based on input stream sort description
2022-08-17 12:58:11 +02:00
Igor Nikonov
d4367de7bb Rename setting to optimize_sorting_by_input_stream_properties 2022-08-16 16:27:41 +00:00
Alexander Tokmakov
832d7c6e7c Merge branch 'master' into replicated_database_improvements 2022-08-16 15:49:13 +02:00
Igor Nikonov
7a9bdbe81a Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-15 20:59:37 +00:00
Alexey Milovidov
158332f61d clickhouse-test: enable ZooKeeper tests by default 2022-08-14 01:01:59 +02:00
Alexey Milovidov
c6bb4ae575 clickhouse-test: enable ZooKeeper tests by default 2022-08-14 00:45:59 +02:00
Igor Nikonov
d83bea626c Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-13 21:46:34 +00:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexander Tokmakov
54862cd6d5 fix 2022-08-12 15:40:35 +02:00
Alexander Tokmakov
044aa4d923 fix 2022-08-12 11:28:16 +02:00
Igor Nikonov
75f6fcfa70 Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-11 12:35:55 +00:00
Robert Schulze
e7d1012c4b
Merge pull request #40057 from azat/clickhouse-test-fix
Fix clickhouse-test hang in case of CREATE DATABASE fails
2022-08-11 09:43:31 +02:00
vdimir
9ecf1c156a
Skip newlines before Tags in clickhouse-test 2022-08-10 11:32:24 +00:00
Azat Khuzhin
36ea40ab64 Fix clickhouse-test hang in case of CREATE DATABASE fails
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-10 11:25:48 +02:00
Igor Nikonov
70b52f7cb9 Fix test, review comments 2022-08-09 16:29:56 +00:00
Anton Popov
4f2c73f9f6 Merge remote-tracking branch 'upstream/master' into HEAD 2022-08-04 23:08:15 +00:00
Alexander Tokmakov
b3732df248 Merge branch 'master' into replicated_database_improvements 2022-07-28 13:08:30 +02:00
Igor Nikonov
2dbb159b53 Add optimize_distinct_in_order in settings randomizer 2022-07-26 20:35:45 +00:00
Alexander Tokmakov
e295fd5090 Merge branch 'master' into replicated_database_improvements 2022-07-20 12:49:18 +02:00
Kruglov Pavel
9dd370e2ec
Fix typo 2022-07-18 20:15:18 +02:00
Anton Popov
90779941cd fix clickhouse-test 2022-07-14 11:42:12 +00:00
Anton Popov
97425bb167 turn on merge tree settings randomization 2022-07-13 21:07:12 +00:00
Anton Popov
54a0985c42 randomize one more setting 2022-07-13 12:50:12 +00:00
Anton Popov
50f1edabf6 add more settings for randomization 2022-07-08 19:30:54 +00:00
Anton Popov
53bb42d9ba add some merge tree settings for randomization 2022-07-08 14:47:55 +00:00
Anton Popov
499262dba9 allow to randomize merge tree settings 2022-07-07 22:16:01 +00:00
Alexander Tokmakov
2e073b5cff Merge branch 'master' into replicated_database_improvements 2022-07-04 13:53:47 +02:00
Azat Khuzhin
9b8fc6a5a6 Fix CLICKHOUSE_TMP in tests
Previous it was not updated, and always uses the first CLICKHOUSE_TMP
for all tests (that was run from one thread).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 21:47:29 +03:00
Azat Khuzhin
e4b81e6de9 Add exp_internal for expect tests
This is to catch possible issues like 01565_reconnect_after_client_error in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/38417/e33f236d502fe9f7906392f4ceffaee44e3c4ce4/stateless_tests__thread__actions__[3/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 17:08:06 +03:00
Dmitry Novik
7378f0e30f Print stacktraces if test queue is full 2022-06-30 22:33:56 +00:00
Alexander Tokmakov
c6c22409a2 Merge branch 'master' into replicated_database_improvements 2022-06-29 14:38:07 +02:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00