Commit Graph

69 Commits

Author SHA1 Message Date
Raúl Marín
35b6112b7b Try to stop on leaks 2024-08-01 19:50:13 +02:00
Anton Popov
fa437b34ec
Increase timeout for curl in tests 2024-07-25 03:16:20 +02:00
Nikita Fomichev
eeb3561c37 Stateless tests: run sequential tests in parallel to other tests 2024-07-09 19:41:06 +02:00
Alexey Milovidov
e49cfbef08 Coverage for non-server tools 2024-01-15 05:40:03 +01:00
Alexey Milovidov
71c5ae548f
Revert "Fix leftover processes/hangs in tests" 2023-12-24 07:57:43 +03:00
Azat Khuzhin
72fa58e192 Fix leftover processes/hangs in tests
One of such cases is 02479_race_condition_between_insert_and_droppin_mv
[1], yes it can be fixed (by using fixed number of iterations, or with
some bash trickery), but it is better to fix them completelly,
eventually such tests will be submitted and pass review anyway.

By allocating process group for each test we can kill all the processes
in this process group, and this what this patch does.

This will also fix some test hangs (like in [1]) as well as some
possible issues in stress tests.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/e2c1230b00386c4d0096a245396ab3be7ce60950/stateless_tests__release__analyzer_/run.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-23 16:40:33 +01:00
Raúl Marín
4d51e167d9
Merge pull request #57861 from mkmkme/mkmkme/fix-hardcode
Remove hardcoded clickhouse-client invocations from tests
2023-12-18 11:18:09 +01:00
Mikhail Koviazin
5ee165e486
tests: properly set options for CLICKHOUSE_BENCHMARK 2023-12-15 11:43:03 +00:00
Mikhail Koviazin
9341209ca8
tests: properly handle clickhouse-benchmark in shell_config.sh 2023-12-15 10:56:44 +00:00
Mikhail Koviazin
d12f2a0946
tests: handle benchmark same way as client
Previously `CLICKHOUSE_BENCHMARK` was set simply as
`${CLICKHOUSE_BINARY}-benchmark` which is not applicable when testing a single
binary, e.g. downloaded via `curl https://clickhouse.com | sh`.  This commit
adds support for `CLICKHOUSE_BENCHMARK_BINARY` (not exported from
`shell_config.sh`) that is set to `"$CLICKHOUSE_BINARY benchmark"` if
`CLICKHOUSE_BINARY` is set. This is the same behaviour that is already used for
`CLICKHOUSE_CLIENT_BINARY`.
2023-12-14 12:06:08 +00:00
Raúl Marín
462cd0e4be Fix CLICKHOUSE_KEEPER_CLIENT with CLICKHOUSE_BINARY 2023-12-11 16:28:36 +01:00
Azat Khuzhin
929d5d6097 Add stateless test for clickhouse keeper-client --no-confirmation (resubmit)
Reverts: #54616
Resubmits: #54547

This reverts commit d23daca082, reversing
changes made to e111d4abd3.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-14 14:25:09 +02:00
Alexey Milovidov
02adae79e0
Revert "Add stateless test for clickhouse keeper-client --no-confirmation" 2023-09-14 04:43:23 +03:00
Azat Khuzhin
ddb2718cdb Add stateless test for clickhouse keeper-client --no-confirmation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-12 21:34:18 +02:00
Alexander Tokmakov
bf40767f10 fix another race 2023-08-15 14:27:49 +02:00
Alexander Tokmakov
6ee65fa1dc fix shellcheck 2023-03-01 16:41:51 +01:00
Alexander Tokmakov
b11ed59107 remove ps 2023-03-01 15:37:03 +01:00
Azat Khuzhin
683a51633e tests: fix clickhouse binaries detection
Previosly only clickhouse-client binary was more or less detected, but
everything else does not, since "test -x clickhouse" does not work as
expected, "test -x" need a full path to the file, it does not search in
PATH.

Also improve clickhouse-test default --binary path, by properly search
in PATH.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-15 17:05:16 +01:00
Alexey Milovidov
f29da86620
Merge pull request #41760 from FrankChen021/script
Support to run testcases on macOS
2022-10-03 16:39:55 +03:00
Frank Chen
27a1b4a4f3 Add default value in case of unbound variable error
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-26 20:35:21 +08:00
Frank Chen
f149530ee4 Revert accidental change
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-26 11:48:20 +08:00
Frank Chen
a1319e8be7 Replace -v with -n
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-09-26 11:44:56 +08:00
Yakov Olkhovskiy
ff8c74800d
change to --accept-invalid-certificate 2022-09-25 20:54:42 -04:00
Yakov Olkhovskiy
c1220d39fe fix tests 2022-09-24 13:43:18 +00:00
Azat Khuzhin
96429e293a tests: cover ClickHouseStatusInfo_DictionaryStatus in prometheus metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:58:08 +03:00
Azat Khuzhin
769017e1f5 tests: move random_str() helper into shell_config.sh
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-03 14:24:24 +03:00
Alexander Tokmakov
74f38710a8 Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-23 21:43:28 +02:00
Alexander Tokmakov
8288b9fe60 fixes 2022-06-21 18:47:55 +02:00
alesapin
cbec924113
Merge pull request #37932 from azat/tests-fix-log_comment
tests: fix log_comment (extra quotes)
2022-06-21 13:38:35 +02:00
Azat Khuzhin
d85421cc70 tests: fix log_comment (extra quotes)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Cherry-pick: 9a297ce3b6
2022-06-15 23:52:49 +03:00
Alexander Tokmakov
b39bd3c4e0 fix 2022-06-14 16:11:16 +02:00
Alexander Tokmakov
e33d986cf1 Revert "Merge pull request #34924 from azat/tests-overlaps"
This reverts commit f13e436d40, reversing
changes made to aa3c05e9d4.
2022-05-28 19:20:32 +02:00
Alexander Tokmakov
376398f1a9 support secure connection in clickhouse-test 2022-05-05 21:11:38 +02:00
Azat Khuzhin
d28963d695 tests: do not leave any queries after finish
This should fix issues like [1], where because one query from the
previous test was left the next fails, in this particular report the
problem was that 01281_group_by_limit_memory_tracking fails due to the
query from 01301_aggregate_state_exception_memory_leak was running in
background.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34919/311f884d3d4215f7f82c2dd66ea51d071d313241/stateless_tests__thread__actions__[2/3].html

v2: wait for queries in 01249_flush_interactive
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-09 17:29:33 +03:00
Azat Khuzhin
9a297ce3b6 tests: fix log_comment (extra quotes)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-09 17:29:32 +03:00
alesapin
583c9a5720
Update shell_config.sh 2021-11-19 16:36:13 +03:00
alesapin
7b7df05e33
Update shell_config.sh 2021-11-19 13:49:04 +03:00
alesapin
3f8f08e816 Slightly better 2021-11-19 12:30:58 +03:00
feng lv
e068855c3e fix
fix
2021-10-30 11:12:36 +00:00
Raúl Marín
d2a8ec9b93 Fix CLICKHOUSE_CLIENT_SECURE with the default config 2021-07-28 14:03:35 +02:00
tavplubix
48fbc78d31
Update shell_config.sh 2021-06-23 19:37:57 +03:00
tavplubix
1077e1f347
Update shell_config.sh 2021-06-23 18:27:39 +03:00
Alexander Tokmakov
ee5b0c2c34 fix test 2021-06-23 12:28:18 +03:00
Ivan Lezhankin
cdd825b18b Merge remote-tracking branch 'upstream/master' into ast-table-identifier-2 2021-04-23 18:08:25 +03:00
Ivan
b099ad467d
Merge branch 'master' into ast-table-identifier-2 2021-04-14 18:38:30 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy 2021-04-14 14:50:28 +03:00
Azat Khuzhin
3afa94612a Add a test to ensure that server will wait the server thread pools
v2: add into skip_list
v3: print server log on error
v4: increase sleep time to trigger some issues under TSAN
v5: avoid ports overlaps
v6: avoid endless loops to print server log on failure
2021-04-13 21:37:38 +03:00
kssenii
9089f44a50 Fix tests 2021-04-12 18:40:34 +00:00
Ivan Lezhankin
b559e45d93 Some minor fixes 2021-04-12 20:19:46 +03:00
Azat Khuzhin
e6b9740a69 Add $CLICKHOUSE_TEST_ZOOKEEPER_PREFIX (for *.sh stateless tests) 2021-03-16 07:22:32 +03:00