mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-12-15 02:41:59 +00:00
ff324fe81a
There are very frequent flakiness of `test_cluster_copier` test, here is an example of copier failures on CI [1]: AssertionError: Instance: s0_1_0 (172.16.29.9). Info: {'ID': '5d68dcb46fdb4b0c54b7c7ba1ddde83b8f34d483bbb32abcb0c52b966444ce82', 'Running': False, 'ExitCode': 85, 'ProcessConfig': {'tty': False, 'entrypoint': '/usr/bin/clickhouse', 'arguments': ['copier', '--config', '/etc/clickhouse-server/config-copier.xml', '--task-path', '/clickhouse-copier/task_simple_4DFWYTDD49', '--task-file', '/task0_description.xml', '--task-upload-force', 'true', '--base-dir', '/var/log/clickhouse-server/copier', '--copy-fault-probability', '0.2', '--experimental-use-sample-offset', '1'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f356df6694b3cc09ee9830c623681626f8e8d999677c188b9fe911aa702784ca', 'DetachKeys': '', 'Pid': 84332} assert 85 == 0 But let's look what the error it is, apparently it is UNFINISHED: SELECT name, code FROM system.errors WHERE ((code % 256) = 85) AND (NOT remote) SETTINGS system_events_show_zero_values = 1 ┌─name─────────────────────────────┬─code─┐ │ FORMAT_IS_NOT_SUITABLE_FOR_INPUT │ 85 │ │ UNFINISHED │ 341 │ │ NO_SUCH_ERROR_CODE │ 597 │ └──────────────────────────────────┴──────┘ Let's verify: $ grep -r UNFINISHED ./test_cluster_copier/_instances_0/s0_1_0/logs/copier/clickhouse-copier_* ./test_cluster_copier/_instances_0/s0_1_0/logs/copier/clickhouse-copier_20230206220846_368/log.log:2023.02.06 22:09:19.015251 [ 368 ] {} <Error> : virtual int DB::ClusterCopierApp::main(const std::vector<std::string> &): Code: 341. DB::Exception: Too many tries to process table cluster1.default.hits. Abort remaining execution. (UNFINISHED), Stack trace (when copying this message, always include the lines below): And apparently that it is due to query error with fault injection: 2023.02.06 22:09:15.654724 [ 368 ] {} <Error> Application: An error occurred while processing partition 0: Code: 62. DB::Exception: Syntax error (Query): failed at position 168 ('Native'): Native. Expected one of: token, Dot, OR, AND, BETWEEN, NOT BETWEEN, LIKE, ILIKE, NOT LIKE, NOT ILIKE, IN, NOT IN, GLOBAL IN, GLOBAL NOT IN, MOD, DIV, IS NULL, IS NOT NULL, alias, AS, Comma, OFFSET, WITH TIES, BY, LIMIT, SETTINGS, UNION, EXCEPT, INTERSECT, INTO OUTFILE, FORMAT, end of query. (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below): Example: select x from x limit 1FORMAT Native Syntax error: failed at position 32 ('Native'): So fixing this should fix test_cluster_copier flakiness. [1]: https://s3.amazonaws.com/clickhouse-test-reports/46045/bd4170e03c6af583a51d12d2c39fa775dcb9997b/integration_tests__release__[4/4].html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> |
||
---|---|---|
.. | ||
bash-completion | ||
benchmark | ||
client | ||
compressor | ||
copier | ||
diagnostics | ||
disks | ||
extract-from-config | ||
format | ||
git-import | ||
install | ||
keeper | ||
keeper-converter | ||
library-bridge | ||
local | ||
obfuscator | ||
odbc-bridge | ||
self-extracting | ||
server | ||
static-files-disk-uploader | ||
su | ||
CMakeLists.txt | ||
config_tools.h.in | ||
embed_binary.S.in | ||
main.cpp |