Commit Graph

7280 Commits

Author SHA1 Message Date
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Alexey Milovidov
0ef6453935
Merge pull request #52148 from azat/tests/EADDRINUSE
Fix possible EADDRINUSE ("Address already in use") in integration tests
2023-07-23 01:27:47 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Alexey Milovidov
5a3f872a4b
Merge branch 'master' into integration-tests-fix-disaster-2 2023-07-22 19:37:59 +03:00
Alexey Milovidov
b869466a6a
Merge branch 'master' into sparse-columns-by-default 2023-07-22 19:34:29 +03:00
alesapin
835c36cbf3
Merge pull request #52419 from ClickHouse/implement_borders_for_sampling_memory_profiler
Add an ability to specify allocations size for sampling memory profiler
2023-07-22 18:13:26 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
kssenii
4fc3d0b290 Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-22 14:45:38 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
7af9af1a3f
Merge pull request #52103 from azat/tests/test_materialized_mysql_database
tests: drop existing view in test_materialized_mysql_database
2023-07-22 03:41:52 +03:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
ae8f511ac5 Fix a test 2023-07-22 02:27:07 +02:00
Alexey Milovidov
860e3975ad Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-22 02:25:23 +02:00
Alexey Milovidov
91fd286165 Merge branch 'master' into sleep-each-row-max-time 2023-07-22 02:25:03 +02:00
Alexey Milovidov
37a7b13ca6
Merge pull request #52095 from azat/tests/fix-docker-network-prune
Add missing --force for docker network prune (otherwise it is noop on CI)
2023-07-22 02:30:28 +03:00
Sema Checherinda
3cc7f137bd add tests with connection reset by peer 2023-07-22 00:45:12 +02:00
robot-ch-test-poll
8175ba8ade
Merge pull request #52408 from ClickHouse/fix-test_keeper_force_recovery
Fix `test_keeper_force_recovery`
2023-07-22 00:22:54 +02:00
Alexey Milovidov
de949b6844
Merge pull request #52306 from ClickHouse/backuptestfix
Add missing replica syncs in test_backup_restore_on_cluster
2023-07-22 00:57:24 +03:00
kssenii
f82364d2c9 Fix flaky test 2023-07-21 17:03:30 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf
`reconfig` support for CH Keeper
2023-07-21 15:59:25 +02:00
robot-clickhouse
2a6b96f9e3 Automatic style fix 2023-07-21 13:51:40 +00:00
Roman Vasin
1daa26c741 Fix black formatting 2023-07-21 13:31:42 +00:00
Yarik Briukhovetskyi
e7b9b42326
Merge branch 'master' into rewrite_uniq_to_count 2023-07-21 15:30:03 +02:00
Roman Vasin
10ec069175 Improve exception message text 2023-07-21 13:29:40 +00:00
Roman Vasin
0aed62ec73 Add codec name into exception message 2023-07-21 13:03:25 +00:00
Alexander Sapin
4695ec6802 Add an ability to specify allocations size for sampling memory profiler 2023-07-21 14:56:29 +02:00
Nikita Mikhaylov
5ea0971921
Merge pull request #52379 from ClickHouse/fix-test-with-encrypted-disks
Fix `test_replicated_merge_tree_encrypted_disk `
2023-07-21 14:12:51 +02:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
Azat Khuzhin
0f96992322 Fix possible EADDRINUSE ("Address already in use") in integration tests
Here is one example [1]:

    minio1_1    | WARNING: Console endpoint is listening on a dynamic port (32911), please use --console-address ":PORT" to choose a static port.
    minio1_1    | ERROR Unable to initialize console server: Specified port is already in use
    minio1_1    |       > Please ensure no other program uses the same address/port

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/52103/7d510eac7c5f0dfb3361e269be30972e6022fada/integration_tests__tsan__[1_6].html

And here is second [2]:

    java.net.BindException: Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/51493/63e88b725d3d255a6534adce4d434ce5f95d2874/integration_tests__asan__[1_6].html

v2: increase the limit from 5K to 10K
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-21 13:47:42 +02:00
Nikolai Kochetov
e02a7c7382
Merge pull request #52375 from ClickHouse/disable-analyzer-bc-tests
Disable analyzer setting in backward_compatibility integration tests.
2023-07-21 13:39:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
3815a6aa62 Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
Smita Kulkarni
6cc8a9af5c Fixed named collection tests 2023-07-21 11:19:12 +02:00
Antonio Andelic
234b5047b5
Merge pull request #52373 from ClickHouse/fix-test_keeper_session
Fix `test_keeper_session`
2023-07-21 08:33:37 +02:00
Roman Vasin
695a6b7bb3 Add integration test 2023-07-21 06:18:54 +00:00
Yury Bogomolov
c8b128aad4 add predefined macros support in kafka engine settings 2023-07-21 01:06:49 +04:00
Nikita Mikhaylov
920887f315 Done 2023-07-20 16:43:59 +00:00
Michael Kolupaev
97e54d6eba Fix test_backup_restore_on_cluster flakiness caused by missing replica syncs 2023-07-20 15:57:29 +00:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover
Handle multiple resolved IPs for HTTP/HTTPS session connection
2023-07-20 18:25:45 +03:00
robot-clickhouse
a26de1b370 Automatic style fix 2023-07-20 15:12:55 +00:00
Nikolai Kochetov
ea252e2f61 Disable analyzer setting in backward_compatibility integration tests. 2023-07-20 15:05:07 +00:00
Roman Vasin
8adf57a698 Fix text in comments and improve exception handling 2023-07-20 14:18:32 +00:00
robot-clickhouse
5decb1f5c5 Automatic style fix 2023-07-20 14:11:11 +00:00
Antonio Andelic
f997adfe27 Retry if sessions not closed because missing leader 2023-07-20 14:02:55 +00:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync
Fix materialised pg syncTables
2023-07-20 15:38:18 +02:00
Alexander Tokmakov
96a890b8a2
Merge pull request #52307 from ClickHouse/repdbtestfix
Fix test_replicated_database 'node doesn't exist' flakiness
2023-07-20 16:30:42 +03:00
Kseniia Sumarokova
ed38c45729
Merge pull request #52067 from valbok/start-transaction
MaterializedMySQL: Support CREATE TABLE AS SELECT
2023-07-20 15:28:11 +02:00
Val Doroshchuk
d16d444943 MaterializedMySQL: Add support of double quoted comments 2023-07-20 13:59:01 +02:00
Kruglov Pavel
b08c72b28d
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-20 12:45:19 +02:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
János Benjamin Antal
16cc007842 Fix table ad variable name 2023-07-20 09:21:18 +00:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry
Basic auth to fetch Avro schema in Kafka
2023-07-20 10:58:11 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
Song Liyong
7837559dbf MaterializedMySQL: Support CREATE TABLE AS SELECT 2023-07-19 13:33:02 +02:00
JackyWoo
08409059cc support alias for new analyzer 2023-07-19 18:46:20 +08:00
alesapin
08022f474b
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-19 12:00:07 +02:00
János Benjamin Antal
5ed23fd749
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-19 11:11:36 +02:00
robot-clickhouse
70543e8ef9 Automatic style fix 2023-07-19 08:47:53 +00:00
Ilya Golshtein
c8347bd313 test_for_basic_auth_registry: some comments removed per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
9f6ab5e816 test_for_basic_auth_registry - made black formatter happy 2023-07-19 08:32:45 +00:00
Ilya Golshtein
f1ce1da007 test_for_basic_auth_registry - new test and cleanup per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Michael Kolupaev
a86baab88b Fix test_replicated_database 'node doesn't exist' flakiness 2023-07-19 08:28:04 +00:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290
Add support for multi-directory globs
2023-07-19 06:24:38 +02:00
robot-clickhouse
3c8141529f Automatic style fix 2023-07-18 23:25:21 +00:00
Alexey Milovidov
c724816cb8 Fix test 2023-07-19 01:15:16 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
robot-clickhouse
ff6e5ff1c5 Automatic style fix 2023-07-18 20:23:55 +00:00
Alexey Milovidov
b2164ab97e Fix integration tests 2023-07-18 22:13:28 +02:00
Alexey Milovidov
d423add083 Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-18 22:06:49 +02:00
Alexey Milovidov
06914e8196 Merge branch 'master' into sleep-each-row-max-time 2023-07-18 22:06:27 +02:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
János Benjamin Antal
6a104cc3f7 Add checked waits to improve kafka tests
It might take a few minutes to receive all the messages for the last
materialized view. By waiting to the number of expected results the
happy path of execution takes minimal time while becoming more stable,
while the erroneous path might take a bit longer.
2023-07-18 16:04:41 +00:00
Roman Vasin
50734017ae Fix test style with black 2023-07-18 15:45:43 +00:00
Roman Vasin
c8c6c31384 Change Method into method in exceptions 2023-07-18 15:33:50 +00:00
kssenii
680903e89b Fix style check 2023-07-18 16:54:33 +02:00
Roman Vasin
ea3d9e92f1 Add support of YAML configs for decryption 2023-07-18 14:44:47 +00:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
alesapin
5fe90208cf
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-18 14:43:18 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Azat Khuzhin
baf6d182d6 Fix reporting some BROKEN tests as ERROR
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:22:38 +02:00
Azat Khuzhin
92ca2b0bdd Make psql tests in test_odbc_interaction more robust to other test failures
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:22:28 +02:00
Azat Khuzhin
e9b7a84aa1 Fix network manager for integration tests
Sometimes you may get:

    >           raise subprocess.CalledProcessError(exit_code, cmd)
    E           subprocess.CalledProcessError: Command '['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.2.3', '-d', '172.16.2.2', '-j', 'DROP']' returned non-zero exit status 137.

And only sometimes you may get the reason:

    OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown

So this means that container for iptables does not exists anymore, and
the reason is the timeout. And the fact that container_exit_timeout was
equal to container_expire_timeout and was 120.

From the docker logs:

    time="2023-07-16T15:46:52.513673446Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"
    time="2023-07-16T15:48:57.611857183Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"

And then pytest will try to execute the iptables command:

    time="2023-07-16T15:50:57.698705244Z" level=debug msg="starting exec command 860920ab2aa07e8d285050f200ac92423a3cf8ec3fb2f57683541e62cf6bc20e in container 66d6c96671b5e987345290ddd260727d96b99789b512d40f333f6263f42fd2f1"

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:17:26 +02:00
Alexey Milovidov
3dbad00313
Merge branch 'master' into deprecate-metadata-cache 2023-07-18 05:27:15 +03:00
Alexey Milovidov
22c72db848
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-18 02:59:25 +03:00
Alexey Milovidov
806caea282 Update more tests 2023-07-18 01:56:38 +02:00
Alexey Milovidov
a4b92652da Update more tests 2023-07-18 01:50:43 +02:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Alexey Milovidov
4884022fda
Merge branch 'master' into zvonand-issue-49290 2023-07-17 23:03:50 +03:00
Kruglov Pavel
4ed8dcd436
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-17 21:02:33 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
robot-clickhouse
32311bf28f Automatic style fix 2023-07-17 15:30:31 +00:00
Azat Khuzhin
6c986c1fb2 Allow test names with spaces in it
It had been fixed and now it is allowed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:29:44 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
SmitaRKulkarni
3bb7db45c4
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-17 17:23:29 +02:00
Smita Kulkarni
671f8b34d0 Added test with all signatures and fixed style check 2023-07-17 17:18:14 +02:00
Azat Khuzhin
acbdbf6ab7 tests: do not use --format if --quiet is set in integration runner
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
e532d5b376 tests: use -- over quotes on and on in ci-runner.py
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Antonio Andelic
51f0089457
Merge branch 'master' into fix-test_multiple_disks 2023-07-17 16:25:06 +02:00
Andrey Zvonov
d339c22a2f
Merge branch 'master' into zvonand-issue-49290 2023-07-17 16:43:15 +03:00
kssenii
7a224c252e One more fix 2023-07-17 15:04:39 +02:00
kssenii
9c66655288 Fix tests 2023-07-17 15:01:58 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
robot-clickhouse
71e8465663 Automatic style fix 2023-07-17 12:09:36 +00:00
Alexander Sapin
2993cf3cba Fix flaky test test_lost_part 2023-07-17 14:01:31 +02:00
Antonio Andelic
152f5527a9 Remove wrong assert 2023-07-17 11:58:22 +00:00
Kruglov Pavel
9ac1a9c556
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-17 13:40:36 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
vdimir
37f8bd070f
Retry blob listing in test_alter_moving_garbage 2023-07-17 09:55:12 +00:00
Kseniia Sumarokova
200dfc24b6
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-17 11:53:42 +02:00
Antonio Andelic
dfc1cc13c8 Better oldest part selection 2023-07-17 08:57:22 +00:00
robot-ch-test-poll
3b0a4040cd
Merge pull request #51876 from evillique/fix-mongodb-inserts
Fix inserts into MongoDB tables
2023-07-16 05:28:43 +02:00
Alexey Milovidov
d900aa467f
Merge pull request #51992 from ClickHouse/fix-test_extreme_deduplication
Fix test_extreme_deduplication
2023-07-16 05:54:44 +03:00
Alexey Milovidov
2be26de2db
Merge pull request #52142 from ClickHouse/remove-detection-of-flaky-test
There is no point in detecting flaky tests
2023-07-16 05:52:04 +03:00
robot-ch-test-poll
67492bc2ed
Merge pull request #52122 from azat/keeper-stat-zxid
Print Zxid in keeper stat command in hex (so as ZooKeeper)
2023-07-16 03:28:53 +02:00
Alexey Milovidov
7e6551dbd0
Merge branch 'master' into fix-mongodb-inserts 2023-07-16 01:47:52 +03:00
robot-clickhouse
44fc93ba63 Automatic style fix 2023-07-15 21:10:21 +00:00
Alexey Milovidov
90f9d156d2
Merge branch 'master' into fix-test_extreme_deduplication 2023-07-16 00:05:40 +03:00
Alexey Milovidov
2ad7d121ae
Merge pull request #52085 from azat/tests/test_extreme_deduplication
Fix test_extreme_deduplication flakiness
2023-07-16 00:02:18 +03:00
Alexey Milovidov
20b77e946a There is no point in detecting flaky tests 2023-07-15 23:00:23 +02:00
Alexey Milovidov
7d510eac7c
Merge branch 'master' into tests/test_materialized_mysql_database 2023-07-15 20:36:32 +03:00
Alexey Milovidov
0d48dca171
Update materialized_with_ddl.py 2023-07-15 20:36:16 +03:00
Alexey Milovidov
47a33efc73
Merge branch 'master' into tests/test_keeper_s3_snapshot 2023-07-15 19:27:06 +03:00
Alexey Milovidov
ba60db1558
Merge branch 'master' into tests/fix-docker-network-prune 2023-07-15 19:24:59 +03:00
Alexey Milovidov
edbd05f332
Merge branch 'master' into tests/test_extreme_deduplication 2023-07-15 19:20:32 +03:00
Alexey Milovidov
0eab3276f5
Merge branch 'master' into keeper-stat-zxid 2023-07-15 19:07:48 +03:00
Vitaly Baranov
2f23b6a593
Merge branch 'master' into backups-native-copy 2023-07-15 08:40:17 +02:00
Aleksei Filatov
801d0955ec Add tests 2023-07-15 08:18:35 +03:00
Andrey Zvonov
dbdd15686a
Merge branch 'master' into zvonand-issue-49290 2023-07-15 00:53:29 +02:00
Azat Khuzhin
6abdde12ca Print Zxid in keeper stat command in hex (so as ZooKeeper)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-14 21:17:09 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B
Implement support of date/time format specifiers in log and error log file names
2023-07-14 18:54:27 +02:00
Azat Khuzhin
4f6d59ce7f tests: drop existing view in test_materialized_mysql_database
This should avoid failures of other tests in case of some previous test
failed

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-14 16:50:41 +02:00
Azat Khuzhin
2f17208792 Add missing --force for docker network prune (otherwise it is noop on CI)
On CI there is no stdin attached, so this command simply do nothing, fix
this.

Fixes: https://github.com/ClickHouse/ClickHouse/pull/51969
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 20:38:17 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
Azat Khuzhin
3a54182f77 Fix test_extreme_deduplication flakiness
This is part of **"Why my PR is not merged?"** patch set series.

Since #50107 there one more tunable that can increase the cleanup period
- max_cleanup_delay_period.

Plus, increase the delay for the cleanup thread, otherwise it is too
fragile.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 13:58:19 +02:00
Andrey Zvonov
871cce61fa
Merge branch 'master' into zvonand-issue-49290 2023-07-13 11:44:08 +02:00
Dmitry Novik
5c73a0b19c
Merge pull request #50926 from ClickHouse/analyzer-integration-tests
Add integration test check with enabled analyzer
2023-07-13 10:59:39 +02:00
Andrey Zvonov
22d8b35ee6
Merge branch 'master' into zvonand-issue-49290 2023-07-12 12:51:10 +02:00
robot-clickhouse
881a45ec83 Automatic style fix 2023-07-12 09:26:01 +00:00
Dmitry Novik
b4723ca8df Try to fix report 2023-07-12 09:16:13 +00:00
Alexey Gerasimchuck
7b4e7cd203
Merge branch 'master' into ADQM-970 2023-07-12 07:44:54 +10:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
Nikolai Kochetov
ab6356f9bc
Merge branch 'master' into vdimir/fix_race_in_remove_objects 2023-07-11 11:22:04 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00
JackyWoo
cd1111b17b ignore alias for UniqToCountPass 2023-07-11 10:45:08 +08:00
Victor Krasnov
e592c7c353 Fix integration tests - recover clickhouse_stay_alive_command lost by incomplete copy-paste 2023-07-11 10:32:33 +08:00
JackyWoo
a01a683448 fix style 2023-07-11 09:51:52 +08:00
JackyWoo
8004f37e97 rewrite uniq to count in new analyzer 2023-07-10 17:16:41 +08:00
JackyWoo
e0b223aa7e add tests for uniq to count rewrite 2023-07-10 17:16:41 +08:00
Andrey Zvonov
c030e9dbe4
Merge branch 'master' into zvonand-issue-49290 2023-07-10 11:01:26 +02:00
Victor Krasnov
e311d31d87 Merge branch 'master' into ADQM-950-B 2023-07-10 15:50:09 +08:00
Alexey Gerasimchuck
2c8564e45e
Merge branch 'master' into ADQM-970 2023-07-10 15:53:08 +10:00
vdimir
790b438b7c
add test_delete_race_leftovers 2023-07-09 16:19:00 +00:00
Azat Khuzhin
2db092f9d8 Cleanup remote_servers in dist config.xml
At first, there was no such amount of clusters in dist config, they
added when someone need to write some new cluster for tests.

So let's move them to the clusters.xml that is deployed only for tests,
and leave only default cluster.

And cleanup also some configs that had been copied from dist config in
the repo (about test_config_* integration tests, this should be OK,
since there are more_clusters.xml as well, that covers additional
cases).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 16:55:27 +02:00
Azat Khuzhin
29dc9abfca Fix test_backup_restore_s3 after logging for native copying changed
Check profile events instead of some odd logs.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 08:20:03 +02:00
Azat Khuzhin
84c720b33e Beatify test_backup_restore_s3 (using per-query profile events)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 08:20:03 +02:00
Alexey Milovidov
e2c8cea381
Merge pull request #51801 from ClickHouse/fix_broken_parts_handling
Fix broken parts handling in `ReplicatedMergeTree`
2023-07-09 05:32:51 +03:00
Alexey Milovidov
7311469c32 Fix test_extreme_deduplication 2023-07-09 04:17:15 +02:00
Alexey Milovidov
1f72b1bb09
Update ci-runner.py 2023-07-09 03:28:12 +03:00
Alexey Milovidov
508a9c1800
Merge pull request #51969 from ClickHouse/docker-network-prune
Fix Docker
2023-07-08 23:45:58 +03:00
Alexey Milovidov
b958499c27
Merge pull request #51458 from ClickHouse/sunny19930321-fix-attach-table-function-name-normalizer
Merging #36384
2023-07-08 10:37:11 +03:00
Alexey Milovidov
8e4c8f118c Fix disaster in integration tests, part 2 2023-07-08 09:07:05 +02:00
Alexey Milovidov
adbd85b975 Fix Docker 2023-07-08 06:26:44 +02:00
Alexey Milovidov
a7d225561c
Merge pull request #51868 from ClickHouse/fix-test_replicated_table_attach
Fix test_replicated_table_attach
2023-07-08 02:22:13 +03:00
avogar
ed37b01b51 Fix style 2023-07-07 14:39:11 +00:00
Andrey Zvonov
3e8d0249e8
Merge branch 'master' into zvonand-issue-49290 2023-07-07 14:10:37 +02:00
Yatsishin Ilya
50bda59a0d Fix typo 2023-07-07 11:05:42 +00:00
avogar
fc94cc8b87 Update config for test 2023-07-07 10:59:27 +00:00
avogar
cd3080428e Fix async connect to hosts with multiple ips 2023-07-07 10:58:01 +00:00
Alexey Milovidov
03c4a6e26c
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-07 13:45:30 +03:00
Alexey Milovidov
95b00df8dd
Merge branch 'master' into fix-test_replicated_table_attach 2023-07-07 13:45:07 +03:00
Alexey Milovidov
010f6b627f
Merge branch 'master' into fix-flaky-keeper-map-test 2023-07-07 13:37:58 +03:00
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3
Many fixes [3]
2023-07-07 13:29:49 +03:00
Antonio Andelic
ff79ceaafe Skip parallel keepermap test 2023-07-07 09:58:35 +00:00
Antonio Andelic
fb2affcae3 Dump all rules 2023-07-07 08:37:08 +00:00
Antonio Andelic
5875d66846 Merge branch 'master' into fix-flaky-keeper-map-test 2023-07-07 08:36:37 +00:00
Victor Krasnov
95fedaedff Refine the integration test code 2023-07-07 15:16:10 +08:00
Victor Krasnov
87ea1b6667 Recover the integration test 2023-07-07 13:01:30 +08:00
Victor Krasnov
63fbde41fe Reformat cluster.py (add empty line) 2023-07-07 11:01:39 +08:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks
Try to fix some trash in Disks and part moves
2023-07-07 02:02:17 +03:00
Mike Kot
c2a0607cf8 fix 2023-07-07 00:20:54 +03:00
Mike Kot
2f0cd05497 handle leader removal corner cases 2023-07-07 00:20:54 +03:00
Mike Kot
4550b15876 try updating tests to wait for cluster configs to come in sync 2023-07-07 00:20:54 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
Alexander Tokmakov
abf36065b7 fix 2023-07-06 17:24:06 +02:00
Kruglov Pavel
06de25451a
Merge branch 'master' into formats-with-subcolumns 2023-07-06 16:21:52 +02:00
Alexey Milovidov
6d8434c702 Merge branch 'master' into many-fixes-3 2023-07-06 16:17:32 +02:00
Alexey Milovidov
1fa21700ad Merge remote-tracking branch 'origin/less-flaky-test_start_stop_moves' into many-fixes-3 2023-07-06 16:17:13 +02:00
Alexander Sapin
30bcc73c63 Merge branch 'master' into add_delay_for_replicated 2023-07-06 14:29:15 +02:00
Kseniia Sumarokova
e97e107bcc
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-06 12:16:53 +02:00
robot-clickhouse
69691fd28c Automatic style fix 2023-07-06 09:38:16 +00:00
Smita Kulkarni
56e45ba384 Added test for select query when container does not exist 2023-07-06 11:17:04 +02:00
Andrey Zvonov
cc0210f760
Merge branch 'master' into zvonand-issue-49290 2023-07-06 11:13:51 +02:00
Antonio Andelic
7281bda072 Merge branch 'master' into fix-flaky-keeper-map-test 2023-07-06 06:43:27 +00:00
Antonio Andelic
0b0ce5191c Merge branch 'master' into less-flaky-test_start_stop_moves 2023-07-06 06:17:29 +00:00
Antonio Andelic
af0de3d614 Small fixes 2023-07-06 06:17:11 +00:00
Victor Krasnov
fef71ab0b8 Add inegration test 2023-07-06 14:16:46 +08:00
Victor Krasnov
479efaa79a Add clickhouse_log_file and clickhouse_error_log_file args to add_instance() 2023-07-06 14:16:18 +08:00
Nikolay Degterinsky
546f12dc85 Fix inserts to MongoDB tables 2023-07-06 05:05:27 +00:00
Alexey Milovidov
64d5a85f6e Fix test_replicated_table_attach 2023-07-06 03:16:06 +02:00
Alexey Milovidov
5452f2106f
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-06 03:50:18 +03:00
Sema Checherinda
44791af710 stop merges properly for replicated tables 2023-07-05 22:54:22 +02:00
alesapin
66484a4dd0
Merge branch 'master' into add_delay_for_replicated 2023-07-05 20:03:34 +02:00
Kruglov Pavel
60cf8a4c94
Merge branch 'master' into better-progress-bar-2 2023-07-05 19:58:55 +02:00
Antonio Andelic
b60a1c53d6 Fix oldest part fetching 2023-07-05 17:43:09 +00:00
alesapin
f2d106ffb7 Fix typos 2023-07-05 18:54:33 +02:00
robot-clickhouse
085576efc9 Automatic style fix 2023-07-05 16:22:58 +00:00
alesapin
baee73fd96 Make shutdown of replicated tables softer 2023-07-05 18:11:25 +02:00
Ilya Yatsishin
b0e2d010eb Merge remote-tracking branch 'origin/fix-flaky-keeper-map-test' into many-fixes-3 2023-07-05 17:07:21 +02:00
Antonio Andelic
12f413c7a7
Merge branch 'master' into fix-flaky-keeper-map-test 2023-07-05 14:00:10 +02:00
Antonio Andelic
47cffa6f1e Properly check the first part disk 2023-07-05 10:40:40 +00:00
Kseniia Sumarokova
dcda3576d2
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-05 12:05:49 +02:00
Alexey Milovidov
435d39bccd
Merge branch 'master' into try_fix_hdfs_tests 2023-07-05 01:56:17 +03:00
Alexey Gerasimchuck
2b77196a47
Merge branch 'master' into ADQM-970 2023-07-05 07:44:31 +10:00
Kruglov Pavel
a2805f8f44
Merge branch 'master' into formats-with-subcolumns 2023-07-04 23:27:03 +02:00
avogar
98aa6b317f Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions 2023-07-04 21:17:26 +00:00
Alexey Milovidov
31f68c2c67 Merge branch 'master' into deprecate-metadata-cache 2023-07-04 22:28:14 +02:00
robot-clickhouse
13cc329bfb Automatic style fix 2023-07-04 19:32:43 +00:00
Alexey Milovidov
8551a38e73 Update some tests 2023-07-04 21:19:30 +02:00
kssenii
6bca452924 Fix tests 2023-07-04 12:42:27 +02:00
Antonio Andelic
57ada39ccf Add retries and iptables rules dump 2023-07-04 09:31:15 +00:00
Antonio Andelic
1b71bbf1b1 Add test for ZK disconnect 2023-07-04 08:27:48 +00:00
Alexey Gerasimchuck
49907818e1 Added waiting before crash log store finish 2023-07-04 02:32:08 +00:00
Alexey Milovidov
03b8c28826
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-04 01:28:05 +03:00
Alexey Milovidov
d7bb68064a
Merge branch 'master' into disable-hedged-requests-under-tsan 2023-07-04 01:14:18 +03:00
kssenii
20d7cf2bf6 Fix tests 2023-07-03 14:51:19 +02:00
kssenii
ac77f5fe6f Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
2058b1346e Merge branch 'master' into keeper-with-disks 2023-06-30 13:22:33 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
kssenii
5de869760d Merge remote-tracking branch 'upstream/master' into s3queue 2023-06-30 13:56:43 +02:00
robot-clickhouse
6b7c17fb4c Automatic style fix 2023-06-30 10:14:39 +00:00
Alexey Milovidov
b0d4c9c83b Disable hedged requests under TSan 2023-06-30 10:14:39 +00:00
Alexey Milovidov
2a7ae8f622
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-06-30 12:16:49 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
Update tests' docker containers
2023-06-30 11:24:59 +03:00