Commit Graph

7717 Commits

Author SHA1 Message Date
Ilya Golshtein
ae6e0469ad system_kafka_consumers: rdfakfa stat with attempt to use json 2023-08-10 22:35:05 +00:00
Ilya Golshtein
40fd53c3e3 system_kafka_consumers: style check 2023-08-10 22:35:05 +00:00
Ilya Golshtein
88f5dd5db8 system_kafka_consumers: integration tests passed 2023-08-10 22:35:05 +00:00
Ilya Golshtein
5e1c72a0d0 system_kafka_consumers: test with rebalance 2023-08-10 22:35:05 +00:00
Ilya Golshtein
957787d96a system_kafka_consumers: kind of works, test added 2023-08-10 22:35:05 +00:00
Alexey Milovidov
5fa4cb9345
Revert "#2 Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-11 00:59:48 +03:00
Dmitry Novik
e1c20bb251
Merge branch 'master' into fix-system-flush-test 2023-08-10 22:22:47 +02:00
Arthur Passos
8656f9090b black 2023-08-10 17:22:01 -03:00
Arthur Passos
9781a8cee9 bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query 2023-08-10 16:45:29 -03:00
Alexander Tokmakov
3d59ebe108 fix 2023-08-10 20:11:22 +02:00
Nikolay Degterinsky
bcc0fbbf91 Add EXCEPT clause to SYSTEM STOP LISTEN query 2023-08-10 16:10:33 +00:00
kssenii
4598814e9a Better test 2023-08-10 17:19:54 +02:00
robot-ch-test-poll3
c3c4125328
Merge pull request #53255 from arenadata/ADQM-1011
#2 Added new tests for session_log and fixed the inconsistency between login and logout.
2023-08-10 17:06:24 +02:00
Alexander Tokmakov
6ae0ba1163 Merge branch 'master' into fixes_for_detached_parts 2023-08-10 17:01:05 +02:00
Alexander Tokmakov
635e7e74a8 add garbage 2023-08-10 16:52:57 +02:00
Alexey Milovidov
1365fc91c7
Merge pull request #53081 from ClickHouse/Something
Something with tests
2023-08-10 17:02:25 +03:00
pufit
8c9209745c
Merge pull request #53127 from ClickHouse/pufit/keeper-client-improvements
Revert Revert "Implementing new commands for keeper-client"
2023-08-10 09:51:36 -04:00
pufit
af51268da1
Merge pull request #51912 from ClickHouse/pufit/role-from-storage
Create, Drop, or Move access entities between different access storages.
2023-08-10 09:47:26 -04:00
Kseniia Sumarokova
137ec90a8b
Better test 2023-08-10 14:27:29 +02:00
Igor Nikonov
0282b6961a Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-10 11:47:18 +00:00
Alexey Gerasimchuck
7ed7707ab7 black run 2023-08-10 11:19:16 +00:00
Alexey Gerasimchuck
0ff5d12788 Added decription to the test + race condition fix 2023-08-10 11:14:55 +00:00
Sergei Trifonov
a9ae102169
Merge branch 'master' into improve-throttling-tests 2023-08-10 13:04:28 +02:00
Nikolay Degterinsky
7321f5e543 Better 2023-08-10 06:34:10 +00:00
Alexey Gerasimchuck
d499f8030a reverted change in test 2023-08-10 05:20:00 +00:00
Alexey Gerasimchuck
26aded5062 Used main connections for suggestions 2023-08-10 04:11:07 +00:00
Alexey Milovidov
cf97797836
Merge pull request #53241 from ClickHouse/remove-gargabe-tests
Remove garbage
2023-08-10 07:04:20 +03:00
Alexey Gerasimchuck
b8be7eef04 Added new tests for session_log and bugfix 2023-08-10 03:45:59 +00:00
Nikolay Degterinsky
3c6d140c17 Fix sigle quote escaping in PostgreSQL engine 2023-08-10 01:31:59 +00:00
Alexey Milovidov
bc2015356a
Merge branch 'master' into fix-system-flush-test 2023-08-10 04:14:14 +03:00
Alexey Milovidov
9c5e5ed2d0
Merge branch 'master' into vdimir/test_quorum_inserts 2023-08-10 04:12:53 +03:00
Alexey Milovidov
c071f6755d
Revert "Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-10 04:10:03 +03:00
Alexey Milovidov
2f0ecd2ddf
Merge branch 'master' into Something 2023-08-10 03:45:13 +03:00
Michael Kolupaev
65d3778b03 Fix warning in test_replicated_database 2023-08-09 23:40:08 +00:00
pufit
1a3eac0d4d
Merge branch 'master' into pufit/role-from-storage 2023-08-09 17:50:07 -04:00
Alexey Milovidov
481792181e Remove garbage 2023-08-09 23:12:39 +02:00
Igor Nikonov
5e7a438631 Fix cluster configs
correct internal replication flag
2023-08-09 19:33:45 +00:00
Igor Nikonov
88182b5535 Fix cluster configuration 2023-08-09 13:29:45 +00:00
Alexander Tokmakov
54a82072e7
Update test.py 2023-08-09 15:06:31 +03:00
Alexander Tokmakov
48ed54e822
Allow experimantal features when recovering Replicated db replica (#53167)
* allow experimantal features when recovering Replicated db replica

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-08-09 14:35:50 +03:00
Alexander Tokmakov
85af996d5c
Update test.py (#53195) 2023-08-09 12:53:05 +03:00
Antonio Andelic
ef3e0f7b83 Use async replication in tests 2023-08-09 06:25:47 +00:00
pufit
884ea7f592
Merge branch 'master' into pufit/role-from-storage 2023-08-08 20:20:37 -04:00
Alexey Milovidov
f6faacd394
Merge branch 'master' into Something 2023-08-08 23:55:27 +03:00
robot-clickhouse
4b6ade18b2 Automatic style fix 2023-08-08 20:06:59 +00:00
Dmitry Novik
2637308207 Analyzer: fix test_system_flush_logs 2023-08-08 19:54:07 +00:00
Alexander Tokmakov
2a92dc4b70
Update conftest.py (#53166)
* Update conftest.py

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-08-08 22:23:18 +03:00
Alexey Milovidov
227586acf4
Merge pull request #53113 from ClickHouse/Fix_flaky_test_user_azure_query
Fix flaky test by using azure_query function
2023-08-08 20:09:04 +03:00
Alexander Tokmakov
c1b94b4a3f fixes for detach/attach partition 2023-08-08 17:55:04 +02:00
Dmitry Novik
29051b7fd1
Merge branch 'master' into analyzer-fix-integration 2023-08-08 16:13:44 +02:00
kssenii
aa5eef8408 Move test to a separate folder 2023-08-08 14:08:28 +02:00
vdimir
60ab34f6b0
sync second replica in test_insert_quorum 2023-08-08 11:06:49 +00:00
vdimir
52c7a29309
use unique table names in test_quorum_inserts 2023-08-08 11:02:25 +00:00
alesapin
c12292306d
Merge pull request #53107 from ClickHouse/remove_duplicate_test
Remove duplicate test: `test_concurrent_alter_with_ttl_move`
2023-08-08 11:53:46 +02:00
alesapin
d5338826c9
Merge pull request #53108 from ClickHouse/relax_flaky_test
Relax flaky test `test_s3_engine_heavy_write_check_mem`
2023-08-08 11:53:02 +02:00
robot-clickhouse
201b4fd661 Automatic style fix 2023-08-08 09:32:44 +00:00
Smita Kulkarni
1994bc0d05 Improvements to disallow concurrency of backup restore function, added wait_for_fail_backup & wait_for_fail_restore 2023-08-08 11:08:43 +02:00
pufit
2f46ae850e
Merge branch 'master' into pufit/role-from-storage 2023-08-07 17:57:41 -04:00
Alexander Tokmakov
3073f783e9
Merge pull request #53119 from ClickHouse/tavplubix-patch-9
Update `test_restore_replica`
2023-08-08 00:29:28 +03:00
robot-clickhouse
6dc1772781 Automatic style fix 2023-08-07 21:28:44 +00:00
Igor Nikonov
8ba67f10bb Update test name 2023-08-07 21:13:08 +00:00
Igor Nikonov
50b0db598e Update test: use ReplicatedMergeTree 2023-08-07 21:06:12 +00:00
robot-clickhouse
9b631e2cef Automatic style fix 2023-08-07 19:23:31 +00:00
Igor Nikonov
fd69b18184
Merge branch 'master' into fix-parallel-replicas-multiply-result 2023-08-07 21:14:33 +02:00
Igor Nikonov
cb49b7b9ad Integration test 2023-08-07 19:12:53 +00:00
Vitaly Baranov
6af6247f8a
Merge pull request #52970 from arenadata/ADQM-985
Add `storage_policy` parameter in the `SETTINGS` clause of `RESTORE` statements
2023-08-07 19:01:08 +02:00
pufit
30700996f0 Merge branch 'master' into pufit/keeper-client-improvements
# Conflicts:
#	docs/en/operations/utilities/clickhouse-keeper-client.md
#	programs/keeper-client/Commands.cpp
#	programs/keeper-client/Commands.h
#	programs/keeper-client/KeeperClient.cpp
#	tests/integration/test_keeper_client/test.py
2023-08-07 12:26:08 -04:00
pufit
8e6f7b4d0b Fix typo, fix tests, touch command. 2023-08-07 12:08:31 -04:00
robot-clickhouse
a69bbc8a5a Automatic style fix 2023-08-07 15:49:34 +00:00
Dmitry Novik
53f9bf2ea3 Update list 2023-08-07 15:22:11 +00:00
Anton Popov
67ee1a2385 fix tests 2023-08-07 15:00:25 +00:00
Alexander Tokmakov
97a2988919
Update test.py 2023-08-07 16:58:59 +03:00
Anton Popov
76b279ddb4 Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-07 13:56:17 +00:00
Kseniia Sumarokova
6044da4baf
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-07 15:42:40 +02:00
robot-clickhouse
9587589a49 Automatic style fix 2023-08-07 13:04:51 +00:00
Smita Kulkarni
30d7b7999e Updated to use azure_query in test & test_cluster 2023-08-07 14:46:21 +02:00
Alexander Tokmakov
73d75cde11
Merge pull request #52958 from arenadata/ADQM-1011
Added new tests for session_log and fixed the inconsistency between login and logout.
2023-08-07 15:18:16 +03:00
Alexander Tokmakov
c7996d5453
increase election timeout in integration tests (#53052) 2023-08-07 14:48:52 +03:00
Alexander Sapin
eb43d480f0 Relax flaky test 2023-08-07 12:59:25 +02:00
Alexander Sapin
c830ad0a81 Fix 2023-08-07 12:58:00 +02:00
robot-clickhouse
8dc360e4c7 Automatic style fix 2023-08-07 10:31:41 +00:00
Alexander Sapin
80b681022c Remove duplicate test 2023-08-07 12:20:44 +02:00
Kseniia Sumarokova
e593efc827
Merge pull request #53032 from valbok/nc-alter
MaterializedMySQL: Add tests to alter named collections
2023-08-07 11:54:49 +02:00
Alexey Gerasimchuck
7dbc0d3510
Merge branch 'master' into ADQM-1011 2023-08-07 18:54:16 +10:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster
Table function azureBlobStorageCluster
2023-08-07 09:16:52 +02:00
Alexey Milovidov
674767df16 Fix review comments 2023-08-06 16:29:15 +02:00
Alexey Milovidov
3f9e6bb2f0 Merge branch 'fix-grammarly' of github.com:ClickHouse/ClickHouse into fix-grammarly 2023-08-06 16:28:08 +02:00
Alexey Milovidov
93a10980e9 Fix review comments 2023-08-06 16:27:45 +02:00
robot-clickhouse
5b0b5284c5 Automatic style fix 2023-08-06 12:57:48 +00:00
Alexey Milovidov
ce2fcc8f33 Fix wording 2023-08-06 14:48:20 +02:00
Alexey Gerasimchuck
b65a86c530
Merge branch 'master' into ADQM-1011 2023-08-06 07:29:40 +10:00
Alexey Milovidov
0a6d9881a7 Maybe better, but not sure 2023-08-05 16:52:44 +02:00
Alexey Milovidov
aa57fb6602 Maybe better, but not sure 2023-08-05 14:07:55 +02:00
Alexey Milovidov
10af8fcca4 Fix Python 2023-08-05 14:05:06 +02:00
Alexey Milovidov
9de9587965 Something with tests 2023-08-05 13:54:36 +02:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2
tests: fix possible EADDRINUSE v2
2023-08-05 13:39:25 +03:00
Alexey Gerasimchuck
c2f94101e9
Merge branch 'master' into ADQM-1011 2023-08-05 20:35:45 +10:00
Alexey Milovidov
7f4ce7697b
Merge branch 'master' into vdimir/tmp_storage_cache_msg 2023-08-04 23:11:28 +03:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Victor Krasnov
a2f48e5bb3 Merge branch 'master' into ADQM-985 2023-08-04 19:02:18 +03:00
Alexey Milovidov
376eeeb842
Fix test_zookeeper_config (#52988)
* Fix `test_zookeeper_config`

* Update tests/integration/test_zookeeper_config/test.py

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>

* Update tests/integration/test_zookeeper_config/test.py

* Update test.py

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-04 17:18:50 +03:00
Dmitry Novik
02ed17dfa5 Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
alesapin
109b0197d6
Merge pull request #52984 from ClickHouse/remove-test_host_regexp_multiple_ptr_records_concurrent
Remove `test_host_regexp_multiple_ptr_records_concurrent`, CC @arthurpassos
2023-08-04 11:58:19 +02:00
Val Doroshchuk
3d7bf0626c MaterializedMySQL: Add tests to alter named collections 2023-08-04 11:50:53 +02:00
Kseniia Sumarokova
39916f15eb
Merge branch 'master' into utf-dml-test 2023-08-04 11:26:43 +02:00
alesapin
4390129511
Merge pull request #52989 from ClickHouse/relax_test
Remove assertion from test_no_ttl_merges_in_busy_pool
2023-08-04 11:00:56 +02:00
Kseniia Sumarokova
af610062ec
Merge pull request #52962 from canhld94/fix_mysql_password_leak
Fix password leak in show create mysql table
2023-08-04 10:57:59 +02:00
SmitaRKulkarni
def587701b
Merge pull request #52855 from ClickHouse/Fix_flaky_azure_blob_storage_tests
Fix flaky tests in test_merge_tree_azure_blob_storage & test_storage_azure_blob_storage
2023-08-04 09:59:30 +02:00
Alexey Gerasimchuck
24cdaf305d Reduced test flakiness 2023-08-04 06:09:29 +00:00
robot-clickhouse
e8017d7af0
Merge pull request #42019 from ClickHouse/more-checks-in-thread-status
Add more checks into ThreadStatus ctor.
2023-08-04 05:56:28 +02:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Alexey Gerasimchuck
1e7daca85b Added new tests for session_log plus bugfix 2023-08-03 22:06:33 +00:00
SmitaRKulkarni
75356367fa
Merge branch 'master' into Fix_flaky_azure_blob_storage_tests 2023-08-03 17:46:59 +02:00
Duc Canh Le
63a46d7cb0
fix pg integration test 2023-08-03 21:05:31 +08:00
robot-clickhouse
c279b00c52 Automatic style fix 2023-08-03 12:55:27 +00:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
Kseniia Sumarokova
a8821d6a05
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-03 14:47:18 +02:00
Alexey Milovidov
a98fae936d Fix test_dictionary_custom_settings 2023-08-03 14:33:29 +02:00
alesapin
cc8c2c88bf Remove assertion from test_no_ttl_merges_in_busy_pool 2023-08-03 14:25:37 +02:00
Alexey Milovidov
3a9f9e1297
Revert "Implementing new commands for keeper-client" 2023-08-03 15:05:52 +03:00
Smita Kulkarni
68a10e7cae Merge branch 'master' into azure_table_function_cluster 2023-08-03 13:59:59 +02:00
Alexey Milovidov
d9e45e11c7 Remove test_host_regexp_multiple_ptr_records_concurrent, CC @arthurpassos 2023-08-03 13:59:39 +02:00
Alexander Tokmakov
e451b6d8cf
Merge pull request #52969 from arenadata/ADQM-1080
Added  TSAN option report_atomic_races=0 for test_max_sessions_for_user
2023-08-03 14:52:59 +03:00
Vitaly Baranov
6ac61b1fdd Fix tests. 2023-08-03 13:52:35 +02:00
Vitaly Baranov
556ecf5c1c Renamed backup setting "read_from_filesystem_cache_if_exists_otherwise_bypass_cache" -> "read_from_filesystem_cache". 2023-08-03 13:52:35 +02:00
Vitaly Baranov
1cd7902079 Add test. 2023-08-03 13:52:35 +02:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881)
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
2023-08-03 13:34:43 +03:00
vdimir
4747b7b0be
upd test_temporary_data_in_cache 2023-08-03 10:32:48 +00:00
Alexander Tokmakov
9e0d27dc4d
don't create empty parts on drop partittion if we have a transaction (#52945) 2023-08-03 13:16:32 +03:00
Nikolai Kochetov
5d64e036ba
Merge pull request #52695 from yariks5s/in_schema_case_sensitiveness
Information_schema case sensitiveness
2023-08-03 12:15:31 +02:00
Val Doroshchuk
7da85cc0de MaterializedMySQL: Add tests for unquoted utf8 column names in DML 2023-08-03 11:53:56 +02:00
Aleksei Filatov
0fc0a89f80 Add tests 2023-08-03 12:45:07 +03:00
Duc Canh Le
cc7f771093 Fix for postgres as well 2023-08-03 09:15:45 +00:00
Alexey Gerasimchuck
c7fcc611b2 added TSAN option report_atomic_races=0 2023-08-03 08:27:58 +00:00
Duc Canh Le
06229c1ba6 fix password leak in show create mysql table 2023-08-03 03:50:41 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Anton Popov
89bb3f3410
fix style-check 2023-08-02 19:25:33 +02:00
Victor Krasnov
d8792bf429 Merge branch 'master' into ADQM-985
# Conflicts:
#	docs/en/operations/backup.md
2023-08-02 20:17:59 +03:00
kssenii
c9f0c426e1 Fix style check, improve test 2023-08-02 17:15:50 +02:00
kssenii
d87162f43c Fix 2023-08-02 17:09:47 +02:00
kssenii
0d0cbb44e8 Paralelize loading of cache metadata on startup 2023-08-02 16:46:16 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
robot-clickhouse
6e49d3add6 Automatic style fix 2023-08-02 12:34:43 +00:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Yarik Briukhovetskyi
ffdc174c9a
Update test.py 2023-08-02 13:24:05 +02:00
Alexander Tokmakov
716b1ebcb7
Merge pull request #52907 from ClickHouse/merging_52897
Merging #52897
2023-08-02 13:06:23 +03:00
Kseniia Sumarokova
b2d2a295fd
Merge pull request #49086 from s-kat/s3queue
Streaming Data Import From S3
2023-08-02 11:32:48 +02:00
robot-clickhouse
c1752355b4 Automatic style fix 2023-08-02 06:40:32 +00:00
Antonio Andelic
dc33564044 Disable reconfig test until proper fix 2023-08-02 06:30:22 +00:00
Alexey Gerasimchuck
288e3f75fb fix json 2023-08-02 00:36:25 +00:00
Alexey Gerasimchuck
7e37f1fabd fixed test flakiness 2023-08-02 00:32:20 +00:00
Kseniia Sumarokova
8893670d98
Merge branch 'master' into s3queue 2023-08-01 18:42:32 +02:00
Yarik Briukhovetskyi
104a4aaee5
Merge pull request #51117 from ClickHouse/pufit/keeper-client-improvements
Implementing new commands for keeper-client
2023-08-01 17:47:33 +02:00
yariks5s
2227945529 fixed tests 2023-08-01 13:34:19 +00:00
János Benjamin Antal
a6861ea2f5
Merge pull request #52386 from ybogo/support-predefined-macro-in-kafka-settings
Add predefined macros support in Kafka engine settings
2023-08-01 14:49:01 +02:00
Victor Krasnov
9027ab968e Extend the set of test cases in the integration test 2023-08-01 15:44:43 +03:00
robot-clickhouse
4561378c20 Automatic style fix 2023-08-01 10:57:46 +00:00
Smita Kulkarni
ce4f273be1 Updated list of retryable errors and updated both tests to use same azure_query function 2023-08-01 12:39:36 +02:00
Victor Krasnov
505b4d0112 Simplify the integration test - use backup to File instead of Disk 2023-08-01 13:39:23 +03:00
Alexander Tokmakov
abb80d45f0
Merge branch 'master' into tavplubix-patch-8 2023-08-01 13:30:13 +03:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
serxa
f4779dac41 Merge branch 'improve-throttling-tests' of github.com:ClickHouse/ClickHouse into improve-throttling-tests 2023-08-01 09:44:14 +00:00
serxa
135790c0d6 more fixes 2023-08-01 09:44:08 +00:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Victor Krasnov
946f2f0b39 Simplify the integration test - dispose of the excessive details that cluttered it 2023-08-01 12:24:08 +03:00
Sergei Trifonov
1e44ada200
Merge branch 'master' into improve-throttling-tests 2023-08-01 11:16:21 +02:00
serxa
513d3fd3c1 fix more places 2023-08-01 09:15:35 +00:00
Nikolai Kochetov
15c77afd8e
Merge pull request #52823 from ClickHouse/try-fix-test_version_update_after_mutation
Try to remove more leftovers.
2023-07-31 22:22:18 +02:00
Victor Krasnov
2ed74507e7 Blacken test_backup_restore_storage_policy/test.py 2023-07-31 22:05:23 +03:00
Victor Krasnov
731b780b84 Add integration test 2023-07-31 21:06:13 +03:00
alesapin
0784379583
Merge pull request #52822 from ClickHouse/trying_to_debug_materialize_mysql
Add more logging and touch test for materialize mysql
2023-07-31 19:52:55 +02:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984
Add s3_storage_class parameter in SETTINGS of BACKUP statement
2023-07-31 17:32:12 +02:00
Alexander Tokmakov
e02805d9f7
Update test.py 2023-07-31 16:55:51 +03:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
Nikolai Kochetov
b98d54cdf3 Add flushing logs 2023-07-31 13:05:53 +00:00
Nikolai Kochetov
8f5d0c0cd4 Revert "Merge pull request #52514 from azat/tests/fix-test_version_update_after_mutation"
This reverts commit dd491eeae2, reversing
changes made to b225f9c34b.
2023-07-31 13:03:04 +00:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
alesapin
efba3a2113 Add more logging and touch test for materialize mysql 2023-07-31 14:32:09 +02:00
serxa
fb8502ba76 do not test upper bounds for throttlers 2023-07-31 12:20:27 +00:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
robot-ch-test-poll4
891ae75c55
Merge pull request #52680 from evillique/fixes-start-stop-listen
Fix bugs and better test for SYSTEM STOP LISTEN
2023-07-31 11:39:50 +02:00
Antonio Andelic
1a95a6810f
Merge branch 'master' into fix-test_keeper_reconfig_replace_leader 2023-07-31 10:58:29 +02:00
Alexey Milovidov
d3ea44326a
Merge pull request #52796 from ClickHouse/maybe-fix-tls-tests
Maybe fix TLS tests
2023-07-31 11:47:53 +03:00
Alexey Gerasimchuck
7e9e0ac758
Merge branch 'master' into ADQM-939 2023-07-31 18:12:29 +10:00
Alexey Milovidov
c825f15b74
Merge pull request #52441 from CheSema/reset-connection-s3
add tests with connection reset by peer error, and retry it inside client
2023-07-31 09:58:41 +03:00
robot-clickhouse
010f3f1db1 Automatic style fix 2023-07-31 05:39:49 +00:00
Alexey Milovidov
a7b4a29ed9
Merge branch 'master' into fixes-start-stop-listen 2023-07-31 08:34:17 +03:00
Alexey Milovidov
efad90d0f2 Maybe fix TLS tests 2023-07-31 07:26:36 +02:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
robot-ch-test-poll3
10c6c040aa
Merge pull request #52779 from ClickHouse/revert-52496-revert-52419-implement_borders_for_sampling_memory_profiler
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler""
2023-07-31 05:18:27 +02:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
3e5767853d Disable test for sanitizers 2023-07-30 14:15:17 +02:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
Kseniia Sumarokova
3a2f446b8b
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-30 13:34:24 +02:00
kssenii
6e99e5c453 Fix another flaky test 2023-07-30 13:27:01 +02:00
Илья Коргун
7725c53408 Reformat the previously added test with black 2023-07-30 09:42:57 +03:00
Илья Коргун
c921748d61 Add named collections ddl on cluster integration test 2023-07-30 08:58:16 +03:00
Yury Bogomolov
ba081ed402
Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
pufit
f42cfddee7
Update test.py 2023-07-28 20:28:56 -04:00
Alexey Milovidov
5d2fb786f6
Merge branch 'master' into fixes-start-stop-listen 2023-07-29 00:39:58 +03:00
Sema Checherinda
20995fcb13
Merge branch 'master' into reset-connection-s3 2023-07-28 23:13:35 +04:00
Yury Bogomolov
b2ee4505fb review fixes 2023-07-28 16:06:03 +00:00
pufit
f3a31c20fe
Update test_row_policy.py 2023-07-28 10:53:02 -04:00
pufit
4e8f7f06af
Merge branch 'master' into pufit/keeper-client-improvements 2023-07-28 10:32:27 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
Raúl Marín
e2a3a0e37a Adapt test 2023-07-28 13:33:14 +02:00
Alexey Milovidov
a1e9a76ead
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-28 13:18:10 +03:00
Sema Checherinda
115a085d0f
Merge branch 'master' into reset-connection-s3 2023-07-28 14:00:14 +04:00
Nikolay Degterinsky
0e30b9651a
Merge branch 'master' into fixes-start-stop-listen 2023-07-28 11:35:31 +02:00
robot-ch-test-poll4
501bf47f19
Merge pull request #52709 from ClickHouse/Improvements_to_backup_restore_concurrency_test
Improvements to backup restore disallow_concurrency test
2023-07-28 10:48:50 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
robot-clickhouse
9fd99ce814 Automatic style fix 2023-07-28 06:34:05 +00:00
pufit
0e15f098d1 Yet another fix test 2023-07-28 02:22:44 -04:00
pufit
9dbb106dc1 Fix tests, docs 2023-07-27 23:37:09 -04:00
robot-clickhouse
7d8dc92ed0 Automatic style fix 2023-07-27 21:07:54 +00:00
Sema Checherinda
4629ab1df1 add test with broken pipe 2023-07-28 00:24:05 +04:00
yariks5s
da53bca6e4 added tests 2023-07-27 18:29:50 +00:00
Smita Kulkarni
380da31512 Improvements to backup restore disallow_concurrency test 2023-07-27 19:03:44 +02:00
Nikolay Degterinsky
ee9bad7a31 Fix style 2023-07-27 14:18:46 +00:00
Nikolay Degterinsky
b5160c8072 Fix bugs and better test for SYSTEM STOP LISTEN 2023-07-27 14:16:19 +00:00
Antonio Andelic
04361908e6 Fix test_keeper_reconfig_replace_leader 2023-07-27 10:36:02 +00:00
Robert Schulze
c04fb61487
Merge branch 'master' into follow-up-to-50986 2023-07-27 10:28:59 +02:00
Alexey Milovidov
d3ad7e7d55
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-27 01:14:52 +03:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016)
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-07-26 19:58:41 +02:00
pufit
6b845ae255 Fix tests 2023-07-26 11:15:27 -04:00
pufit
ea672ba618 Add docs, add tests, fix small issues. 2023-07-26 11:15:27 -04:00
Sema Checherinda
7d430b8037 retry ConnectionResetException 2023-07-26 17:31:14 +04:00
Robert Schulze
aa25ce9e3d
Follow-up to "Implement support of encrypted elements in configuration file"
Cf. PR #50986

- rename XML attribute "encryption_codec" to "encrypted_by"
2023-07-26 13:27:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Kruglov Pavel
a875cf5898
Merge pull request #51286 from Avogar/better-progress-bar-2
Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions
2023-07-26 13:16:49 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822
Implement support of encrypted elements in configuration file
2023-07-26 12:27:04 +02:00
Roman Vasin
2cf79ac592 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-984 2023-07-26 09:58:26 +00:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Roman Vasin
2b91a9da78 Remove logging from test 2023-07-26 07:51:26 +00:00
pufit
21e12ea084 Fix tests 2023-07-26 00:53:45 -04:00
robot-clickhouse
48fa1047a9
Merge pull request #52575 from valbok/typos
MaterializedMySQL: Fix typos in tests
2023-07-26 06:45:54 +02:00
Alexey Milovidov
7ac5c421ad
Merge pull request #49343 from ClickHouse/sleep-each-row-max-time
Merging #34909
2023-07-26 00:03:27 +03:00
Alexander Tokmakov
d85f9ddb35
Update parallel_skip.json 2023-07-26 00:03:08 +03:00
Alexander Tokmakov
20300804b1
Update test.py 2023-07-26 00:01:46 +03:00
Sema Checherinda
c341df1949 draft with retry ConnectionResetException 2023-07-25 19:59:39 +04:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Val Doroshchuk
bd09ad6736 MaterializedMySQL: Fix typos in tests 2023-07-25 16:20:24 +02:00
robot-clickhouse
d7de8bf797 Automatic style fix 2023-07-25 13:03:12 +00:00
Alexander Tokmakov
328d0a5269 fix 2023-07-25 14:50:27 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count
Rewrite uniq to count
2023-07-25 11:41:00 +02:00
Roman Vasin
ab55c294bf Add assert for STANDARD storage class 2023-07-25 07:25:27 +00:00
robot-ch-test-poll
bd5d93e439
Merge pull request #52536 from ClickHouse/Fix_disallow_concurrent_backup_restore_test
Fix disallow_concurrency test for backup and restore
2023-07-25 09:10:27 +02:00
Alexey Milovidov
fbcc06685b
Merge pull request #51367 from ClickHouse/remove-wrong-code
Attempt to remove wrong code (catch/throw in Functions)
2023-07-25 05:44:22 +03:00
Alexey Milovidov
787757fd25
Merge pull request #52497 from ClickHouse/Fix_test_insert_same_partition_and_merge_increase_timeout
Fix test_insert_same_partition_and_merge by increasing wait time
2023-07-25 05:39:20 +03:00
Kseniia Sumarokova
e05e0ec557
Merge pull request #52318 from valbok/utf8-names
MaterializedMySQL: Support unquoted utf-8 strings in DDL
2023-07-24 21:49:33 +02:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Alexander Tokmakov
c3e2077449
Merge branch 'master' into comment-db 2023-07-24 20:53:46 +03:00
Alexey Milovidov
b9375782bd Merge branch 'master' into remove-wrong-code 2023-07-24 19:34:01 +02:00
Alexander Tokmakov
032956dd1e fix 2023-07-24 18:42:02 +02:00
Alexey Milovidov
0bbf26549f Fix test 2023-07-24 18:13:15 +02:00
Alexey Milovidov
12b5c0dde7 Merge branch 'master' into sleep-each-row-max-time 2023-07-24 18:10:38 +02:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
robot-ch-test-poll3
40f53c4659
Merge pull request #52515 from ClickHouse/fix-test_throttling
Fix `test_throttling`
2023-07-24 15:58:28 +02:00
Antonio Andelic
5da6c99f6d
Add comment 2023-07-24 12:02:27 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
Antonio Andelic
3710c7238d Fix test_throttling 2023-07-24 09:19:06 +00:00
Val Doroshchuk
efa638ef3c MaterializedMySQL: Support unquoted utf-8 strings in DDL
Since ClickHouse does not support unquoted utf-8 strings but MySQL does.

Instead of fixing Lexer to recognize utf-8 chars as TokenType::BareWord,
suggesting to quote all unrecognized tokens before applying any DDL.

Actual parsing and validating the syntax will be done by particular Parser.

If there is any TokenType::Error, the query is unable to be parsed anyway.
Quoting such tokens can provide the support of utf-8 names.

See `tryQuoteUnrecognizedTokens` and `QuoteUnrecognizedTokensTest`.

mysql> CREATE TABLE 道.渠(...

is converted to

CREATE TABLE `道`.`渠`(...

Also fixed the bug with missing * while doing SELECT in full sync because db or table name are back quoted when not needed.
2023-07-24 11:12:10 +02:00
Azat Khuzhin
0401dc453e Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop
Since there can be some leftovers:

    2023.07.24 07:08:25.238066 [ 140 ] {} <Error> Application: Code: 219. DB::Exception: Cannot drop: filesystem error: in remove: Directory not empty ["/var/lib/clickhouse/data/system/"]. Probably database contain some detached tables or metadata leftovers from Ordinary engine. If you want to remove all data anyway, try to attach database back and drop it again with enabled force_remove_data_recursively_on_drop setting: Exception while trying to convert database system from Ordinary to Atomic. It may be in some intermediate state. You can finish conversion manually by moving the rest tables from system to .tmp_convert.system.9396432095832455195 (using RENAME TABLE) and executing DROP DATABASE system and RENAME DATABASE .tmp_convert.system.9396432095832455195 TO system. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000e68af57 in /usr/bin/clickhouse
    1. ? @ 0x000000000cab443c in /usr/bin/clickhouse
    2. DB::DatabaseOnDisk::drop(std::shared_ptr<DB::Context const>) @ 0x000000001328d617 in /usr/bin/clickhouse
    3. DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000013524a6c in /usr/bin/clickhouse
    4. DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000013bc05e4 in /usr/bin/clickhouse
    5. DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000013bbc6b8 in /usr/bin/clickhouse
    6. DB::InterpreterDropQuery::execute() @ 0x0000000013bbba22 in /usr/bin/clickhouse
    7. ? @ 0x00000000140b13a5 in /usr/bin/clickhouse
    8. DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x00000000140ad20e in /usr/bin/clickhouse
    9. ? @ 0x00000000140d2ef0 in /usr/bin/clickhouse
    10. DB::maybeConvertSystemDatabase(std::shared_ptr<DB::Context>) @ 0x00000000140d0aaf in /usr/bin/clickhouse
    11. DB::Server::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000e724e55 in /usr/bin/clickhouse
    12. Poco::Util::Application::run() @ 0x0000000017ead086 in /usr/bin/clickhouse
    13. DB::Server::run() @ 0x000000000e714a5d in /usr/bin/clickhouse
    14. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000017ec07b9 in /usr/bin/clickhouse
    15. mainEntryClickHouseServer(int, char**) @ 0x000000000e711a26 in /usr/bin/clickhouse
    16. main @ 0x0000000008cf13cf in /usr/bin/clickhouse
    17. __libc_start_main @ 0x0000000000021b97 in /lib/x86_64-linux-gnu/libc-2.27.so
    18. _start @ 0x00000000080705ae in /usr/bin/clickhouse
     (version 23.7.1.2012)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 10:34:50 +02:00
Smita Kulkarni
0e46cf86b7 Added try-except to check cases when second backup/restore is picked up first 2023-07-24 08:52:19 +02:00
Alexey Milovidov
ac54be9652 Fix a test 2023-07-24 05:56:18 +02:00
Alexey Milovidov
eb5038f3e9
Merge pull request #52295 from ClickHouse/allow_vertical_merges_from_compact_to_wide_parts
Enable `allow_vertical_merges_from_compact_to_wide_parts` by default
2023-07-24 06:44:33 +03:00
JackyWoo
ab3376a998
Merge branch 'master' into rewrite_uniq_to_count 2023-07-24 11:04:36 +08:00
Alexey Milovidov
706da4d530
Merge pull request #51973 from ClickHouse/integration-tests-fix-disaster-2
Fix disaster in integration tests, part 2
2023-07-24 02:57:39 +03:00
robot-clickhouse
dba7a0dffc Automatic style fix 2023-07-23 23:18:19 +00:00
Alexey Milovidov
40f5649811 Fix test 2023-07-24 01:02:11 +02:00
Sema Checherinda
cfed3589b0 fix style 2023-07-24 01:11:26 +03:00
Alexey Milovidov
7ff3579115
Merge pull request #49631 from ClickHouse/sparse-columns-by-default
Enable Sparse columns by default
2023-07-23 21:18:05 +03:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets
MaterializedMySQL: Introduce charset conversion
2023-07-23 18:36:30 +02:00
Smita Kulkarni
039cac69cf Fix test_insert_same_partition_and_merge by increasing wait time 2023-07-23 18:35:37 +02:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Alexey Milovidov
0ef6453935
Merge pull request #52148 from azat/tests/EADDRINUSE
Fix possible EADDRINUSE ("Address already in use") in integration tests
2023-07-23 01:27:47 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Alexey Milovidov
5a3f872a4b
Merge branch 'master' into integration-tests-fix-disaster-2 2023-07-22 19:37:59 +03:00
Alexey Milovidov
b869466a6a
Merge branch 'master' into sparse-columns-by-default 2023-07-22 19:34:29 +03:00
alesapin
835c36cbf3
Merge pull request #52419 from ClickHouse/implement_borders_for_sampling_memory_profiler
Add an ability to specify allocations size for sampling memory profiler
2023-07-22 18:13:26 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
kssenii
4fc3d0b290 Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-22 14:45:38 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
7af9af1a3f
Merge pull request #52103 from azat/tests/test_materialized_mysql_database
tests: drop existing view in test_materialized_mysql_database
2023-07-22 03:41:52 +03:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
ae8f511ac5 Fix a test 2023-07-22 02:27:07 +02:00
Alexey Milovidov
860e3975ad Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-22 02:25:23 +02:00
Alexey Milovidov
91fd286165 Merge branch 'master' into sleep-each-row-max-time 2023-07-22 02:25:03 +02:00
Alexey Milovidov
37a7b13ca6
Merge pull request #52095 from azat/tests/fix-docker-network-prune
Add missing --force for docker network prune (otherwise it is noop on CI)
2023-07-22 02:30:28 +03:00
Sema Checherinda
3cc7f137bd add tests with connection reset by peer 2023-07-22 00:45:12 +02:00
robot-ch-test-poll
8175ba8ade
Merge pull request #52408 from ClickHouse/fix-test_keeper_force_recovery
Fix `test_keeper_force_recovery`
2023-07-22 00:22:54 +02:00
Alexey Milovidov
de949b6844
Merge pull request #52306 from ClickHouse/backuptestfix
Add missing replica syncs in test_backup_restore_on_cluster
2023-07-22 00:57:24 +03:00
kssenii
f82364d2c9 Fix flaky test 2023-07-21 17:03:30 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf
`reconfig` support for CH Keeper
2023-07-21 15:59:25 +02:00
robot-clickhouse
2a6b96f9e3 Automatic style fix 2023-07-21 13:51:40 +00:00
Roman Vasin
1daa26c741 Fix black formatting 2023-07-21 13:31:42 +00:00
Yarik Briukhovetskyi
e7b9b42326
Merge branch 'master' into rewrite_uniq_to_count 2023-07-21 15:30:03 +02:00
Roman Vasin
10ec069175 Improve exception message text 2023-07-21 13:29:40 +00:00
Roman Vasin
0aed62ec73 Add codec name into exception message 2023-07-21 13:03:25 +00:00
Alexander Sapin
4695ec6802 Add an ability to specify allocations size for sampling memory profiler 2023-07-21 14:56:29 +02:00
Nikita Mikhaylov
5ea0971921
Merge pull request #52379 from ClickHouse/fix-test-with-encrypted-disks
Fix `test_replicated_merge_tree_encrypted_disk `
2023-07-21 14:12:51 +02:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
Azat Khuzhin
0f96992322 Fix possible EADDRINUSE ("Address already in use") in integration tests
Here is one example [1]:

    minio1_1    | WARNING: Console endpoint is listening on a dynamic port (32911), please use --console-address ":PORT" to choose a static port.
    minio1_1    | ERROR Unable to initialize console server: Specified port is already in use
    minio1_1    |       > Please ensure no other program uses the same address/port

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/52103/7d510eac7c5f0dfb3361e269be30972e6022fada/integration_tests__tsan__[1_6].html

And here is second [2]:

    java.net.BindException: Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/51493/63e88b725d3d255a6534adce4d434ce5f95d2874/integration_tests__asan__[1_6].html

v2: increase the limit from 5K to 10K
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-21 13:47:42 +02:00
Nikolai Kochetov
e02a7c7382
Merge pull request #52375 from ClickHouse/disable-analyzer-bc-tests
Disable analyzer setting in backward_compatibility integration tests.
2023-07-21 13:39:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
3815a6aa62 Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
Smita Kulkarni
6cc8a9af5c Fixed named collection tests 2023-07-21 11:19:12 +02:00
Antonio Andelic
234b5047b5
Merge pull request #52373 from ClickHouse/fix-test_keeper_session
Fix `test_keeper_session`
2023-07-21 08:33:37 +02:00
Roman Vasin
695a6b7bb3 Add integration test 2023-07-21 06:18:54 +00:00
robot-clickhouse
a8c08b34a6 Automatic style fix 2023-07-21 02:39:21 +00:00
pufit
2a00e2aa6a Implement MOVE query for the access entities. 2023-07-20 22:20:36 -04:00
Yury Bogomolov
c8b128aad4 add predefined macros support in kafka engine settings 2023-07-21 01:06:49 +04:00
Nikita Mikhaylov
920887f315 Done 2023-07-20 16:43:59 +00:00
Michael Kolupaev
97e54d6eba Fix test_backup_restore_on_cluster flakiness caused by missing replica syncs 2023-07-20 15:57:29 +00:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover
Handle multiple resolved IPs for HTTP/HTTPS session connection
2023-07-20 18:25:45 +03:00
robot-clickhouse
a26de1b370 Automatic style fix 2023-07-20 15:12:55 +00:00
Nikolai Kochetov
ea252e2f61 Disable analyzer setting in backward_compatibility integration tests. 2023-07-20 15:05:07 +00:00
Roman Vasin
8adf57a698 Fix text in comments and improve exception handling 2023-07-20 14:18:32 +00:00
robot-clickhouse
5decb1f5c5 Automatic style fix 2023-07-20 14:11:11 +00:00
Antonio Andelic
f997adfe27 Retry if sessions not closed because missing leader 2023-07-20 14:02:55 +00:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync
Fix materialised pg syncTables
2023-07-20 15:38:18 +02:00
Alexander Tokmakov
96a890b8a2
Merge pull request #52307 from ClickHouse/repdbtestfix
Fix test_replicated_database 'node doesn't exist' flakiness
2023-07-20 16:30:42 +03:00
Kseniia Sumarokova
ed38c45729
Merge pull request #52067 from valbok/start-transaction
MaterializedMySQL: Support CREATE TABLE AS SELECT
2023-07-20 15:28:11 +02:00
Val Doroshchuk
d16d444943 MaterializedMySQL: Add support of double quoted comments 2023-07-20 13:59:01 +02:00
Kruglov Pavel
b08c72b28d
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-20 12:45:19 +02:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
János Benjamin Antal
16cc007842 Fix table ad variable name 2023-07-20 09:21:18 +00:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry
Basic auth to fetch Avro schema in Kafka
2023-07-20 10:58:11 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
Song Liyong
7837559dbf MaterializedMySQL: Support CREATE TABLE AS SELECT 2023-07-19 13:33:02 +02:00
JackyWoo
08409059cc support alias for new analyzer 2023-07-19 18:46:20 +08:00
alesapin
08022f474b
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-19 12:00:07 +02:00
János Benjamin Antal
5ed23fd749
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-19 11:11:36 +02:00
robot-clickhouse
70543e8ef9 Automatic style fix 2023-07-19 08:47:53 +00:00
Ilya Golshtein
c8347bd313 test_for_basic_auth_registry: some comments removed per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
9f6ab5e816 test_for_basic_auth_registry - made black formatter happy 2023-07-19 08:32:45 +00:00
Ilya Golshtein
f1ce1da007 test_for_basic_auth_registry - new test and cleanup per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Michael Kolupaev
a86baab88b Fix test_replicated_database 'node doesn't exist' flakiness 2023-07-19 08:28:04 +00:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290
Add support for multi-directory globs
2023-07-19 06:24:38 +02:00
robot-clickhouse
3c8141529f Automatic style fix 2023-07-18 23:25:21 +00:00
Alexey Milovidov
c724816cb8 Fix test 2023-07-19 01:15:16 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
robot-clickhouse
ff6e5ff1c5 Automatic style fix 2023-07-18 20:23:55 +00:00
Alexey Milovidov
b2164ab97e Fix integration tests 2023-07-18 22:13:28 +02:00
Alexey Milovidov
d423add083 Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-18 22:06:49 +02:00
Alexey Milovidov
06914e8196 Merge branch 'master' into sleep-each-row-max-time 2023-07-18 22:06:27 +02:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
János Benjamin Antal
6a104cc3f7 Add checked waits to improve kafka tests
It might take a few minutes to receive all the messages for the last
materialized view. By waiting to the number of expected results the
happy path of execution takes minimal time while becoming more stable,
while the erroneous path might take a bit longer.
2023-07-18 16:04:41 +00:00
Roman Vasin
50734017ae Fix test style with black 2023-07-18 15:45:43 +00:00
Roman Vasin
c8c6c31384 Change Method into method in exceptions 2023-07-18 15:33:50 +00:00
kssenii
680903e89b Fix style check 2023-07-18 16:54:33 +02:00
Roman Vasin
ea3d9e92f1 Add support of YAML configs for decryption 2023-07-18 14:44:47 +00:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
alesapin
5fe90208cf
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-18 14:43:18 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Azat Khuzhin
baf6d182d6 Fix reporting some BROKEN tests as ERROR
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:22:38 +02:00
Azat Khuzhin
92ca2b0bdd Make psql tests in test_odbc_interaction more robust to other test failures
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:22:28 +02:00
Azat Khuzhin
e9b7a84aa1 Fix network manager for integration tests
Sometimes you may get:

    >           raise subprocess.CalledProcessError(exit_code, cmd)
    E           subprocess.CalledProcessError: Command '['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.2.3', '-d', '172.16.2.2', '-j', 'DROP']' returned non-zero exit status 137.

And only sometimes you may get the reason:

    OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown

So this means that container for iptables does not exists anymore, and
the reason is the timeout. And the fact that container_exit_timeout was
equal to container_expire_timeout and was 120.

From the docker logs:

    time="2023-07-16T15:46:52.513673446Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"
    time="2023-07-16T15:48:57.611857183Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"

And then pytest will try to execute the iptables command:

    time="2023-07-16T15:50:57.698705244Z" level=debug msg="starting exec command 860920ab2aa07e8d285050f200ac92423a3cf8ec3fb2f57683541e62cf6bc20e in container 66d6c96671b5e987345290ddd260727d96b99789b512d40f333f6263f42fd2f1"

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-18 12:17:26 +02:00
Alexey Milovidov
3dbad00313
Merge branch 'master' into deprecate-metadata-cache 2023-07-18 05:27:15 +03:00
Alexey Milovidov
22c72db848
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-18 02:59:25 +03:00
Alexey Milovidov
806caea282 Update more tests 2023-07-18 01:56:38 +02:00
Alexey Milovidov
a4b92652da Update more tests 2023-07-18 01:50:43 +02:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Alexey Milovidov
4884022fda
Merge branch 'master' into zvonand-issue-49290 2023-07-17 23:03:50 +03:00
Kruglov Pavel
4ed8dcd436
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-17 21:02:33 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
robot-clickhouse
32311bf28f Automatic style fix 2023-07-17 15:30:31 +00:00
Azat Khuzhin
6c986c1fb2 Allow test names with spaces in it
It had been fixed and now it is allowed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:29:44 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
SmitaRKulkarni
3bb7db45c4
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-17 17:23:29 +02:00
Smita Kulkarni
671f8b34d0 Added test with all signatures and fixed style check 2023-07-17 17:18:14 +02:00
Azat Khuzhin
acbdbf6ab7 tests: do not use --format if --quiet is set in integration runner
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
e532d5b376 tests: use -- over quotes on and on in ci-runner.py
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Antonio Andelic
51f0089457
Merge branch 'master' into fix-test_multiple_disks 2023-07-17 16:25:06 +02:00
Andrey Zvonov
d339c22a2f
Merge branch 'master' into zvonand-issue-49290 2023-07-17 16:43:15 +03:00
kssenii
7a224c252e One more fix 2023-07-17 15:04:39 +02:00
kssenii
9c66655288 Fix tests 2023-07-17 15:01:58 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00