thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-21 09:10:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
122,865 Commits 8,936 Branches 1,766 Tags 2 GiB
e7213ef5b9
Commit Graph

7432 Commits

Author SHA1 Message Date
Nikolai Kochetov
5d64e036ba
Merge pull request #52695 from yariks5s/in_schema_case_sensitiveness 
Information_schema case sensitiveness
 2023-08-03 12:15:31 +02:00
Val Doroshchuk
7da85cc0de MaterializedMySQL: Add tests for unquoted utf8 column names in DML 2023-08-03 11:53:56 +02:00
Aleksei Filatov
0fc0a89f80 Add tests 2023-08-03 12:45:07 +03:00
Duc Canh Le
cc7f771093 Fix for postgres as well 2023-08-03 09:15:45 +00:00
Alexey Gerasimchuck
c7fcc611b2 added TSAN option report_atomic_races=0 2023-08-03 08:27:58 +00:00
Duc Canh Le
06229c1ba6 fix password leak in show create mysql table 2023-08-03 03:50:41 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE 
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:17:49 +02:00
Anton Popov
89bb3f3410
fix style-check 2023-08-02 19:25:33 +02:00
Victor Krasnov
d8792bf429 Merge branch 'master' into ADQM-985 
# Conflicts:
#	docs/en/operations/backup.md
 2023-08-02 20:17:59 +03:00
kssenii
d87162f43c Fix 2023-08-02 17:09:47 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
robot-clickhouse
6e49d3add6 Automatic style fix 2023-08-02 12:34:43 +00:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Yarik Briukhovetskyi
ffdc174c9a
Update test.py 2023-08-02 13:24:05 +02:00
Alexander Tokmakov
716b1ebcb7
Merge pull request #52907 from ClickHouse/merging_52897 
Merging #52897
 2023-08-02 13:06:23 +03:00
Kseniia Sumarokova
b2d2a295fd
Merge pull request #49086 from s-kat/s3queue 
Streaming Data Import From S3
 2023-08-02 11:32:48 +02:00
robot-clickhouse
c1752355b4 Automatic style fix 2023-08-02 06:40:32 +00:00
Antonio Andelic
dc33564044 Disable reconfig test until proper fix 2023-08-02 06:30:22 +00:00
Alexey Gerasimchuck
288e3f75fb fix json 2023-08-02 00:36:25 +00:00
Alexey Gerasimchuck
7e37f1fabd fixed test flakiness 2023-08-02 00:32:20 +00:00
Kseniia Sumarokova
8893670d98
Merge branch 'master' into s3queue 2023-08-01 18:42:32 +02:00
Yarik Briukhovetskyi
104a4aaee5
Merge pull request #51117 from ClickHouse/pufit/keeper-client-improvements 
Implementing new commands for keeper-client
 2023-08-01 17:47:33 +02:00
yariks5s
2227945529 fixed tests 2023-08-01 13:34:19 +00:00
János Benjamin Antal
a6861ea2f5
Merge pull request #52386 from ybogo/support-predefined-macro-in-kafka-settings 
Add predefined macros support in Kafka engine settings
 2023-08-01 14:49:01 +02:00
Victor Krasnov
9027ab968e Extend the set of test cases in the integration test 2023-08-01 15:44:43 +03:00
robot-clickhouse
4561378c20 Automatic style fix 2023-08-01 10:57:46 +00:00
Smita Kulkarni
ce4f273be1 Updated list of retryable errors and updated both tests to use same azure_query function 2023-08-01 12:39:36 +02:00
Victor Krasnov
505b4d0112 Simplify the integration test - use backup to File instead of Disk 2023-08-01 13:39:23 +03:00
Alexander Tokmakov
abb80d45f0
Merge branch 'master' into tavplubix-patch-8 2023-08-01 13:30:13 +03:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token 
Azure blob storage sas token
 2023-08-01 12:27:17 +02:00
serxa
f4779dac41 Merge branch 'improve-throttling-tests' of github.com:ClickHouse/ClickHouse into improve-throttling-tests 2023-08-01 09:44:14 +00:00
serxa
135790c0d6 more fixes 2023-08-01 09:44:08 +00:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx 
Replace kssenii/nginx-test by clickhouse/nginx-dav
 2023-08-01 11:36:20 +02:00
Victor Krasnov
946f2f0b39 Simplify the integration test - dispose of the excessive details that cluttered it 2023-08-01 12:24:08 +03:00
Sergei Trifonov
1e44ada200
Merge branch 'master' into improve-throttling-tests 2023-08-01 11:16:21 +02:00
serxa
513d3fd3c1 fix more places 2023-08-01 09:15:35 +00:00
Nikolai Kochetov
15c77afd8e
Merge pull request #52823 from ClickHouse/try-fix-test_version_update_after_mutation 
Try to remove more leftovers.
 2023-07-31 22:22:18 +02:00
Victor Krasnov
2ed74507e7 Blacken test_backup_restore_storage_policy/test.py 2023-07-31 22:05:23 +03:00
Victor Krasnov
731b780b84 Add integration test 2023-07-31 21:06:13 +03:00
alesapin
0784379583
Merge pull request #52822 from ClickHouse/trying_to_debug_materialize_mysql 
Add more logging and touch test for materialize mysql
 2023-07-31 19:52:55 +02:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984 
Add s3_storage_class parameter in SETTINGS of BACKUP statement
 2023-07-31 17:32:12 +02:00
Alexander Tokmakov
e02805d9f7
Update test.py 2023-07-31 16:55:51 +03:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
Nikolai Kochetov
b98d54cdf3 Add flushing logs 2023-07-31 13:05:53 +00:00
Nikolai Kochetov
8f5d0c0cd4 Revert "Merge pull request #52514 from azat/tests/fix-test_version_update_after_mutation" 
This reverts commit dd491eeae2, reversing
changes made to b225f9c34b.
 2023-07-31 13:03:04 +00:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939 
Added max_sessions_for_user setting
 2023-07-31 15:38:58 +03:00
alesapin
efba3a2113 Add more logging and touch test for materialize mysql 2023-07-31 14:32:09 +02:00
serxa
fb8502ba76 do not test upper bounds for throttlers 2023-07-31 12:20:27 +00:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime 
Introduce fallback ZooKeeper sessions
 2023-07-31 15:14:44 +03:00
robot-ch-test-poll4
891ae75c55
Merge pull request #52680 from evillique/fixes-start-stop-listen 
Fix bugs and better test for SYSTEM STOP LISTEN
 2023-07-31 11:39:50 +02:00
Antonio Andelic
1a95a6810f
Merge branch 'master' into fix-test_keeper_reconfig_replace_leader 2023-07-31 10:58:29 +02:00
Alexey Milovidov
d3ea44326a
Merge pull request #52796 from ClickHouse/maybe-fix-tls-tests 
Maybe fix TLS tests
 2023-07-31 11:47:53 +03:00
Alexey Gerasimchuck
7e9e0ac758
Merge branch 'master' into ADQM-939 2023-07-31 18:12:29 +10:00
Alexey Milovidov
c825f15b74
Merge pull request #52441 from CheSema/reset-connection-s3 
add tests with connection reset by peer error, and retry it inside client
 2023-07-31 09:58:41 +03:00
robot-clickhouse
010f3f1db1 Automatic style fix 2023-07-31 05:39:49 +00:00
Alexey Milovidov
a7b4a29ed9
Merge branch 'master' into fixes-start-stop-listen 2023-07-31 08:34:17 +03:00
Alexey Milovidov
efad90d0f2 Maybe fix TLS tests 2023-07-31 07:26:36 +02:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
robot-ch-test-poll3
10c6c040aa
Merge pull request #52779 from ClickHouse/revert-52496-revert-52419-implement_borders_for_sampling_memory_profiler 
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler""
 2023-07-31 05:18:27 +02:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
3e5767853d Disable test for sanitizers 2023-07-30 14:15:17 +02:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
Kseniia Sumarokova
3a2f446b8b
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-30 13:34:24 +02:00
kssenii
6e99e5c453 Fix another flaky test 2023-07-30 13:27:01 +02:00
Илья Коргун
7725c53408 Reformat the previously added test with black 2023-07-30 09:42:57 +03:00
Илья Коргун
c921748d61 Add named collections ddl on cluster integration test 2023-07-30 08:58:16 +03:00
Yury Bogomolov
ba081ed402
Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
pufit
f42cfddee7
Update test.py 2023-07-28 20:28:56 -04:00
Alexey Milovidov
5d2fb786f6
Merge branch 'master' into fixes-start-stop-listen 2023-07-29 00:39:58 +03:00
Sema Checherinda
20995fcb13
Merge branch 'master' into reset-connection-s3 2023-07-28 23:13:35 +04:00
Yury Bogomolov
b2ee4505fb review fixes 2023-07-28 16:06:03 +00:00
pufit
f3a31c20fe
Update test_row_policy.py 2023-07-28 10:53:02 -04:00
pufit
4e8f7f06af
Merge branch 'master' into pufit/keeper-client-improvements 2023-07-28 10:32:27 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache 
Deprecate the `metadata_cache` feature
 2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
Alexey Milovidov
a1e9a76ead
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-28 13:18:10 +03:00
Sema Checherinda
115a085d0f
Merge branch 'master' into reset-connection-s3 2023-07-28 14:00:14 +04:00
Nikolay Degterinsky
0e30b9651a
Merge branch 'master' into fixes-start-stop-listen 2023-07-28 11:35:31 +02:00
robot-ch-test-poll4
501bf47f19
Merge pull request #52709 from ClickHouse/Improvements_to_backup_restore_concurrency_test 
Improvements to backup restore disallow_concurrency test
 2023-07-28 10:48:50 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
robot-clickhouse
9fd99ce814 Automatic style fix 2023-07-28 06:34:05 +00:00
pufit
0e15f098d1 Yet another fix test 2023-07-28 02:22:44 -04:00
pufit
9dbb106dc1 Fix tests, docs 2023-07-27 23:37:09 -04:00
robot-clickhouse
7d8dc92ed0 Automatic style fix 2023-07-27 21:07:54 +00:00
Sema Checherinda
4629ab1df1 add test with broken pipe 2023-07-28 00:24:05 +04:00
yariks5s
da53bca6e4 added tests 2023-07-27 18:29:50 +00:00
Smita Kulkarni
380da31512 Improvements to backup restore disallow_concurrency test 2023-07-27 19:03:44 +02:00
Nikolay Degterinsky
ee9bad7a31 Fix style 2023-07-27 14:18:46 +00:00
Nikolay Degterinsky
b5160c8072 Fix bugs and better test for SYSTEM STOP LISTEN 2023-07-27 14:16:19 +00:00
Antonio Andelic
04361908e6 Fix test_keeper_reconfig_replace_leader 2023-07-27 10:36:02 +00:00
Robert Schulze
c04fb61487
Merge branch 'master' into follow-up-to-50986 2023-07-27 10:28:59 +02:00
Alexey Milovidov
d3ad7e7d55
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-27 01:14:52 +03:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016) 
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-07-26 19:58:41 +02:00
pufit
6b845ae255 Fix tests 2023-07-26 11:15:27 -04:00
pufit
ea672ba618 Add docs, add tests, fix small issues. 2023-07-26 11:15:27 -04:00
Sema Checherinda
7d430b8037 retry ConnectionResetException 2023-07-26 17:31:14 +04:00
Robert Schulze
aa25ce9e3d
Follow-up to "Implement support of encrypted elements in configuration file" 
Cf. PR #50986

- rename XML attribute "encryption_codec" to "encrypted_by"
 2023-07-26 13:27:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Kruglov Pavel
a875cf5898
Merge pull request #51286 from Avogar/better-progress-bar-2 
Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions
 2023-07-26 13:16:49 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822 
Implement support of encrypted elements in configuration file
 2023-07-26 12:27:04 +02:00
Roman Vasin
2cf79ac592 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-984 2023-07-26 09:58:26 +00:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Roman Vasin
2b91a9da78 Remove logging from test 2023-07-26 07:51:26 +00:00
pufit
21e12ea084 Fix tests 2023-07-26 00:53:45 -04:00
robot-clickhouse
48fa1047a9
Merge pull request #52575 from valbok/typos 
MaterializedMySQL: Fix typos in tests
 2023-07-26 06:45:54 +02:00
Alexey Milovidov
7ac5c421ad
Merge pull request #49343 from ClickHouse/sleep-each-row-max-time 
Merging #34909
 2023-07-26 00:03:27 +03:00
Alexander Tokmakov
d85f9ddb35
Update parallel_skip.json 2023-07-26 00:03:08 +03:00
Alexander Tokmakov
20300804b1
Update test.py 2023-07-26 00:01:46 +03:00
Sema Checherinda
c341df1949 draft with retry ConnectionResetException 2023-07-25 19:59:39 +04:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Val Doroshchuk
bd09ad6736 MaterializedMySQL: Fix typos in tests 2023-07-25 16:20:24 +02:00
robot-clickhouse
d7de8bf797 Automatic style fix 2023-07-25 13:03:12 +00:00
Alexander Tokmakov
328d0a5269 fix 2023-07-25 14:50:27 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count 
Rewrite uniq to count
 2023-07-25 11:41:00 +02:00
Roman Vasin
ab55c294bf Add assert for STANDARD storage class 2023-07-25 07:25:27 +00:00
robot-ch-test-poll
bd5d93e439
Merge pull request #52536 from ClickHouse/Fix_disallow_concurrent_backup_restore_test 
Fix disallow_concurrency test for backup and restore
 2023-07-25 09:10:27 +02:00
Alexey Milovidov
fbcc06685b
Merge pull request #51367 from ClickHouse/remove-wrong-code 
Attempt to remove wrong code (catch/throw in Functions)
 2023-07-25 05:44:22 +03:00
Alexey Milovidov
787757fd25
Merge pull request #52497 from ClickHouse/Fix_test_insert_same_partition_and_merge_increase_timeout 
Fix test_insert_same_partition_and_merge by increasing wait time
 2023-07-25 05:39:20 +03:00
Kseniia Sumarokova
e05e0ec557
Merge pull request #52318 from valbok/utf8-names 
MaterializedMySQL: Support unquoted utf-8 strings in DDL
 2023-07-24 21:49:33 +02:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Alexander Tokmakov
c3e2077449
Merge branch 'master' into comment-db 2023-07-24 20:53:46 +03:00
Alexey Milovidov
b9375782bd Merge branch 'master' into remove-wrong-code 2023-07-24 19:34:01 +02:00
Alexander Tokmakov
032956dd1e fix 2023-07-24 18:42:02 +02:00
Alexey Milovidov
0bbf26549f Fix test 2023-07-24 18:13:15 +02:00
Alexey Milovidov
12b5c0dde7 Merge branch 'master' into sleep-each-row-max-time 2023-07-24 18:10:38 +02:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
robot-ch-test-poll3
40f53c4659
Merge pull request #52515 from ClickHouse/fix-test_throttling 
Fix `test_throttling`
 2023-07-24 15:58:28 +02:00
Antonio Andelic
5da6c99f6d
Add comment 2023-07-24 12:02:27 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
Antonio Andelic
3710c7238d Fix test_throttling 2023-07-24 09:19:06 +00:00
Val Doroshchuk
efa638ef3c MaterializedMySQL: Support unquoted utf-8 strings in DDL 
Since ClickHouse does not support unquoted utf-8 strings but MySQL does.

Instead of fixing Lexer to recognize utf-8 chars as TokenType::BareWord,
suggesting to quote all unrecognized tokens before applying any DDL.

Actual parsing and validating the syntax will be done by particular Parser.

If there is any TokenType::Error, the query is unable to be parsed anyway.
Quoting such tokens can provide the support of utf-8 names.

See `tryQuoteUnrecognizedTokens` and `QuoteUnrecognizedTokensTest`.

mysql> CREATE TABLE 道.渠(...

is converted to

CREATE TABLE `道`.`渠`(...

Also fixed the bug with missing * while doing SELECT in full sync because db or table name are back quoted when not needed.
 2023-07-24 11:12:10 +02:00
Azat Khuzhin
0401dc453e Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop 
Since there can be some leftovers:

    2023.07.24 07:08:25.238066 [ 140 ] {} <Error> Application: Code: 219. DB::Exception: Cannot drop: filesystem error: in remove: Directory not empty ["/var/lib/clickhouse/data/system/"]. Probably database contain some detached tables or metadata leftovers from Ordinary engine. If you want to remove all data anyway, try to attach database back and drop it again with enabled force_remove_data_recursively_on_drop setting: Exception while trying to convert database system from Ordinary to Atomic. It may be in some intermediate state. You can finish conversion manually by moving the rest tables from system to .tmp_convert.system.9396432095832455195 (using RENAME TABLE) and executing DROP DATABASE system and RENAME DATABASE .tmp_convert.system.9396432095832455195 TO system. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000e68af57 in /usr/bin/clickhouse
    1. ? @ 0x000000000cab443c in /usr/bin/clickhouse
    2. DB::DatabaseOnDisk::drop(std::shared_ptr<DB::Context const>) @ 0x000000001328d617 in /usr/bin/clickhouse
    3. DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000013524a6c in /usr/bin/clickhouse
    4. DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000013bc05e4 in /usr/bin/clickhouse
    5. DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000013bbc6b8 in /usr/bin/clickhouse
    6. DB::InterpreterDropQuery::execute() @ 0x0000000013bbba22 in /usr/bin/clickhouse
    7. ? @ 0x00000000140b13a5 in /usr/bin/clickhouse
    8. DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x00000000140ad20e in /usr/bin/clickhouse
    9. ? @ 0x00000000140d2ef0 in /usr/bin/clickhouse
    10. DB::maybeConvertSystemDatabase(std::shared_ptr<DB::Context>) @ 0x00000000140d0aaf in /usr/bin/clickhouse
    11. DB::Server::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000e724e55 in /usr/bin/clickhouse
    12. Poco::Util::Application::run() @ 0x0000000017ead086 in /usr/bin/clickhouse
    13. DB::Server::run() @ 0x000000000e714a5d in /usr/bin/clickhouse
    14. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000017ec07b9 in /usr/bin/clickhouse
    15. mainEntryClickHouseServer(int, char**) @ 0x000000000e711a26 in /usr/bin/clickhouse
    16. main @ 0x0000000008cf13cf in /usr/bin/clickhouse
    17. __libc_start_main @ 0x0000000000021b97 in /lib/x86_64-linux-gnu/libc-2.27.so
    18. _start @ 0x00000000080705ae in /usr/bin/clickhouse
     (version 23.7.1.2012)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 10:34:50 +02:00
Smita Kulkarni
0e46cf86b7 Added try-except to check cases when second backup/restore is picked up first 2023-07-24 08:52:19 +02:00
Alexey Milovidov
ac54be9652 Fix a test 2023-07-24 05:56:18 +02:00
Alexey Milovidov
eb5038f3e9
Merge pull request #52295 from ClickHouse/allow_vertical_merges_from_compact_to_wide_parts 
Enable `allow_vertical_merges_from_compact_to_wide_parts` by default
 2023-07-24 06:44:33 +03:00
JackyWoo
ab3376a998
Merge branch 'master' into rewrite_uniq_to_count 2023-07-24 11:04:36 +08:00
Alexey Milovidov
706da4d530
Merge pull request #51973 from ClickHouse/integration-tests-fix-disaster-2 
Fix disaster in integration tests, part 2
 2023-07-24 02:57:39 +03:00
robot-clickhouse
dba7a0dffc Automatic style fix 2023-07-23 23:18:19 +00:00
Alexey Milovidov
40f5649811 Fix test 2023-07-24 01:02:11 +02:00
Sema Checherinda
cfed3589b0 fix style 2023-07-24 01:11:26 +03:00
Alexey Milovidov
7ff3579115
Merge pull request #49631 from ClickHouse/sparse-columns-by-default 
Enable Sparse columns by default
 2023-07-23 21:18:05 +03:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets 
MaterializedMySQL: Introduce charset conversion
 2023-07-23 18:36:30 +02:00
Smita Kulkarni
039cac69cf Fix test_insert_same_partition_and_merge by increasing wait time 2023-07-23 18:35:37 +02:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Alexey Milovidov
0ef6453935
Merge pull request #52148 from azat/tests/EADDRINUSE 
Fix possible EADDRINUSE ("Address already in use") in integration tests
 2023-07-23 01:27:47 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Alexey Milovidov
5a3f872a4b
Merge branch 'master' into integration-tests-fix-disaster-2 2023-07-22 19:37:59 +03:00
Alexey Milovidov
b869466a6a
Merge branch 'master' into sparse-columns-by-default 2023-07-22 19:34:29 +03:00
alesapin
835c36cbf3
Merge pull request #52419 from ClickHouse/implement_borders_for_sampling_memory_profiler 
Add an ability to specify allocations size for sampling memory profiler
 2023-07-22 18:13:26 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
kssenii
4fc3d0b290 Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-22 14:45:38 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
7af9af1a3f
Merge pull request #52103 from azat/tests/test_materialized_mysql_database 
tests: drop existing view in test_materialized_mysql_database
 2023-07-22 03:41:52 +03:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests 
Fix running integration tests with spaces in it's names
 2023-07-22 03:38:51 +03:00
Alexey Milovidov
ae8f511ac5 Fix a test 2023-07-22 02:27:07 +02:00
Alexey Milovidov
860e3975ad Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-22 02:25:23 +02:00
Alexey Milovidov
91fd286165 Merge branch 'master' into sleep-each-row-max-time 2023-07-22 02:25:03 +02:00
Alexey Milovidov
37a7b13ca6
Merge pull request #52095 from azat/tests/fix-docker-network-prune 
Add missing --force for docker network prune (otherwise it is noop on CI)
 2023-07-22 02:30:28 +03:00
Sema Checherinda
3cc7f137bd add tests with connection reset by peer 2023-07-22 00:45:12 +02:00
robot-ch-test-poll
8175ba8ade
Merge pull request #52408 from ClickHouse/fix-test_keeper_force_recovery 
Fix `test_keeper_force_recovery`
 2023-07-22 00:22:54 +02:00
Alexey Milovidov
de949b6844
Merge pull request #52306 from ClickHouse/backuptestfix 
Add missing replica syncs in test_backup_restore_on_cluster
 2023-07-22 00:57:24 +03:00
kssenii
f82364d2c9 Fix flaky test 2023-07-21 17:03:30 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf 
`reconfig` support for CH Keeper
 2023-07-21 15:59:25 +02:00
robot-clickhouse
2a6b96f9e3 Automatic style fix 2023-07-21 13:51:40 +00:00
Roman Vasin
1daa26c741 Fix black formatting 2023-07-21 13:31:42 +00:00
Yarik Briukhovetskyi
e7b9b42326
Merge branch 'master' into rewrite_uniq_to_count 2023-07-21 15:30:03 +02:00
Roman Vasin
10ec069175 Improve exception message text 2023-07-21 13:29:40 +00:00
Roman Vasin
0aed62ec73 Add codec name into exception message 2023-07-21 13:03:25 +00:00
Alexander Sapin
4695ec6802 Add an ability to specify allocations size for sampling memory profiler 2023-07-21 14:56:29 +02:00
Nikita Mikhaylov
5ea0971921
Merge pull request #52379 from ClickHouse/fix-test-with-encrypted-disks 
Fix `test_replicated_merge_tree_encrypted_disk `
 2023-07-21 14:12:51 +02:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
Azat Khuzhin
0f96992322 Fix possible EADDRINUSE ("Address already in use") in integration tests 
Here is one example [1]:

    minio1_1    | WARNING: Console endpoint is listening on a dynamic port (32911), please use --console-address ":PORT" to choose a static port.
    minio1_1    | ERROR Unable to initialize console server: Specified port is already in use
    minio1_1    |       > Please ensure no other program uses the same address/port

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/52103/7d510eac7c5f0dfb3361e269be30972e6022fada/integration_tests__tsan__[1_6].html

And here is second [2]:

    java.net.BindException: Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/51493/63e88b725d3d255a6534adce4d434ce5f95d2874/integration_tests__asan__[1_6].html

v2: increase the limit from 5K to 10K
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-21 13:47:42 +02:00
Nikolai Kochetov
e02a7c7382
Merge pull request #52375 from ClickHouse/disable-analyzer-bc-tests 
Disable analyzer setting in backward_compatibility integration tests.
 2023-07-21 13:39:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
3815a6aa62 Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
Smita Kulkarni
6cc8a9af5c Fixed named collection tests 2023-07-21 11:19:12 +02:00
Antonio Andelic
234b5047b5
Merge pull request #52373 from ClickHouse/fix-test_keeper_session 
Fix `test_keeper_session`
 2023-07-21 08:33:37 +02:00
Roman Vasin
695a6b7bb3 Add integration test 2023-07-21 06:18:54 +00:00
robot-clickhouse
a8c08b34a6 Automatic style fix 2023-07-21 02:39:21 +00:00
pufit
2a00e2aa6a Implement MOVE query for the access entities. 2023-07-20 22:20:36 -04:00
Yury Bogomolov
c8b128aad4 add predefined macros support in kafka engine settings 2023-07-21 01:06:49 +04:00
Nikita Mikhaylov
920887f315 Done 2023-07-20 16:43:59 +00:00
Michael Kolupaev
97e54d6eba Fix test_backup_restore_on_cluster flakiness caused by missing replica syncs 2023-07-20 15:57:29 +00:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover 
Handle multiple resolved IPs for HTTP/HTTPS session connection
 2023-07-20 18:25:45 +03:00
robot-clickhouse
a26de1b370 Automatic style fix 2023-07-20 15:12:55 +00:00
Nikolai Kochetov
ea252e2f61 Disable analyzer setting in backward_compatibility integration tests. 2023-07-20 15:05:07 +00:00
Roman Vasin
8adf57a698 Fix text in comments and improve exception handling 2023-07-20 14:18:32 +00:00
robot-clickhouse
5decb1f5c5 Automatic style fix 2023-07-20 14:11:11 +00:00
Antonio Andelic
f997adfe27 Retry if sessions not closed because missing leader 2023-07-20 14:02:55 +00:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync 
Fix materialised pg syncTables
 2023-07-20 15:38:18 +02:00
Alexander Tokmakov
96a890b8a2
Merge pull request #52307 from ClickHouse/repdbtestfix 
Fix test_replicated_database 'node doesn't exist' flakiness
 2023-07-20 16:30:42 +03:00
Kseniia Sumarokova
ed38c45729
Merge pull request #52067 from valbok/start-transaction 
MaterializedMySQL: Support CREATE TABLE AS SELECT
 2023-07-20 15:28:11 +02:00
Val Doroshchuk
d16d444943 MaterializedMySQL: Add support of double quoted comments 2023-07-20 13:59:01 +02:00
Kruglov Pavel
b08c72b28d
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-20 12:45:19 +02:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
János Benjamin Antal
16cc007842 Fix table ad variable name 2023-07-20 09:21:18 +00:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry 
Basic auth to fetch Avro schema in Kafka
 2023-07-20 10:58:11 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
Song Liyong
7837559dbf MaterializedMySQL: Support CREATE TABLE AS SELECT 2023-07-19 13:33:02 +02:00
JackyWoo
08409059cc support alias for new analyzer 2023-07-19 18:46:20 +08:00
alesapin
08022f474b
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-19 12:00:07 +02:00
János Benjamin Antal
5ed23fd749
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-19 11:11:36 +02:00
robot-clickhouse
70543e8ef9 Automatic style fix 2023-07-19 08:47:53 +00:00
Ilya Golshtein
c8347bd313 test_for_basic_auth_registry: some comments removed per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
9f6ab5e816 test_for_basic_auth_registry - made black formatter happy 2023-07-19 08:32:45 +00:00
Ilya Golshtein
f1ce1da007 test_for_basic_auth_registry - new test and cleanup per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Michael Kolupaev
a86baab88b Fix test_replicated_database 'node doesn't exist' flakiness 2023-07-19 08:28:04 +00:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290 
Add support for multi-directory globs
 2023-07-19 06:24:38 +02:00
robot-clickhouse
3c8141529f Automatic style fix 2023-07-18 23:25:21 +00:00
Alexey Milovidov
c724816cb8 Fix test 2023-07-19 01:15:16 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
robot-clickhouse
ff6e5ff1c5 Automatic style fix 2023-07-18 20:23:55 +00:00
Alexey Milovidov
b2164ab97e Fix integration tests 2023-07-18 22:13:28 +02:00
Alexey Milovidov
d423add083 Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-18 22:06:49 +02:00
Alexey Milovidov
06914e8196 Merge branch 'master' into sleep-each-row-max-time 2023-07-18 22:06:27 +02:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
János Benjamin Antal
6a104cc3f7 Add checked waits to improve kafka tests 
It might take a few minutes to receive all the messages for the last
materialized view. By waiting to the number of expected results the
happy path of execution takes minimal time while becoming more stable,
while the erroneous path might take a bit longer.
 2023-07-18 16:04:41 +00:00
Roman Vasin
50734017ae Fix test style with black 2023-07-18 15:45:43 +00:00
Roman Vasin
c8c6c31384 Change Method into method in exceptions 2023-07-18 15:33:50 +00:00
kssenii
680903e89b Fix style check 2023-07-18 16:54:33 +02:00
Roman Vasin
ea3d9e92f1 Add support of YAML configs for decryption 2023-07-18 14:44:47 +00:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
alesapin
5fe90208cf
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-18 14:43:18 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Azat Khuzhin
baf6d182d6 Fix reporting some BROKEN tests as ERROR 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:22:38 +02:00
Azat Khuzhin
92ca2b0bdd Make psql tests in test_odbc_interaction more robust to other test failures 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:22:28 +02:00
Azat Khuzhin
e9b7a84aa1 Fix network manager for integration tests 
Sometimes you may get:

    >           raise subprocess.CalledProcessError(exit_code, cmd)
    E           subprocess.CalledProcessError: Command '['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.2.3', '-d', '172.16.2.2', '-j', 'DROP']' returned non-zero exit status 137.

And only sometimes you may get the reason:

    OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown

So this means that container for iptables does not exists anymore, and
the reason is the timeout. And the fact that container_exit_timeout was
equal to container_expire_timeout and was 120.

From the docker logs:

    time="2023-07-16T15:46:52.513673446Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"
    time="2023-07-16T15:48:57.611857183Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"

And then pytest will try to execute the iptables command:

    time="2023-07-16T15:50:57.698705244Z" level=debug msg="starting exec command 860920ab2aa07e8d285050f200ac92423a3cf8ec3fb2f57683541e62cf6bc20e in container 66d6c96671b5e987345290ddd260727d96b99789b512d40f333f6263f42fd2f1"

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:17:26 +02:00
Alexey Milovidov
3dbad00313
Merge branch 'master' into deprecate-metadata-cache 2023-07-18 05:27:15 +03:00
Alexey Milovidov
22c72db848
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-18 02:59:25 +03:00
Alexey Milovidov
806caea282 Update more tests 2023-07-18 01:56:38 +02:00
Alexey Milovidov
a4b92652da Update more tests 2023-07-18 01:50:43 +02:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00