thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
121,906 Commits 9,326 Branches 1,783 Tags 2.1 GiB
a89d711113
Commit Graph

7280 Commits

Author SHA1 Message Date
Sema Checherinda
7d430b8037 retry ConnectionResetException 2023-07-26 17:31:14 +04:00
Robert Schulze
aa25ce9e3d
Follow-up to "Implement support of encrypted elements in configuration file" 
Cf. PR #50986

- rename XML attribute "encryption_codec" to "encrypted_by"
 2023-07-26 13:27:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Kruglov Pavel
a875cf5898
Merge pull request #51286 from Avogar/better-progress-bar-2 
Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions
 2023-07-26 13:16:49 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822 
Implement support of encrypted elements in configuration file
 2023-07-26 12:27:04 +02:00
Roman Vasin
2cf79ac592 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-984 2023-07-26 09:58:26 +00:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Roman Vasin
2b91a9da78 Remove logging from test 2023-07-26 07:51:26 +00:00
robot-clickhouse
48fa1047a9
Merge pull request #52575 from valbok/typos 
MaterializedMySQL: Fix typos in tests
 2023-07-26 06:45:54 +02:00
Alexey Milovidov
7ac5c421ad
Merge pull request #49343 from ClickHouse/sleep-each-row-max-time 
Merging #34909
 2023-07-26 00:03:27 +03:00
Alexander Tokmakov
d85f9ddb35
Update parallel_skip.json 2023-07-26 00:03:08 +03:00
Alexander Tokmakov
20300804b1
Update test.py 2023-07-26 00:01:46 +03:00
Sema Checherinda
c341df1949 draft with retry ConnectionResetException 2023-07-25 19:59:39 +04:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Val Doroshchuk
bd09ad6736 MaterializedMySQL: Fix typos in tests 2023-07-25 16:20:24 +02:00
robot-clickhouse
d7de8bf797 Automatic style fix 2023-07-25 13:03:12 +00:00
Alexander Tokmakov
328d0a5269 fix 2023-07-25 14:50:27 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count 
Rewrite uniq to count
 2023-07-25 11:41:00 +02:00
Roman Vasin
ab55c294bf Add assert for STANDARD storage class 2023-07-25 07:25:27 +00:00
robot-ch-test-poll
bd5d93e439
Merge pull request #52536 from ClickHouse/Fix_disallow_concurrent_backup_restore_test 
Fix disallow_concurrency test for backup and restore
 2023-07-25 09:10:27 +02:00
Alexey Milovidov
fbcc06685b
Merge pull request #51367 from ClickHouse/remove-wrong-code 
Attempt to remove wrong code (catch/throw in Functions)
 2023-07-25 05:44:22 +03:00
Alexey Milovidov
787757fd25
Merge pull request #52497 from ClickHouse/Fix_test_insert_same_partition_and_merge_increase_timeout 
Fix test_insert_same_partition_and_merge by increasing wait time
 2023-07-25 05:39:20 +03:00
Kseniia Sumarokova
e05e0ec557
Merge pull request #52318 from valbok/utf8-names 
MaterializedMySQL: Support unquoted utf-8 strings in DDL
 2023-07-24 21:49:33 +02:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Alexander Tokmakov
c3e2077449
Merge branch 'master' into comment-db 2023-07-24 20:53:46 +03:00
Alexey Milovidov
b9375782bd Merge branch 'master' into remove-wrong-code 2023-07-24 19:34:01 +02:00
Alexander Tokmakov
032956dd1e fix 2023-07-24 18:42:02 +02:00
Alexey Milovidov
0bbf26549f Fix test 2023-07-24 18:13:15 +02:00
Alexey Milovidov
12b5c0dde7 Merge branch 'master' into sleep-each-row-max-time 2023-07-24 18:10:38 +02:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
robot-ch-test-poll3
40f53c4659
Merge pull request #52515 from ClickHouse/fix-test_throttling 
Fix `test_throttling`
 2023-07-24 15:58:28 +02:00
Antonio Andelic
5da6c99f6d
Add comment 2023-07-24 12:02:27 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
Antonio Andelic
3710c7238d Fix test_throttling 2023-07-24 09:19:06 +00:00
Val Doroshchuk
efa638ef3c MaterializedMySQL: Support unquoted utf-8 strings in DDL 
Since ClickHouse does not support unquoted utf-8 strings but MySQL does.

Instead of fixing Lexer to recognize utf-8 chars as TokenType::BareWord,
suggesting to quote all unrecognized tokens before applying any DDL.

Actual parsing and validating the syntax will be done by particular Parser.

If there is any TokenType::Error, the query is unable to be parsed anyway.
Quoting such tokens can provide the support of utf-8 names.

See `tryQuoteUnrecognizedTokens` and `QuoteUnrecognizedTokensTest`.

mysql> CREATE TABLE 道.渠(...

is converted to

CREATE TABLE `道`.`渠`(...

Also fixed the bug with missing * while doing SELECT in full sync because db or table name are back quoted when not needed.
 2023-07-24 11:12:10 +02:00
Azat Khuzhin
0401dc453e Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop 
Since there can be some leftovers:

    2023.07.24 07:08:25.238066 [ 140 ] {} <Error> Application: Code: 219. DB::Exception: Cannot drop: filesystem error: in remove: Directory not empty ["/var/lib/clickhouse/data/system/"]. Probably database contain some detached tables or metadata leftovers from Ordinary engine. If you want to remove all data anyway, try to attach database back and drop it again with enabled force_remove_data_recursively_on_drop setting: Exception while trying to convert database system from Ordinary to Atomic. It may be in some intermediate state. You can finish conversion manually by moving the rest tables from system to .tmp_convert.system.9396432095832455195 (using RENAME TABLE) and executing DROP DATABASE system and RENAME DATABASE .tmp_convert.system.9396432095832455195 TO system. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000e68af57 in /usr/bin/clickhouse
    1. ? @ 0x000000000cab443c in /usr/bin/clickhouse
    2. DB::DatabaseOnDisk::drop(std::shared_ptr<DB::Context const>) @ 0x000000001328d617 in /usr/bin/clickhouse
    3. DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000013524a6c in /usr/bin/clickhouse
    4. DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000013bc05e4 in /usr/bin/clickhouse
    5. DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000013bbc6b8 in /usr/bin/clickhouse
    6. DB::InterpreterDropQuery::execute() @ 0x0000000013bbba22 in /usr/bin/clickhouse
    7. ? @ 0x00000000140b13a5 in /usr/bin/clickhouse
    8. DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x00000000140ad20e in /usr/bin/clickhouse
    9. ? @ 0x00000000140d2ef0 in /usr/bin/clickhouse
    10. DB::maybeConvertSystemDatabase(std::shared_ptr<DB::Context>) @ 0x00000000140d0aaf in /usr/bin/clickhouse
    11. DB::Server::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000e724e55 in /usr/bin/clickhouse
    12. Poco::Util::Application::run() @ 0x0000000017ead086 in /usr/bin/clickhouse
    13. DB::Server::run() @ 0x000000000e714a5d in /usr/bin/clickhouse
    14. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000017ec07b9 in /usr/bin/clickhouse
    15. mainEntryClickHouseServer(int, char**) @ 0x000000000e711a26 in /usr/bin/clickhouse
    16. main @ 0x0000000008cf13cf in /usr/bin/clickhouse
    17. __libc_start_main @ 0x0000000000021b97 in /lib/x86_64-linux-gnu/libc-2.27.so
    18. _start @ 0x00000000080705ae in /usr/bin/clickhouse
     (version 23.7.1.2012)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 10:34:50 +02:00
Smita Kulkarni
0e46cf86b7 Added try-except to check cases when second backup/restore is picked up first 2023-07-24 08:52:19 +02:00
Alexey Milovidov
ac54be9652 Fix a test 2023-07-24 05:56:18 +02:00
Alexey Milovidov
eb5038f3e9
Merge pull request #52295 from ClickHouse/allow_vertical_merges_from_compact_to_wide_parts 
Enable `allow_vertical_merges_from_compact_to_wide_parts` by default
 2023-07-24 06:44:33 +03:00
JackyWoo
ab3376a998
Merge branch 'master' into rewrite_uniq_to_count 2023-07-24 11:04:36 +08:00
Alexey Milovidov
706da4d530
Merge pull request #51973 from ClickHouse/integration-tests-fix-disaster-2 
Fix disaster in integration tests, part 2
 2023-07-24 02:57:39 +03:00
robot-clickhouse
dba7a0dffc Automatic style fix 2023-07-23 23:18:19 +00:00
Alexey Milovidov
40f5649811 Fix test 2023-07-24 01:02:11 +02:00
Sema Checherinda
cfed3589b0 fix style 2023-07-24 01:11:26 +03:00
Alexey Milovidov
7ff3579115
Merge pull request #49631 from ClickHouse/sparse-columns-by-default 
Enable Sparse columns by default
 2023-07-23 21:18:05 +03:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets 
MaterializedMySQL: Introduce charset conversion
 2023-07-23 18:36:30 +02:00
Smita Kulkarni
039cac69cf Fix test_insert_same_partition_and_merge by increasing wait time 2023-07-23 18:35:37 +02:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Alexey Milovidov
0ef6453935
Merge pull request #52148 from azat/tests/EADDRINUSE 
Fix possible EADDRINUSE ("Address already in use") in integration tests
 2023-07-23 01:27:47 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Alexey Milovidov
5a3f872a4b
Merge branch 'master' into integration-tests-fix-disaster-2 2023-07-22 19:37:59 +03:00
Alexey Milovidov
b869466a6a
Merge branch 'master' into sparse-columns-by-default 2023-07-22 19:34:29 +03:00
alesapin
835c36cbf3
Merge pull request #52419 from ClickHouse/implement_borders_for_sampling_memory_profiler 
Add an ability to specify allocations size for sampling memory profiler
 2023-07-22 18:13:26 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
kssenii
4fc3d0b290 Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-22 14:45:38 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
7af9af1a3f
Merge pull request #52103 from azat/tests/test_materialized_mysql_database 
tests: drop existing view in test_materialized_mysql_database
 2023-07-22 03:41:52 +03:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests 
Fix running integration tests with spaces in it's names
 2023-07-22 03:38:51 +03:00
Alexey Milovidov
ae8f511ac5 Fix a test 2023-07-22 02:27:07 +02:00
Alexey Milovidov
860e3975ad Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-22 02:25:23 +02:00
Alexey Milovidov
91fd286165 Merge branch 'master' into sleep-each-row-max-time 2023-07-22 02:25:03 +02:00
Alexey Milovidov
37a7b13ca6
Merge pull request #52095 from azat/tests/fix-docker-network-prune 
Add missing --force for docker network prune (otherwise it is noop on CI)
 2023-07-22 02:30:28 +03:00
Sema Checherinda
3cc7f137bd add tests with connection reset by peer 2023-07-22 00:45:12 +02:00
robot-ch-test-poll
8175ba8ade
Merge pull request #52408 from ClickHouse/fix-test_keeper_force_recovery 
Fix `test_keeper_force_recovery`
 2023-07-22 00:22:54 +02:00
Alexey Milovidov
de949b6844
Merge pull request #52306 from ClickHouse/backuptestfix 
Add missing replica syncs in test_backup_restore_on_cluster
 2023-07-22 00:57:24 +03:00
kssenii
f82364d2c9 Fix flaky test 2023-07-21 17:03:30 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf 
`reconfig` support for CH Keeper
 2023-07-21 15:59:25 +02:00
robot-clickhouse
2a6b96f9e3 Automatic style fix 2023-07-21 13:51:40 +00:00
Roman Vasin
1daa26c741 Fix black formatting 2023-07-21 13:31:42 +00:00
Yarik Briukhovetskyi
e7b9b42326
Merge branch 'master' into rewrite_uniq_to_count 2023-07-21 15:30:03 +02:00
Roman Vasin
10ec069175 Improve exception message text 2023-07-21 13:29:40 +00:00
Roman Vasin
0aed62ec73 Add codec name into exception message 2023-07-21 13:03:25 +00:00
Alexander Sapin
4695ec6802 Add an ability to specify allocations size for sampling memory profiler 2023-07-21 14:56:29 +02:00
Nikita Mikhaylov
5ea0971921
Merge pull request #52379 from ClickHouse/fix-test-with-encrypted-disks 
Fix `test_replicated_merge_tree_encrypted_disk `
 2023-07-21 14:12:51 +02:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
Azat Khuzhin
0f96992322 Fix possible EADDRINUSE ("Address already in use") in integration tests 
Here is one example [1]:

    minio1_1    | WARNING: Console endpoint is listening on a dynamic port (32911), please use --console-address ":PORT" to choose a static port.
    minio1_1    | ERROR Unable to initialize console server: Specified port is already in use
    minio1_1    |       > Please ensure no other program uses the same address/port

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/52103/7d510eac7c5f0dfb3361e269be30972e6022fada/integration_tests__tsan__[1_6].html

And here is second [2]:

    java.net.BindException: Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/51493/63e88b725d3d255a6534adce4d434ce5f95d2874/integration_tests__asan__[1_6].html

v2: increase the limit from 5K to 10K
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-21 13:47:42 +02:00
Nikolai Kochetov
e02a7c7382
Merge pull request #52375 from ClickHouse/disable-analyzer-bc-tests 
Disable analyzer setting in backward_compatibility integration tests.
 2023-07-21 13:39:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
3815a6aa62 Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
Smita Kulkarni
6cc8a9af5c Fixed named collection tests 2023-07-21 11:19:12 +02:00
Antonio Andelic
234b5047b5
Merge pull request #52373 from ClickHouse/fix-test_keeper_session 
Fix `test_keeper_session`
 2023-07-21 08:33:37 +02:00
Roman Vasin
695a6b7bb3 Add integration test 2023-07-21 06:18:54 +00:00
Yury Bogomolov
c8b128aad4 add predefined macros support in kafka engine settings 2023-07-21 01:06:49 +04:00
Nikita Mikhaylov
920887f315 Done 2023-07-20 16:43:59 +00:00
Michael Kolupaev
97e54d6eba Fix test_backup_restore_on_cluster flakiness caused by missing replica syncs 2023-07-20 15:57:29 +00:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover 
Handle multiple resolved IPs for HTTP/HTTPS session connection
 2023-07-20 18:25:45 +03:00
robot-clickhouse
a26de1b370 Automatic style fix 2023-07-20 15:12:55 +00:00
Nikolai Kochetov
ea252e2f61 Disable analyzer setting in backward_compatibility integration tests. 2023-07-20 15:05:07 +00:00
Roman Vasin
8adf57a698 Fix text in comments and improve exception handling 2023-07-20 14:18:32 +00:00
robot-clickhouse
5decb1f5c5 Automatic style fix 2023-07-20 14:11:11 +00:00
Antonio Andelic
f997adfe27 Retry if sessions not closed because missing leader 2023-07-20 14:02:55 +00:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync 
Fix materialised pg syncTables
 2023-07-20 15:38:18 +02:00
Alexander Tokmakov
96a890b8a2
Merge pull request #52307 from ClickHouse/repdbtestfix 
Fix test_replicated_database 'node doesn't exist' flakiness
 2023-07-20 16:30:42 +03:00
Kseniia Sumarokova
ed38c45729
Merge pull request #52067 from valbok/start-transaction 
MaterializedMySQL: Support CREATE TABLE AS SELECT
 2023-07-20 15:28:11 +02:00
Val Doroshchuk
d16d444943 MaterializedMySQL: Add support of double quoted comments 2023-07-20 13:59:01 +02:00
Kruglov Pavel
b08c72b28d
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-20 12:45:19 +02:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
János Benjamin Antal
16cc007842 Fix table ad variable name 2023-07-20 09:21:18 +00:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry 
Basic auth to fetch Avro schema in Kafka
 2023-07-20 10:58:11 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
Song Liyong
7837559dbf MaterializedMySQL: Support CREATE TABLE AS SELECT 2023-07-19 13:33:02 +02:00
JackyWoo
08409059cc support alias for new analyzer 2023-07-19 18:46:20 +08:00
alesapin
08022f474b
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-19 12:00:07 +02:00
János Benjamin Antal
5ed23fd749
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-19 11:11:36 +02:00
robot-clickhouse
70543e8ef9 Automatic style fix 2023-07-19 08:47:53 +00:00
Ilya Golshtein
c8347bd313 test_for_basic_auth_registry: some comments removed per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
9f6ab5e816 test_for_basic_auth_registry - made black formatter happy 2023-07-19 08:32:45 +00:00
Ilya Golshtein
f1ce1da007 test_for_basic_auth_registry - new test and cleanup per code review 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Michael Kolupaev
a86baab88b Fix test_replicated_database 'node doesn't exist' flakiness 2023-07-19 08:28:04 +00:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290 
Add support for multi-directory globs
 2023-07-19 06:24:38 +02:00
robot-clickhouse
3c8141529f Automatic style fix 2023-07-18 23:25:21 +00:00
Alexey Milovidov
c724816cb8 Fix test 2023-07-19 01:15:16 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
robot-clickhouse
ff6e5ff1c5 Automatic style fix 2023-07-18 20:23:55 +00:00
Alexey Milovidov
b2164ab97e Fix integration tests 2023-07-18 22:13:28 +02:00
Alexey Milovidov
d423add083 Merge branch 'sleep-each-row-max-time' of github.com:ClickHouse/ClickHouse into sleep-each-row-max-time 2023-07-18 22:06:49 +02:00
Alexey Milovidov
06914e8196 Merge branch 'master' into sleep-each-row-max-time 2023-07-18 22:06:27 +02:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
János Benjamin Antal
6a104cc3f7 Add checked waits to improve kafka tests 
It might take a few minutes to receive all the messages for the last
materialized view. By waiting to the number of expected results the
happy path of execution takes minimal time while becoming more stable,
while the erroneous path might take a bit longer.
 2023-07-18 16:04:41 +00:00
Roman Vasin
50734017ae Fix test style with black 2023-07-18 15:45:43 +00:00
Roman Vasin
c8c6c31384 Change Method into method in exceptions 2023-07-18 15:33:50 +00:00
kssenii
680903e89b Fix style check 2023-07-18 16:54:33 +02:00
Roman Vasin
ea3d9e92f1 Add support of YAML configs for decryption 2023-07-18 14:44:47 +00:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
alesapin
5fe90208cf
Merge branch 'master' into fix_flaky_test_lost_part 2023-07-18 14:43:18 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Azat Khuzhin
baf6d182d6 Fix reporting some BROKEN tests as ERROR 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:22:38 +02:00
Azat Khuzhin
92ca2b0bdd Make psql tests in test_odbc_interaction more robust to other test failures 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:22:28 +02:00
Azat Khuzhin
e9b7a84aa1 Fix network manager for integration tests 
Sometimes you may get:

    >           raise subprocess.CalledProcessError(exit_code, cmd)
    E           subprocess.CalledProcessError: Command '['iptables', '--wait', '-D', 'DOCKER-USER', '-p', 'tcp', '-s', '172.16.2.3', '-d', '172.16.2.2', '-j', 'DROP']' returned non-zero exit status 137.

And only sometimes you may get the reason:

    OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown

So this means that container for iptables does not exists anymore, and
the reason is the timeout. And the fact that container_exit_timeout was
equal to container_expire_timeout and was 120.

From the docker logs:

    time="2023-07-16T15:46:52.513673446Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"
    time="2023-07-16T15:48:57.611857183Z" level=debug msg="form data: {\"AttachStderr\":false,\"AttachStdin\":false,\"AttachStdout\":false,\"Cmd\":[\"sleep\",\"120\"],\"HostConfig\":{\"AutoRemove\":true,\"NetworkMode\":\"host\"},\"Image\":\"clickhouse/integration-helper:latest\",\"NetworkDisabled\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Tty\":false}"

And then pytest will try to execute the iptables command:

    time="2023-07-16T15:50:57.698705244Z" level=debug msg="starting exec command 860920ab2aa07e8d285050f200ac92423a3cf8ec3fb2f57683541e62cf6bc20e in container 66d6c96671b5e987345290ddd260727d96b99789b512d40f333f6263f42fd2f1"

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-18 12:17:26 +02:00
Alexey Milovidov
3dbad00313
Merge branch 'master' into deprecate-metadata-cache 2023-07-18 05:27:15 +03:00
Alexey Milovidov
22c72db848
Merge branch 'master' into vdimir/test_alter_moving_garbage_retry 2023-07-18 02:59:25 +03:00
Alexey Milovidov
806caea282 Update more tests 2023-07-18 01:56:38 +02:00
Alexey Milovidov
a4b92652da Update more tests 2023-07-18 01:50:43 +02:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Alexey Milovidov
4884022fda
Merge branch 'master' into zvonand-issue-49290 2023-07-17 23:03:50 +03:00
Kruglov Pavel
4ed8dcd436
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-17 21:02:33 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
robot-clickhouse
32311bf28f Automatic style fix 2023-07-17 15:30:31 +00:00
Azat Khuzhin
6c986c1fb2 Allow test names with spaces in it 
It had been fixed and now it is allowed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 17:29:44 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
SmitaRKulkarni
3bb7db45c4
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-17 17:23:29 +02:00
Smita Kulkarni
671f8b34d0 Added test with all signatures and fixed style check 2023-07-17 17:18:14 +02:00
Azat Khuzhin
acbdbf6ab7 tests: do not use --format if --quiet is set in integration runner 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 17:17:21 +02:00
Azat Khuzhin
e532d5b376 tests: use -- over quotes on and on in ci-runner.py 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 17:17:21 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names 
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 17:17:21 +02:00
Antonio Andelic
51f0089457
Merge branch 'master' into fix-test_multiple_disks 2023-07-17 16:25:06 +02:00
Andrey Zvonov
d339c22a2f
Merge branch 'master' into zvonand-issue-49290 2023-07-17 16:43:15 +03:00
kssenii
7a224c252e One more fix 2023-07-17 15:04:39 +02:00
kssenii
9c66655288 Fix tests 2023-07-17 15:01:58 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
robot-clickhouse
71e8465663 Automatic style fix 2023-07-17 12:09:36 +00:00
Alexander Sapin
2993cf3cba Fix flaky test test_lost_part 2023-07-17 14:01:31 +02:00
Antonio Andelic
152f5527a9 Remove wrong assert 2023-07-17 11:58:22 +00:00
Kruglov Pavel
9ac1a9c556
Merge branch 'master' into async-connect-to-multiple-ips 2023-07-17 13:40:36 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
vdimir
37f8bd070f
Retry blob listing in test_alter_moving_garbage 2023-07-17 09:55:12 +00:00
Kseniia Sumarokova
200dfc24b6
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-17 11:53:42 +02:00
Antonio Andelic
dfc1cc13c8 Better oldest part selection 2023-07-17 08:57:22 +00:00
robot-ch-test-poll
3b0a4040cd
Merge pull request #51876 from evillique/fix-mongodb-inserts 
Fix inserts into MongoDB tables
 2023-07-16 05:28:43 +02:00
Alexey Milovidov
d900aa467f
Merge pull request #51992 from ClickHouse/fix-test_extreme_deduplication 
Fix test_extreme_deduplication
 2023-07-16 05:54:44 +03:00
Alexey Milovidov
2be26de2db
Merge pull request #52142 from ClickHouse/remove-detection-of-flaky-test 
There is no point in detecting flaky tests
 2023-07-16 05:52:04 +03:00
robot-ch-test-poll
67492bc2ed
Merge pull request #52122 from azat/keeper-stat-zxid 
Print Zxid in keeper stat command in hex (so as ZooKeeper)
 2023-07-16 03:28:53 +02:00
Alexey Milovidov
7e6551dbd0
Merge branch 'master' into fix-mongodb-inserts 2023-07-16 01:47:52 +03:00
robot-clickhouse
44fc93ba63 Automatic style fix 2023-07-15 21:10:21 +00:00
Alexey Milovidov
90f9d156d2
Merge branch 'master' into fix-test_extreme_deduplication 2023-07-16 00:05:40 +03:00
Alexey Milovidov
2ad7d121ae
Merge pull request #52085 from azat/tests/test_extreme_deduplication 
Fix test_extreme_deduplication flakiness
 2023-07-16 00:02:18 +03:00
Alexey Milovidov
20b77e946a There is no point in detecting flaky tests 2023-07-15 23:00:23 +02:00
Alexey Milovidov
7d510eac7c
Merge branch 'master' into tests/test_materialized_mysql_database 2023-07-15 20:36:32 +03:00
Alexey Milovidov
0d48dca171
Update materialized_with_ddl.py 2023-07-15 20:36:16 +03:00
Alexey Milovidov
47a33efc73
Merge branch 'master' into tests/test_keeper_s3_snapshot 2023-07-15 19:27:06 +03:00
Alexey Milovidov
ba60db1558
Merge branch 'master' into tests/fix-docker-network-prune 2023-07-15 19:24:59 +03:00
Alexey Milovidov
edbd05f332
Merge branch 'master' into tests/test_extreme_deduplication 2023-07-15 19:20:32 +03:00
Alexey Milovidov
0eab3276f5
Merge branch 'master' into keeper-stat-zxid 2023-07-15 19:07:48 +03:00
Vitaly Baranov
2f23b6a593
Merge branch 'master' into backups-native-copy 2023-07-15 08:40:17 +02:00
Aleksei Filatov
801d0955ec Add tests 2023-07-15 08:18:35 +03:00
Andrey Zvonov
dbdd15686a
Merge branch 'master' into zvonand-issue-49290 2023-07-15 00:53:29 +02:00
Azat Khuzhin
6abdde12ca Print Zxid in keeper stat command in hex (so as ZooKeeper) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-14 21:17:09 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B 
Implement support of date/time format specifiers in log and error log file names
 2023-07-14 18:54:27 +02:00
Azat Khuzhin
4f6d59ce7f tests: drop existing view in test_materialized_mysql_database 
This should avoid failures of other tests in case of some previous test
failed

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-14 16:50:41 +02:00
Azat Khuzhin
2f17208792 Add missing --force for docker network prune (otherwise it is noop on CI) 
On CI there is no stdin attached, so this command simply do nothing, fix
this.

Fixes: https://github.com/ClickHouse/ClickHouse/pull/51969
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-13 20:38:17 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot 
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-13 14:25:24 +02:00
Azat Khuzhin
3a54182f77 Fix test_extreme_deduplication flakiness 
This is part of **"Why my PR is not merged?"** patch set series.

Since #50107 there one more tunable that can increase the cleanup period
- max_cleanup_delay_period.

Plus, increase the delay for the cleanup thread, otherwise it is too
fragile.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-13 13:58:19 +02:00