thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-11 17:02:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
115,359 Commits 9,299 Branches 1,782 Tags 2.1 GiB
4d06246cd4
Commit Graph

6456 Commits

Author SHA1 Message Date
Alexey Milovidov
4a44dafdee Merge branch 'master' into decimal256-various 2023-03-20 03:30:14 +01:00
kssenii
ea375ef989 Fix memory leak 2023-03-20 00:40:06 +01:00
Alexander Tokmakov
f1df91cd09
Merge pull request #47659 from ClickHouse/fix_993 
Fixes for 993 and friends
 2023-03-18 14:46:43 +03:00
Antonio Andelic
593ac89cb9
Merge pull request #47687 from ClickHouse/fix-mntr-data-size-test 
Try making `test_keeper_mntr_data_size` less flaky
 2023-03-18 10:09:25 +01:00
Alexey Milovidov
26d17fe560 Merge branch 'master' of github.com:ClickHouse/ClickHouse into decimal256-various 2023-03-17 22:15:16 +01:00
Nikolay Degterinsky
7fb171f84d
Merge pull request #47596 from evillique/native-client-ssl 
Add SSL User Certificate authentication to the native protocol
 2023-03-17 21:27:58 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
kssenii
e48d8d12e7 Fixes for hudi 2023-03-17 19:44:30 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Antonio Andelic
86a409e7a9 Assert znode count 2023-03-17 16:07:12 +00:00
Alexander Tokmakov
dfd8b2670a fix tests, update docs 2023-03-17 14:15:03 +01:00
robot-clickhouse
2198ea2d89 Automatic style fix 2023-03-17 12:19:16 +00:00
kssenii
bb0beb7449 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-17 13:02:36 +01:00
alesapin
e44fca8bb9 Add test 2023-03-17 12:56:31 +01:00
Aleksei Filatov
886b530963 [rev: 1] Fix review remarks 2023-03-17 13:56:05 +03:00
Aleksei Filatov
cf6ca10c83 Tests for replicated system.functions 2023-03-17 13:56:05 +03:00
Aleksei Filatov
1321f87eee Tests for replication UDF to ZooKeeper 2023-03-17 13:56:04 +03:00
alesapin
efa0622a84
Merge pull request #47631 from ClickHouse/fix_wait_for_zero_copy_lock 
Fix wait for zero copy lock during move
 2023-03-17 11:15:55 +01:00
Alexander Tokmakov
8b8215f91a fix some other tests, add logs for further debugging 2023-03-16 16:40:08 +01:00
pufit
f4d9b4a888
Merge pull request #47086 from pkit/pkit/insert_http_body 
use http request body in predefined http handlers
 2023-03-15 17:41:05 -04:00
alesapin
586b8a4733 Add test 2023-03-15 22:38:42 +01:00
Dmitry Novik
be40218a9a
Revert "Revert #46622 (test_async_insert_memory)" 2023-03-15 22:14:54 +01:00
Alexander Tokmakov
6a653060ff
Merge pull request #47213 from azat/interserver-mode-v2 
Reimplement interserver mode to avoid replay attacks
 2023-03-15 16:26:50 +03:00
avogar
b603ce63f1 Fix more tests 2023-03-15 12:18:33 +00:00
Vitaly Baranov
00c05f7f8b
Merge pull request #47546 from vitlibar/use-server-side-copy-for-restore 
Use server-side copy for restore from S3 to S3.
 2023-03-15 11:28:29 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix 
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
 2023-03-15 11:00:06 +01:00
Azat Khuzhin
bcf381c5ae Reimplement interserver mode to avoid replay attacks 
Prevous implementation (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET)
accepts the salt from the client, which make it useless.

Reimplement the protocol to send the salt by the server and use it in
the client instead.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-15 08:28:43 +01:00
Alexey Milovidov
f859b3258a Add support for Decimal256 in MySQL tables 2023-03-15 04:45:26 +01:00
Vitaly Baranov
25356786ea Simplify the implementation, create new utility function copyS3FileToDisk(). 2023-03-14 23:34:44 +01:00
Nikolay Degterinsky
eddda2eb73 Add SSL authentication to the native protocol 2023-03-14 22:10:08 +00:00
Smita Kulkarni
8cd36d2a36 Removed generated file cluster_for_concurrency_test.xml 2023-03-14 20:30:44 +01:00
Smita Kulkarni
e863e49a49 Renamed cluster configuration xml to cluster_for_disallow_concurrency_test.xml for disallow_concurreny of backup and restore test 2023-03-14 20:26:19 +01:00
SmitaRKulkarni
8db4964ebc
Revert "Revert "Backup_Restore_concurrency_check_node"" 2023-03-14 20:23:43 +01:00
Yatsishin Ilya
45c5275bfb Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-14 17:27:25 +00:00
Alexander Tokmakov
773cd5a686
Revert "Backup_Restore_concurrency_check_node" 2023-03-14 18:55:08 +03:00
Vitaly Baranov
859082c4b7
Merge pull request #47216 from ClickHouse/Backup_Restore_concurrency_check_node 
Backup_Restore_concurrency_check_node
 2023-03-14 13:36:43 +01:00
Alexander Tokmakov
5a1ee881f8
Merge pull request #47547 from ClickHouse/filter_too_frequent_logs 
Hide too noisy log messages, fix some tests
 2023-03-14 13:53:21 +03:00
Alexander Tokmakov
ba6c6255a3 hide too noisy log messages, fix some tests 2023-03-14 00:23:36 +01:00
Vitaly Baranov
1cf1ce07fe Use server-side copy during restore from S3 to S3. 2023-03-13 23:50:13 +01:00
Alexey Milovidov
a411ae10b5
Merge pull request #47486 from ClickHouse/revert_25674 
Remove "asynchronous connection drain"
 2023-03-13 21:40:39 +03:00
Alexander Tokmakov
ee6c18cbc6
Better error after failed Ordinary-to-Atomic conversion (#47487) 
* better error on failed Ordinary-to-Atomic conversion

* fix test

* Update loadMetadata.cpp
 2023-03-13 19:13:49 +03:00
MeenaRenganathan22
dc1e125b31 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-13 06:54:47 -07:00
alesapin
8db0d26519
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-13 14:48:20 +01:00
Smita Kulkarni
f76b97cb51 Set num of nodes to 4 for backup restore disallow concurrency test 2023-03-13 10:42:43 +01:00
SmitaRKulkarni
9a35a434f8
Merge branch 'master' into Backup_Restore_concurrency_check_node 2023-03-13 10:04:32 +01:00
Alexander Tokmakov
7b1b238d0b Revert "Merge pull request #25674 from amosbird/distributedreturnconnection" 
This reverts commit 5ffd99dfd4, reversing
changes made to 2796aa333f.
 2023-03-11 19:09:47 +01:00
Alexander Tokmakov
0359b3e336 Revert "Merge pull request #46622 from ClickHouse/async-insert-memory-fix" 
This reverts commit 67469ad46b, reversing
changes made to 678e4250cd.
 2023-03-11 17:01:10 +01:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
alesapin
588cc0f159
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-09 14:54:10 +01:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
MeenaRenganathan22
ed5b19f5f8 Fixed the integration test failures related with HDFS and KAFKA 2023-03-08 06:11:17 -08:00
Yatsishin Ilya
6cde37093a Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-08 13:34:18 +00:00
alesapin
4423be8332
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-08 12:59:07 +01:00
Antonio Andelic
816a9c1099
Merge branch 'master' into custom-key-parallel-replicas 2023-03-08 11:06:30 +01:00
Igor Nikonov
cc5b97b624
Merge pull request #46997 from AndyBys/log-level-change 
Change level log in executeQuery
 2023-03-08 10:36:21 +01:00
Alexey Milovidov
e2aff59a2d
Merge pull request #47106 from kssenii/allow-nested-disks-in-custom-disks 
Allow nested custom disks
 2023-03-08 03:00:55 +03:00
Alexander Tokmakov
ffd55d951d
Merge branch 'master' into followup_46681 2023-03-07 23:38:06 +03:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine 
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
 2023-03-07 20:36:46 +01:00
Alexander Tokmakov
7ce20f5cd2 fix tests 2023-03-07 14:25:28 +01:00
Antonio Andelic
35c15e6ef8 Merge branch 'master' into custom-key-parallel-replicas 2023-03-07 09:37:38 +00:00
Alexey Milovidov
7d48eae0f6
Merge pull request #47256 from ClickHouse/keeper-4lw-clean-resources 
Add Keeper 4LW for cleaning resources
 2023-03-07 04:23:15 +03:00
Igor Nikonov
838ff88abe
Merge branch 'master' into log-level-change 2023-03-06 18:00:49 +01:00
Antonio Andelic
9e3794f7d7 Skip for sanitizer builds 2023-03-06 14:36:53 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
kssenii
cb3dd3c200 Fix flaky test 2023-03-06 13:06:31 +01:00
Han Fei
b7eef62458
Merge pull request #45491 from azat/dist/async-send-refactoring 
[RFC] Rewrite distributed sends to avoid using filesystem as a queue, use in-memory queue instead
 2023-03-06 12:32:33 +01:00
Antonio Andelic
3a184880c6 Add test for clrs 2023-03-05 17:18:53 +00:00
kssenii
b8d33f4d38 Fix test 2023-03-05 13:46:23 +01:00
kssenii
d9e75e5c0a Fix test 2023-03-05 13:13:32 +01:00
kssenii
8f2d75cef8 Fix tests 2023-03-05 12:56:00 +01:00
Alexey Milovidov
41c79b0c42
Merge pull request #46086 from ClickHouse/fix-data-size 
Fix data size calculation in Keeper
 2023-03-05 14:11:36 +03:00
Sema Checherinda
85178c9609
Merge pull request #47102 from CheSema/merge-mutate-do-thread-group 
do flushUntrackedMemory when context switches
 2023-03-03 20:23:25 +01:00
robot-clickhouse
cebe323bef Automatic style fix 2023-03-03 15:56:11 +00:00
Smita Kulkarni
d2dbd5f293 Updated to use tryGet instead of get for checking stage of backups/restores in concurrency check and updated tests by increasing data size to have a longer backup/restore to ensure the overlap and increased timeout correspondingly. 2023-03-03 16:48:14 +01:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
robot-clickhouse
46667d43d8 Automatic style fix 2023-03-03 15:25:25 +00:00
Antonio Andelic
737cf8e149 Better 2023-03-03 15:14:49 +00:00
Antonio Andelic
cd4100cb19
Merge branch 'master' into fix-data-size 2023-03-03 15:33:43 +01:00
Alexander Tokmakov
5be681c5f6
Merge pull request #47152 from ClickHouse/fix_flaky_test_replicated_database 
Use unique names and paths in `test_replicated_database`
 2023-03-03 17:15:27 +03:00
Alexander Tokmakov
cadaf06829
Merge pull request #46681 from ClickHouse/fix_insert_cancellation_in_native_protocol 
Fix queries cancellation when a client dies
 2023-03-03 16:27:20 +03:00
kssenii
0fa3fb3592 Fix show grants for user which has all grants 2023-03-03 14:04:32 +01:00
Konstantin Bogdanov
1bbf5acd47
Pass headers from StorageURL to WriteBufferFromHTTP (#46996) 
* Pass headers from StorageURL to WriteBufferFromHTTP

* Add a test

* Lint

* `time.sleep(1)`

* Start echo server earlier

* Add proper handling for mock server start

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-03-03 13:55:52 +01:00
Sema Checherinda
bc8b34f74b adjust test test_seekable_formats 2023-03-03 13:16:46 +01:00
Kseniia Sumarokova
386663953c
Merge branch 'master' into named-collections-finish 2023-03-03 12:23:38 +01:00
Antonio Andelic
a6da64aac0
Merge pull request #46824 from ClickHouse/fix-single-thread-parquet 
Use initial range for fetching file size in HTTP read buffer
 2023-03-03 09:23:22 +01:00
kssenii
cd7cd0526b Fix tests 2023-03-02 21:21:04 +01:00
kssenii
0c4bb3c80f Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-03-02 19:08:29 +01:00
robot-clickhouse
fdcbec4fee Automatic style fix 2023-03-02 17:35:56 +00:00
Alexander Tokmakov
c518f3690e Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-02 18:24:08 +01:00
Alexander Tokmakov
fc8ea01c2b use unique names and paths in test_replicated_database 2023-03-02 18:23:31 +01:00
Yatsishin Ilya
d4304d2028 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-02 16:16:18 +00:00
AndyB
cf245538b9 checker fix 2023-03-02 14:31:38 +00:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
Antonio Andelic
5328a0777b Merge branch 'master' into fix-single-thread-parquet 2023-03-02 13:45:27 +00:00
kssenii
2883861795 Merge remote-tracking branch 'upstream/master' into allow-nested-disks-in-custom-disks 2023-03-02 14:30:58 +01:00
alesapin
915b4ea56a
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 14:29:21 +01:00
Constantine Peresypkin
c4ae17e495
fix black 2023-03-02 14:23:22 +01:00
Kseniia Sumarokova
e95c4b6379
Merge pull request #47011 from kssenii/fix-azure-test 
Fix flaky azure test
 2023-03-02 13:59:43 +01:00
Constantine Peresypkin
fdc6de2a27 use http request body in predefined http handlers 
adds a new "virtual" parameter `__request_body`
which can be used in http rules, see below

tremendously helps in producing arbitrary REST interfaces

for example:

```xml
<http_handlers>
  <rule>
    <methods>POST</methods>
    <url>/ingest</url>
    <handler>
      <type>predefined_query_handler</type>
      <query>INSERT INTO events(id, data) SELECT {id:UInt32}, {__request_body:String}</query>
    </handler>
  </rule>
</http_handlers>
```
 2023-03-02 12:51:48 +01:00
alesapin
189836307c Merge branch 'revert-46909-revert-45911-mutations_rename_hang' of github.com:ClickHouse/ClickHouse into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 12:49:06 +01:00
Kruglov Pavel
ce8e49a9a0
Merge pull request #45693 from Avogar/fix-kafka-protobuf 
Fix formats parser resetting, test processing bad messages in kafka
 2023-03-02 11:50:45 +01:00
AndyB
657afa849e logger level in test 2023-03-01 23:35:09 +00:00
robot-clickhouse
54336f7c98 Automatic style fix 2023-03-01 20:12:00 +00:00
alesapin
46f25d53b3 Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-01 20:09:12 +01:00
kssenii
f3e3b916c9 Allow nested custom disks 2023-03-01 19:55:59 +01:00
Alexander Gololobov
f64d08bd5c Enable lightweight delete support by default 2023-03-01 19:35:55 +01:00
alesapin
ebba37b18f
Merge pull request #47010 from ClickHouse/zero_copy_fetch 
Fix bug in zero-copy replication disk choice during fetch
 2023-03-01 15:55:00 +01:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
Kseniia Sumarokova
b9bb7bcce3
Update test.py 2023-03-01 13:14:53 +01:00
Kseniia Sumarokova
adf2d56a2d
Update test.py 2023-03-01 12:35:01 +01:00
AVMusorin
99329d8682 Improve tests for Distributed INSERT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-28 23:17:37 +01:00
Antonio Andelic
6e28406751 Merge branch 'master' into fix-data-size 2023-02-28 20:09:29 +00:00
pufit
29296cb004
Merge pull request #46550 from ClickHouse/46231-systerm-server-settings 
Implement `system.server_settings`
 2023-02-28 11:23:15 -05:00
robot-clickhouse
38d026ca6e Automatic style fix 2023-02-28 14:29:24 +00:00
Antonio Andelic
919122948f More fixes and add tests 2023-02-28 14:22:44 +00:00
robot-clickhouse
82be8eb468 Automatic style fix 2023-02-28 13:56:14 +00:00
kssenii
ef58249115 Fix 2023-02-28 14:52:11 +01:00
alesapin
bb7571427b Fix bug in zero-copy replica disk choice during fetch 2023-02-28 14:48:46 +01:00
kssenii
de81a5f92d Fix integration tests 2023-02-28 13:36:52 +01:00
robot-clickhouse
979c62af4f Automatic style fix 2023-02-28 11:24:39 +00:00
alesapin
967a47d870 Fix bug with readonly storages 2023-02-28 12:17:43 +01:00
kssenii
f43e00c3ca Add order by to test to fix flakyness 2023-02-28 11:32:33 +01:00
kssenii
69cdf401a4 Add test for materialized view with materialized postgresql 2023-02-27 22:29:16 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
kssenii
03c9eeb106 Fix tests 2023-02-27 14:29:20 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
avogar
0ef83b10ce Fix style 2023-02-27 13:01:07 +00:00
alesapin
e3961c118a
Revert "Revert "Fix several RENAME COLUMN bugs."" 2023-02-27 12:27:57 +01:00
zk_kiger
4f05eeeff9
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-02-27 17:15:02 +08:00
robot-clickhouse
5f7220e498 Automatic style fix 2023-02-26 18:15:55 +00:00
Smita Kulkarni
4c5d39725c Updated node to check BACKUP_CREATED to node1 in test_concurrent_backups_on_different_nodes 2023-02-26 19:08:26 +01:00
Smita Kulkarni
10c92b6cb0 Increased ddl timeout during DROP of table and updated node for concurrent backups on different node 2023-02-26 19:06:31 +01:00
Alexey Milovidov
9ac48dddb8
Merge pull request #46888 from vitlibar/fix-test_async_backups_to_same_destination 
Fix test test_async_backups_to_same_destination.
 2023-02-26 11:36:18 +03:00
Robert Schulze
5e68d50b39
Merge pull request #46752 from ClickHouse/rs/periods-in-kafka-topics 
Allow configuration of Kafka topics with periods
 2023-02-26 07:49:28 +01:00
Alexey Milovidov
8f40bbd5b4
Revert "Fix several RENAME COLUMN bugs." 2023-02-26 05:47:05 +03:00
Alexey Milovidov
936f57e7b2
Merge pull request #46887 from ClickHouse/fix-flaky-test-12 
Fix flaky `test_concurrent_queries_restriction_by_query_kind`
 2023-02-26 04:30:51 +03:00
Alexey Milovidov
eb89ab471f
Merge pull request #45911 from ClickHouse/mutations_rename_hang 
Fix several `RENAME COLUMN` bugs.
 2023-02-26 01:56:40 +03:00
Alexey Milovidov
656af55831
Merge pull request #46384 from ClickHouse/fixes_for_993 
Fixes for 993
 2023-02-26 01:55:20 +03:00
Vitaly Baranov
2d38c89e2a Fix test test_async_backups_to_same_destination. 2023-02-25 23:38:40 +01:00
Alexey Milovidov
88704c4d9f Fix flaky test_concurrent_queries_restriction_by_query_kind 2023-02-25 22:23:29 +01:00
Robert Schulze
fbba9e319d
Merge branch 'master' into rs/periods-in-kafka-topics 2023-02-25 21:45:20 +01:00
SmitaRKulkarni
4109fbd7cf
Merge pull request #46517 from azat/tests/fix-backup-restore-flakiness 
Fix flakiness of test_backup_restore_on_cluster/test_disallow_concurrency
 2023-02-25 19:54:21 +01:00
Alexander Tokmakov
cad1e0b768 fix 2023-02-25 01:18:34 +01:00
kssenii
6224ca9cd6 Fix 2023-02-24 17:08:05 +01:00
kssenii
357ffcb61f More review fixes 2023-02-24 16:53:16 +01:00
kssenii
8b40723fed Better fix 2023-02-24 16:19:36 +01:00
kssenii
f2a9109fe1 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-24 15:20:46 +01:00
kssenii
0555ca2724 Review fixes 2023-02-24 14:44:47 +01:00
Yatsishin Ilya
76e7e15f67 black and tty 2023-02-24 13:36:43 +00:00
avogar
c6a30d23aa Add separate test 2023-02-24 12:31:09 +00:00
Kruglov Pavel
2150b836b1
Merge branch 'master' into fix-kafka-protobuf 2023-02-24 12:48:07 +01:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Alexander Tokmakov
f76c42348b
Merge pull request #46402 from lzydmxy/apply_move_partition_to_all_replicas 
Apply `ALTER TABLE ON CLUSTER MOVE PARTITION TO DISK|VOLUME` to all replicas.
 2023-02-23 19:42:54 +03:00
Kruglov Pavel
bda1ce7367
Update test.py 2023-02-23 14:47:29 +01:00
Kseniia Sumarokova
7e064ccbd4
Merge pull request #46667 from kssenii/hide-named-collections-under-setting 
Allow to hide only values from system.named_collections while making collection visible
 2023-02-23 11:44:50 +01:00
Kseniia Sumarokova
30a8eb0c2f
Merge pull request #46670 from kssenii/hide-disk-setting 
Hide arguments of custom disk merge tree setting
 2023-02-23 11:42:53 +01:00
kigerzhang
af5a8ce74c style check 2023-02-23 17:18:56 +08:00
kigerzhang
f74f3718a0 add skip_unavailable_shards setting for table function cluste 2023-02-23 17:05:51 +08:00
Alexey Milovidov
0db943e596
Merge pull request #46687 from ClickHouse/tavplubix-patch-5 
Disable flaky test_ttl_move_memory_usage.py
 2023-02-23 10:27:25 +03:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods 
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
 2023-02-22 20:35:09 +00:00
Alexander Gololobov
b0427c2e3c
Merge pull request #46660 from ClickHouse/fix_backup_test 
Fix integration test: terminate old version without wait
 2023-02-22 15:20:26 +01:00
Antonio Andelic
7f5fb77ed5
Increase table retries in cluster copier tests (#46590) 2023-02-22 15:09:48 +01:00
Yatsishin Ilya
80857638c1 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-22 13:58:17 +00:00
kssenii
c4761d6cc6 Fix checks 2023-02-22 14:27:43 +01:00
kssenii
f0ca3ef207 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-22 14:02:29 +01:00
Alexander Tokmakov
fba2ec30a2 fix style check 2023-02-22 13:53:43 +01:00
lzydmxy
ec8b6c5590 add __init__.py for integration test test_move_partition_to_disk_on_cluster 2023-02-22 19:57:56 +08:00
kssenii
ceff5f41d1 Fix tests 2023-02-22 12:27:07 +01:00
Dmitry Novik
67469ad46b
Merge pull request #46622 from ClickHouse/async-insert-memory-fix 
Fix MemoryTracker counters for async inserts
 2023-02-22 12:27:05 +01:00
Kseniia Sumarokova
3f0d93d6e6
Merge pull request #46656 from ClickHouse/kssenii-patch-6 
Update postgres_utility.py
 2023-02-22 11:35:03 +01:00
Alexander Tokmakov
c009c2f4cb
Update test_ttl_move_memory_usage.py 2023-02-22 00:50:21 +03:00
kssenii
08b0e3c630 Fix style check 2023-02-21 18:27:37 +01:00
kssenii
9a7c71b78e Allow to hide only values from system.named_collections 2023-02-21 18:07:57 +01:00
Igor Nikonov
bf05082984
Merge branch 'master' into keeper-retries-by-default 2023-02-21 17:59:55 +01:00
robot-clickhouse
af677c7dcd Automatic style fix 2023-02-21 16:08:13 +00:00
alesapin
1d4352d82a Fix integration test: terminate old version without wait 2023-02-21 17:01:19 +01:00
Kruglov Pavel
341a776617
Disable test 2023-02-21 16:41:05 +01:00
Kseniia Sumarokova
3df7a10ac7
Update postgres_utility.py 2023-02-21 16:25:11 +01:00
Kseniia Sumarokova
655e7f29f7
Merge pull request #46595 from kssenii/update-rabbit-producer 
Fix rabbitmq test
 2023-02-21 16:18:55 +01:00
Kseniia Sumarokova
a45480c11e
Merge pull request #46596 from ClickHouse/kssenii-patch-7 
Fix meilisearch test flakyness
 2023-02-21 14:23:07 +01:00
Kseniia Sumarokova
09a979f106
Merge branch 'master' into update-rabbit-producer 2023-02-21 11:50:30 +01:00
robot-clickhouse
93aabf8c66 Automatic style fix 2023-02-21 02:06:16 +00:00
Dmitry Novik
573ce50403 Fix test 2023-02-21 01:44:10 +00:00
Dmitry Novik
16a9ac9118 Try to add test 2023-02-21 00:52:54 +00:00
robot-clickhouse
abeb1c5ba8 Automatic style fix 2023-02-20 23:49:25 +00:00
Alexey Milovidov
4a2bd6e0aa Adapt a test 2023-02-21 00:43:10 +01:00
Alexey Milovidov
dc4b52e54e Adapt a test 2023-02-21 00:41:40 +01:00
Alexey Milovidov
40d11ce422 Adapt a test 2023-02-21 00:39:32 +01:00
Kruglov Pavel
828a06b511
Merge branch 'master' into fix-kafka-protobuf 2023-02-20 21:45:43 +01:00
Kseniia Sumarokova
47604ad77e
Merge pull request #46106 from kssenii/return-materialized-postrgesql-tests-back 
Enable disabled MaterializedPostgreSQL tests back in CI
 2023-02-20 19:04:58 +01:00
kssenii
0a36398847 Update test 2023-02-20 16:53:06 +01:00
Kseniia Sumarokova
0d9a541441
Update test.py 2023-02-20 16:43:10 +01:00
kssenii
80a0aa1327 Merge remote-tracking branch 'upstream/master' into return-materialized-postrgesql-tests-back 2023-02-20 14:37:39 +01:00
kssenii
591510c20e Uodate test 2023-02-20 14:36:53 +01:00
Kseniia Sumarokova
514e3cbf90
Update test.py 2023-02-20 14:29:04 +01:00
kssenii
361678ad73 rabbitmq-test-fix 2023-02-20 14:16:40 +01:00
lzydmxy
ccf87a6afd add integration test for move partition to disk on cluster 2023-02-20 16:52:55 +08:00
Azat Khuzhin
0859bbb08b Compress tar archives with zstd in intergration tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 21:54:38 +01:00
pufit
5b10fafbb0 Additional tests 2023-02-18 13:45:33 -05:00
Alexey Milovidov
f073cd470f
Merge pull request #46478 from ClickHouse/fix_test_store_cleanup 
Fix some flaky integration tests
 2023-02-18 17:33:02 +03:00
Kseniia Sumarokova
b0ea047e76
Merge pull request #46533 from kssenii/fix-disk-setting 
Allow `disk` merge tree setting in query to override config merge tree setting `storage_policy`
 2023-02-18 12:36:54 +01:00
kssenii
ee7eb8a7dc Fix test 2023-02-18 12:28:55 +01:00
Azat Khuzhin
fb35a6852e More flakiness fiexes for test_backup_restore_on_cluster/test_disallow_concurrency 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 11:13:32 +01:00
kssenii
30748eace8 Fix black check 2023-02-17 21:02:16 +01:00
kssenii
afb36dd120 Allow disk setting to override storage_policy from config merge tree settings insteaf of exception 2023-02-17 17:11:29 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
flynn
ebd88aab41
Merge branch 'master' into iceberg 2023-02-17 21:53:29 +08:00
Alexander Tokmakov
fb3574d2cf Merge branch 'master' into fix_test_store_cleanup 2023-02-17 13:59:22 +01:00
kssenii
729c4b74d1 Fix black check 2023-02-17 13:47:45 +01:00
Mikhail f. Shiryaev
3edfb62066
Rollback unnecessary sync because of checking exit code 2023-02-17 12:28:04 +01:00
Alexander Tokmakov
9a664efeb6
Merge branch 'master' into fixes_for_993 2023-02-17 14:17:08 +03:00
Azat Khuzhin
1a352b9021 Fix flakiness of test_backup_restore_on_cluster/test_disallow_concurrency 
The problem is that if you will run first
test_concurrent_restores_on_different_node and after
test_concurrent_restores_on_same_node, like in [1], the first one will
leave the RESTORE and the second will fail.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45282/5af2967f65c3293b277872a002cb5d570200c008/integration_tests__asan__[3/6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-17 10:21:52 +01:00
Antonio Andelic
4e6587b34b
Merge pull request #46488 from ClickHouse/Avogar-patch-1 
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference
 2023-02-17 10:19:18 +01:00
Dmitry Novik
0336f0d8cc
Merge branch 'master' into background-memory-tracker 2023-02-16 20:57:44 +01:00
Alexey Milovidov
993a39e2a1
Merge pull request #46360 from genzgd/http_client_version 
Allow to provide the protocol version by HTTP clients to tune the compatibility of the Native output format.
 2023-02-16 22:17:04 +03:00
kssenii
417052e4b2 Fix remaining tests 2023-02-16 18:56:19 +01:00
kssenii
75d62ee24a Remove support of feature which does not work reliably 2023-02-16 16:41:31 +01:00
Kruglov Pavel
0ed6ddd7ab
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference 2023-02-16 16:28:47 +01:00
Alexander Tokmakov
cc4932aa35 disable flaky test with cassandra dictionaries 2023-02-16 15:11:34 +01:00
robot-clickhouse
a96d6af17e Automatic style fix 2023-02-16 13:37:40 +00:00
Alexander Tokmakov
86d177e0ee fix flaky test 2023-02-16 14:19:55 +01:00
Dmitry Novik
728434821a Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-02-16 12:35:07 +00:00
kssenii
0954a57a6a Enable back 2023-02-16 13:27:58 +01:00
Alexander Tokmakov
ac62356477 fix 2023-02-16 13:05:13 +01:00
Kseniia Sumarokova
4303ee9114
Merge pull request #46404 from kssenii/fix-rabbit-test-4 
Fix test test_rabbitmq_overloaded_insert
 2023-02-16 11:28:18 +01:00
Vitaly Baranov
7dabd18e8d
Merge pull request #46449 from vitlibar/fix-backup-tests 
Fix a backup test
 2023-02-16 10:55:01 +01:00
flynn
ecc39978d7 fix conflict 2023-02-16 02:23:55 +00:00
Dmitry Novik
718ccace80 Update test 2023-02-15 19:08:17 +00:00
Dmitry Novik
e7a94a28ee
Merge branch 'master' into background-memory-tracker 2023-02-15 19:39:28 +01:00
Vitaly Baranov
4a3ad7da85 Fix test test_backup_restore_new/test.py::test_async_backups_to_same_destination[http]. 2023-02-15 17:27:05 +01:00
robot-clickhouse
69463f852e Automatic style fix 2023-02-15 15:44:19 +00:00
Alexander Tokmakov
885f14311c fix 2023-02-15 16:37:44 +01:00
Kruglov Pavel
4f380370a9
Fix s3Cluster schema inference in parallel distributed insert select (#46381) 
* Fix s3Cluster schema inference in parallel distributed insert select
* Try fix flaky test
* Try SYSTEM SYNC REPLICA to avoid test flakiness
 2023-02-15 15:30:43 +01:00
Geoff Genz
33037334a5 Add raw content option to http helper methods 2023-02-15 07:17:28 -07:00
Kruglov Pavel
e56dead5aa
Merge branch 'master' into fix-kafka-protobuf 2023-02-15 15:16:25 +01:00
Nikolay Degterinsky
3075656e1d Merge remote-tracking branch 'upstream/master' into HEAD 2023-02-15 10:06:44 +00:00
Antonio Andelic
4dd4aac125
Merge branch 'master' into custom-key-parallel-replicas 2023-02-15 11:02:37 +01:00
Geoff Genz
fb90c57918 Fix black quotes 2023-02-14 18:44:41 -07:00
Geoff Genz
143806d8ed Fix black quotes 2023-02-14 18:36:17 -07:00
Alexander Tokmakov
ff5023049b
Update test.py 2023-02-15 02:17:02 +03:00
Geoff Genz
f3bcf26959
Merge branch 'ClickHouse:master' into http_client_version 2023-02-14 09:31:29 -07:00
Geoff Genz
5652625ef3 Add http client_protocol_version test 2023-02-14 09:30:13 -07:00
Vladimir C
726fb4bebc
Merge pull request #46368 from ClickHouse/vdimir/bugfix-validate-fix 2023-02-14 14:54:07 +01:00
flynn
e05b4e9745 fix conflict 2023-02-14 13:49:28 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
kssenii
bead024ecb Fix test 2023-02-14 12:45:57 +01:00
vdimir
19b5d21e8b
Minor fix in files locating for Bugfix validate check 2023-02-14 12:31:10 +01:00
Kseniia Sumarokova
1ed4d20e1c
Update test.py 2023-02-14 12:25:27 +01:00
Kseniia Sumarokova
810348a613
Merge pull request #46340 from ClickHouse/kssenii-patch-6 
Update cluster.py
 2023-02-14 11:43:58 +01:00
robot-clickhouse
dce8dca4e5 Automatic style fix 2023-02-13 23:53:15 +00:00
Alexander Tokmakov
e712fbecb2 fix race between drop and create 2023-02-14 00:45:28 +01:00
Nikolai Kochetov
1c0c662fe1
Merge pull request #46275 from ClickHouse/less-mem-usage-for-vertical-merge 
Less memory usage for vertical merge (non-remote disk)
 2023-02-13 21:10:43 +01:00
Kseniia Sumarokova
3977643b52
Update cluster.py 2023-02-13 13:42:21 +01:00
Kruglov Pavel
e139070043
Merge branch 'master' into fix-kafka-protobuf 2023-02-13 12:38:18 +01:00
Ilya Golshtein
f937dc3500 secure in named collections - test.py reformatted by black 2023-02-13 14:10:56 +03:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
Dan Roscigno
5dd6f25d5d
Merge pull request #46276 from ClickHouse/document-log-compression 
docs for logger stream_compression
 2023-02-12 21:55:33 -05:00
alesapin
1683cd5d6f
Merge branch 'master' into mutations_rename_hang 2023-02-12 13:06:48 +01:00
Alexey Milovidov
395d6b6bd5
Merge pull request #46282 from CurtizJ/return-back-vertical-merges 
Allow vertical merges from compact to wide parts [2]
 2023-02-12 05:51:12 +03:00
Alexey Milovidov
732a030036
Merge pull request #46288 from azat/tests/simplify-attach-from-s3 
Simplify ATTACH MergeTree table FROM S3 in tests
 2023-02-12 05:31:24 +03:00
kssenii
7beb843650 Fix 2023-02-11 19:57:41 +01:00
Kseniia Sumarokova
ed6f623f3a
Merge pull request #46168 from kssenii/resubmit-prefetches 
Allow to increase prefetching of data for reads
 2023-02-11 16:22:47 +01:00
Kruglov Pavel
e84baa9106
Merge pull request #43179 from tonickkozlov/tonickkozlov/add-interserver-dns-retries 
CLICKHOUSE-2375 Add interserver DNS retries
 2023-02-11 14:35:40 +01:00
kssenii
7e0a98cbf1 Add test 2023-02-11 12:36:25 +01:00
alesapin
5c83ddabf9 Merge branch 'master' into mutations_rename_hang 2023-02-11 12:18:58 +01:00
kssenii
3067c1d723 Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
Azat Khuzhin
67b47fe871 Simplify ATTACH MergeTree table FROM S3 in tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-11 08:46:05 +01:00
Kruglov Pavel
cf14282d79
Fix style 2023-02-11 01:45:28 +01:00
Kruglov Pavel
825a5dd806
Try prevent flaky test 2023-02-10 23:12:32 +01:00
Kseniia Sumarokova
3be36c7979
Merge pull request #41976 from kssenii/allow-single-disk-instead-of-storage-policy 
Allow configuring storage as `SETTINGS disk='<disk_name>'` (instead of `storage_policy`) and explicit disk creation `SETTINGS disk=disk(<disk_configuration>)`
 2023-02-10 21:38:50 +01:00
Kruglov Pavel
8bbf62508f
Merge branch 'master' into fix-kafka-protobuf 2023-02-10 18:32:25 +01:00
Anton Popov
1205932a19 add setting to disable vertical merges from compact parts 2023-02-10 16:33:46 +00:00
Antonio Andelic
9e11f06e79
Merge pull request #46191 from ClickHouse/s3-reorder-creds 
Prefer explicitly defined credentials for S3
 2023-02-10 16:35:54 +01:00
Sema Checherinda
4827c70b5e
Merge pull request #46233 from ClickHouse/CheSema-patch-1 
increase a time gap between insert and ttl move
 2023-02-10 15:36:56 +01:00
DanRoscigno
043c1b7d8d docs for logger stream_compression 2023-02-10 09:02:54 -05:00
robot-clickhouse
fa424ae8eb Automatic style fix 2023-02-10 14:01:19 +00:00
Nikolai Kochetov
367136697d Added tests. 2023-02-10 13:51:02 +00:00
Ilya Golshtein
3b72b3f13b secure in named collection - switched to specific_args, tests added 2023-02-10 13:42:11 +03:00
flynn
37a850bd36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into iceberg 2023-02-10 08:47:14 +00:00
flynn
db15634a01 fix conflict 2023-02-10 08:41:04 +00:00
Alexander Tokmakov
e5f8a44b87
Merge pull request #46243 from ClickHouse/tavplubix-patch-7 
Fix test_distributed_ddl_parallel
 2023-02-09 22:15:08 +03:00
Alexander Tokmakov
f7c7c9be31
Update test.py 2023-02-09 20:37:47 +03:00
Alexander Tokmakov
e2be729aea
Update test.py 2023-02-09 20:27:24 +03:00
kssenii
9e04e57949 Allow to give access only to certain named collections 2023-02-09 17:22:57 +01:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Sema Checherinda
ffc97908ef
increase a time gap between insert and ttl move 2023-02-09 15:12:21 +01:00
Kruglov Pavel
947923321c
Fix style 2023-02-09 14:55:21 +01:00
Kruglov Pavel
59c52c503d
Fix style 2023-02-09 14:09:46 +01:00
Kruglov Pavel
8821074f83
Fix style 2023-02-09 14:08:24 +01:00
Vitaly Baranov
39bacfb9dc
Merge branch 'master' into allow-single-disk-instead-of-storage-policy 2023-02-09 13:16:55 +01:00
Kruglov Pavel
c3c0356fdd
Merge branch 'master' into fix-kafka-protobuf 2023-02-09 13:04:55 +01:00
alesapin
0a82385413 Blind fix for trash test 2023-02-09 12:23:18 +01:00
robot-clickhouse
2f9ad860bd Automatic style fix 2023-02-09 08:26:36 +00:00
Antonio Andelic
ae731b739a Prefer explicitly defined creds for S3 2023-02-09 08:13:16 +00:00
pufit
7cf71d1f82
Merge pull request #46144 from ClickHouse/46131-fix-config-attributes-merge 
Fix config merge for XML attributes.
 2023-02-08 23:28:13 -05:00
Alexander Tokmakov
4fd4058259
Merge pull request #45629 from arthurpassos/fix_cares_crash 
Cancel c-ares failed requests and retry on system interrupts to prevent callbacks with dangling references and premature resolution failures
 2023-02-09 02:29:29 +03:00
Alexander Tokmakov
65cbb0fcfc
Merge pull request #46138 from vitlibar/fix-dependency-checks 
Fix dependency checks
 2023-02-09 00:54:40 +03:00
alesapin
00686ae03b Fix tests again 2023-02-08 22:34:09 +01:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
alesapin
5f33aaf59b Fix three leftovers 2023-02-08 16:31:37 +01:00
Yatsishin Ilya
c5103ae469 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-08 14:09:34 +00:00
robot-clickhouse
f81f0b351f Automatic style fix 2023-02-08 13:58:55 +00:00
alesapin
a28d10a810 Fxi 2023-02-08 14:50:30 +01:00
Kseniia Sumarokova
f6ebe11350
Merge pull request #46108 from azat/azure-fix 
Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test
 2023-02-08 12:04:46 +01:00
Alexey Milovidov
5145beb033
Merge branch 'master' into 46131-fix-config-attributes-merge 2023-02-08 10:42:54 +03:00
Alexey Milovidov
da22a770a0
Merge pull request #46107 from kssenii/rabbit-test-overloaded-insert-fix 
Fix flaky rabbitmq test
 2023-02-08 04:14:03 +03:00
robot-clickhouse
6fda4902d8 Automatic style fix 2023-02-07 23:57:14 +00:00
pufit
982f588f71 \n before EOF 2023-02-07 23:50:57 +00:00
pufit
c066c0dfdb Fix config merge for an attributes 2023-02-07 23:46:13 +00:00
Vitaly Baranov
3db9d58fcf Added test. 2023-02-07 23:46:48 +01:00
Kseniia Sumarokova
a5d3b00699
Merge pull request #46010 from kssenii/named-collections-fix-access 
Fix named collections access
 2023-02-07 23:20:22 +01:00
robot-clickhouse
0d28a8e6a8 Automatic style fix 2023-02-07 18:45:17 +00:00
Dmitry Novik
9c74443783 Trying to add a test 2023-02-07 18:38:26 +00:00
Yatsishin Ilya
1baa15d603 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-07 15:46:59 +00:00
Yatsishin Ilya
ff4e10fdd4 print what is running when can't stop clickhouse 2023-02-07 15:46:55 +00:00
kssenii
022d4308ce Address review comments 2023-02-07 13:01:55 +01:00
Azat Khuzhin
bca85c6852 Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test 
Here is an example of an error [1]:

    2023.02.06 21:59:09.076849 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Starting up disk blob_storage_disk
    2023.02.06 21:59:09.076897 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Disk blob_storage_disk started up
    2023.02.06 21:59:09.077263 [ 200 ] {} <Trace> StoragePolicy (blob_storage_policy): Storage policy blob_storage_policy created, total volumes 1
    2023.02.06 21:59:09.077318 [ 200 ] {} <Information> StoragePolicySelector: Storage policy `blob_storage_policy` loaded
    ...
    2023.02.06 21:59:09.227326 [ 1 ] {} <Error> Application: std::exception. Code: 1001, type: Azure::Storage::StorageException, e.what() = 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384, Stack trace (when copying this message, always include the lines below):

    0. ./build_docker/../contrib/llvm-project/libcxx/include/exception:134: std::runtime_error::runtime_error() @ 0x44297b8d in /usr/bin/clickhouse
    ...
    5. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::getAzureBlobContainerClient() @ 0x2f5b225f in /usr/bin/clickhouse
    6. ./build_docker/../src/Disks/ObjectStorages/AzureBlobStorage/registerDiskAzureBlobStorage.cpp:0:
    10. ./build_docker/../src/Interpreters/Context.cpp:0: DB::Context::getDisksMap() const @ 0x2f95af47 in /usr/bin/clickhouse
    ...
    13. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::AsynchronousMetrics::start() @ 0x1f4d6161 in /usr/bin/clickhouse
    14. ./build_docker/../programs/server/Server.cpp:0: DB::Server::main() @ 0x1f3a5bfb in /usr/bin/clickhouse
    15. ./build_docker/../contrib/poco/Util/src/Application.cpp:0: Poco::Util::Application::run() @ 0x3c7546bf in /usr/bin/clickhouse
    16. ./build_docker/../programs/server/Server.cpp:476: DB::Server::run() @ 0x1f381f7b in /usr/bin/clickhouse
    17. ./build_docker/../contrib/poco/Util/src/ServerApplication.cpp:612: Poco::Util::ServerApplication::run(int, char**) @ 0x3c797ee0 in /usr/bin/clickhouse
    18. ./build_docker/../programs/server/Server.cpp:0: mainEntryClickHouseServer(int, char**) @ 0x1f37a262 in /usr/bin/clickhouse
    19. ./build_docker/../programs/main.cpp:0: main @ 0xe9d21ae in /usr/bin/clickhouse
    20. __libc_start_main @ 0x7f58271a1083 in ?
    21. _start @ 0xe90ef6e in /usr/bin/clickhouse
     (version 23.2.1.1)
    2023.02.06 21:59:09.227971 [ 1 ] {} <Error> Application: 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/46045/bd4170e03c6af583a51d12d2c39fa775dcb9997b/integration_tests__asan__[6/6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-07 12:52:36 +01:00
kssenii
427f2d0257 Try fix rabbit test 2023-02-07 12:36:25 +01:00
Antonio Andelic
9cde46acff Correctly calculate size on update 2023-02-06 16:28:05 +00:00
robot-clickhouse
7aeacabe2f Automatic style fix 2023-02-06 13:20:15 +00:00
Kseniia Sumarokova
d52420c548
Update test.py 2023-02-06 14:10:33 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
kssenii
631c460c96 Add forgitten config file 2023-02-06 11:35:30 +01:00
Antonio Andelic
61ddae6c2f
Merge pull request #46041 from azat/ci/improve-integration-sanitizer-report 
Dump sanitizer errors in the integration tests logs
 2023-02-06 09:42:26 +01:00
flynn
0dd8a61a8e fix conflict 2023-02-06 03:25:12 +00:00
kssenii
9937e73fa9 Fix integration test 2023-02-05 22:38:07 +01:00
kssenii
3042e9ee6e Fix integration test 2023-02-05 13:39:13 +01:00
robot-clickhouse
fb288ad5f7 Automatic style fix 2023-02-05 11:58:51 +00:00
Kseniia Sumarokova
7a11b37dae
Update test.py 2023-02-05 12:54:03 +01:00
kssenii
84ea48b555 Merge remote-tracking branch 'origin/named-collections-fix-access' into named-collections-fix-access 2023-02-04 23:32:56 +01:00
kssenii
cb4757fc43 Fix tests 2023-02-04 22:54:49 +01:00
Azat Khuzhin
0a598c79f4 Remove misleading information that sanitizer errors are in the docker.log 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-04 11:23:26 +01:00
Azat Khuzhin
88dc85e13e Dump sanitizer errors in the integration tests logs 
Previously you need to download the artifacts (0.5G+-), or reproduce the
problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-04 11:23:26 +01:00
Antonio Andelic
8929838fcc Merge branch 'master' into add-support-for-settings-alias 2023-02-03 17:47:00 +00:00
Vitaly Baranov
45d2d678ab
Merge pull request #45800 from vitlibar/rename-new-columns-in-system-backups 
Rename new columns in system.backups
 2023-02-03 14:00:16 +01:00
kssenii
486c10bde1 Fix named collections access 2023-02-03 13:18:54 +01:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush 
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
 2023-02-03 11:50:12 +01:00
Alexey Milovidov
108d1c3442
Merge pull request #45872 from ClickHouse/fix-trash-query-kind 
Remove trash, add a feature and fix a bug
 2023-02-03 09:58:43 +03:00
kssenii
a391de18a1 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-02-02 20:49:41 +01:00
kssenii
b72810a608 Fix tests 2023-02-02 20:16:53 +01:00
Arthur Passos
108071f052 fix style 2023-02-02 13:42:17 -03:00
Arthur Passos
6e466e3a19 fix style 2023-02-02 13:28:50 -03:00
Kseniia Sumarokova
6705fafef9
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-02-02 16:06:51 +01:00
Arthur Passos
eda8ab78c2 fix integ tests 2023-02-02 11:30:16 -03:00
Antonio Andelic
f613bfd8d2 Merge branch 'master' into add-support-for-settings-alias 2023-02-02 11:15:39 +00:00
kssenii
d85ad3c219 Fix tests 2023-02-02 12:15:29 +01:00
Vitaly Baranov
b8078acce2
Merge pull request #45774 from vitlibar/wiping-sensitive-info-in-named-collection-overrides 
Mask sensitive info in named collection's overrides
 2023-02-02 10:06:59 +01:00
Alexey Milovidov
11e89d9aa0 Add a test 2023-02-02 04:40:45 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Arthur Passos
3d9b464758 add missing comma :) 2023-02-01 09:52:06 -03:00
Arthur Passos
e4545e1267 rename reverse_dns_config file 2023-02-01 09:37:39 -03:00
Arthur Passos
70f700941a add missing allow_reverse_dns_function 2023-02-01 08:48:46 -03:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster 
Support DELETE ON CLUSTER
 2023-02-01 10:52:01 +01:00
Antonio Andelic
ec04cf6876 Merge branch 'master' into add-support-for-settings-alias 2023-02-01 09:01:01 +00:00
Vitaly Baranov
96b140cc95 Rename columns in system.backups: num_files, num_processed_files, processed_files_size 
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
 2023-01-31 22:45:41 +01:00
kssenii
2f5842a749 Update tests 2023-01-31 20:25:08 +01:00
kssenii
4a1bdcf24c Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-31 18:11:26 +01:00
robot-clickhouse
a32818a32e Automatic style fix 2023-01-31 14:35:08 +00:00
Alexander Gololobov
51fdcb7ffd Test DELETE FROM on replicated database 2023-01-31 15:20:21 +01:00
Arthur Passos
58e4e35f0d remove unnecessary file mapping 2023-01-31 09:10:45 -03:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Kseniia Sumarokova
7d53f8bbf6
Merge pull request #45591 from bharatnc/ncb/odbc-connection-pool-fixes 
fixes to use the odbc_bridge_use_connection_pooling setting correctly
 2023-01-31 11:31:59 +01:00
flynn
ffddc0dcce fix conflict 2023-01-31 10:28:58 +00:00
Alexander Gololobov
f9133f3d85
Merge pull request #45791 from ClickHouse/fix_drop_hung 
Fix bug in tables drop which can lead to potential query hung
 2023-01-31 10:11:11 +01:00
Bharat Nallan
f1d6e3b908
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-30 15:49:04 -08:00
Vitaly Baranov
48023a297f Add missed test config. 2023-01-30 21:47:30 +01:00
alesapin
0908ce8e14 Add timeout 2023-01-30 17:02:58 +01:00
alesapin
be58d5d1af Fix bug in tables drop which can lead to potential query hung 2023-01-30 17:00:28 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Pradeep Chhetri
deaa70fb14
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 21:35:16 +08:00
Vitaly Baranov
6ee9971931 Mask sensitive info in named collection's overrides. 2023-01-30 11:33:21 +01:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files 
Added num_processed_files and processed_files_size for backup and restore processes
 2023-01-30 09:24:49 +01:00
Arthur Passos
0e7b35c9f4 fix black 2023-01-29 13:19:03 -03:00
Arthur Passos
2a63b86796 fix black 2023-01-29 11:35:04 -03:00
Arthur Passos
6c3a5871ba added integ test 2023-01-29 11:24:47 -03:00
flynn
9b517cdc76 fix conflict 2023-01-29 08:34:56 +00:00
Pradeep Chhetri
9919fb0be9
Merge branch 'master' into pchhetri/fix-45690 2023-01-29 11:35:26 +08:00
Pradeep Chhetri
d52c841d7d Fix test 2023-01-29 11:35:00 +08:00
Pradeep Chhetri
18cf0fd2c1 Fix test 2023-01-29 10:29:10 +08:00
Pradeep Chhetri
65301cf55a Format fixes 2023-01-29 09:03:51 +08:00
Pradeep Chhetri
0e02f82665 Add test for zip archive with bad settings 2023-01-29 08:40:24 +08:00
Azat Khuzhin
3903b442fb tests: fix broken disk emulation in test_jbod_ha 
The problem with chmod 000 is that it is simply ignored for the owner of
the namespace (verified with kprobe for security_capable [1]),
previously it worked only cause there was a check for uid explicitly in
FS::canRead/canWrite.

  [1]: cat-10561   [001]  1340776.172944: security_capable_retprobe: (capable_wrt_inode_uidgid+0x40/0x70 <- security_capable) arg1=0xffffffff

0xffffffff is -1 and it is EPERM

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
Azat Khuzhin
e6695196aa tests/integration: add SYS_ADMIN capability for mount/remount 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
Azat Khuzhin
1e3f33ad4b tests/integration: fix --privileged passthrough 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
kssenii
68cab4bc49 Merge remote-tracking branch 'origin/storage-rabbitmq-fix-flush' into storage-rabbitmq-fix-flush 2023-01-27 17:23:05 +01:00
kssenii
f39cd0b392 Update tests 2023-01-27 17:22:24 +01:00
kssenii
9c4a97bbd1 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-27 17:17:09 +01:00
avogar
0a99d421f5 Fix formats parser resetting, test processing bad messages in kafka 2023-01-27 13:22:50 +00:00
robot-clickhouse
9cdc8d7b9d Automatic style fix 2023-01-27 09:46:51 +00:00
Antonio Andelic
defc9108f0 Extend support for aliases to constraints and profiles 2023-01-27 09:39:10 +00:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Bharat Nallan Chakravarthy
70a3ffa0e6 fix test 2023-01-25 06:47:04 -08:00
Vitaly Baranov
9014023625 Fix wiping sensitive info in INSERT INTO FUNCTION. 2023-01-25 14:50:49 +01:00
Vitaly Baranov
32efe92199
Merge pull request #45487 from vitlibar/use-new-copy-s3-functions-in-s3-obj-storage 
Use new copy s3 functions in S3ObjectStorage
 2023-01-25 13:22:04 +01:00
Bharat Nallan
2ef8fcb318
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-24 21:27:20 -08:00
Bharat Nallan Chakravarthy
fc4eba3b7b add a test 2023-01-24 16:56:56 -08:00
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
Antonio Andelic
6da9dc2407 Correctly handle case with missing custom_key 2023-01-24 14:16:26 +00:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
Smita Kulkarni
642f9ca549 Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 09:37:28 +01:00
Alexander Tokmakov
0e0e2f0f67
Update test.py 2023-01-23 19:01:06 +03:00
Aleksandr
2caeed901b
Merge branch 'master' into fix_backup_restore_num_files 2023-01-23 13:43:20 +01:00
Smita Kulkarni
383af7f3a6 Moved settings inside backups section - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-23 08:59:44 +01:00
Anton Popov
f181254fb0 fix race in destructor of ParallelParsingInputFormat 2023-01-23 01:18:58 +00:00
Smita Kulkarni
310ae62d90 Updated backup/restore status when concurrent backups & restores are not allowed 
Implementation:
* Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures.
* Renamed backup_uuid to restore_uuid in RestoreSettings.
Testing:
* Updated test test_backup_and_restore_on_cluster/test_disallow_concurrency to check for specific backup/restore id.
 2023-01-22 19:01:09 +01:00
Antonio Andelic
44ef00dc05 Merge branch 'master' into custom-key-parallel-replicas 2023-01-22 14:20:58 +00:00
Antonio Andelic
3a09415733 Refactor integration test 2023-01-22 14:20:25 +00:00
Vitaly Baranov
5ceb64accc Use new copy s3 functions in S3ObjectStorage. 2023-01-21 15:47:58 +01:00
Vitaly Baranov
f0fda580d0
Merge pull request #45188 from vitlibar/backup-to-s3-memory-optimization 
Optimize memory consumption during backup to S3
 2023-01-21 12:37:35 +01:00
Sema Checherinda
962894afc8
Merge pull request #44909 from CheSema/intersect-prev-part 
Do not merge over a gap with outdated undeleted parts
 2023-01-21 11:51:21 +01:00
Anton Popov
41a199e175
Fix crash when ListObjects request fails (#45371) 2023-01-20 20:10:23 +01:00
Antonio Andelic
2cb106f1f9 Add integration test for custom_key 2023-01-20 12:55:26 +00:00
Maksim Kita
23e26032ca
Merge pull request #45399 from aalexfvk/alexfvk/mdb-21326_fix_system_dictionaries_when_dictionary_with_bad_structure 
Fix select from system.dictionaries when there is dictionary with bad structure
 2023-01-20 13:36:32 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config 
Add <storage_policy> config parameter for system logs
 2023-01-20 10:27:57 +01:00
Aleksandr Musorin
838acb22b7
added num_processed_files and processed_files_size 2023-01-20 10:20:41 +01:00
SmitaRKulkarni
6aa63414db
Merge pull request #45072 from ClickHouse/43891_Disallow_concurrent_backups_and_restores 
Added settings to disallow concurrent backups and restores
 2023-01-20 09:17:20 +01:00
Aleksei Filatov
42549e89f2 [rev 2] Fix review notes 2023-01-20 09:37:49 +03:00
Kseniia Sumarokova
1452d2588c
Update test.py 2023-01-19 18:06:43 +01:00
Kseniia Sumarokova
f80246644c
Update test.py 2023-01-19 18:04:09 +01:00
Kseniia Sumarokova
db49368f5e
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-01-19 18:03:42 +01:00
Aleksei Filatov
afada0ecb3 Fix review notes 2023-01-19 17:02:57 +03:00
alesapin
ccd41e6d14
Merge pull request #45403 from ClickHouse/fix_test_system_merges 
Reduce an amount of trash in `tests_system_merges`
 2023-01-19 12:00:54 +01:00
SmitaRKulkarni
67e2bf31f5
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 11:21:37 +01:00
Ilya Yatsishin
f16328aa8b
Merge pull request #45402 from qoega/simpler-test_replicated_merge_tree_s3_restore 2023-01-19 10:27:42 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
SmitaRKulkarni
db03dd1bb9
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 09:32:50 +01:00
robot-clickhouse
33a4222155 Automatic style fix 2023-01-18 15:52:38 +00:00
Alexander Tokmakov
6f8c1424df reduce an amount of trash in tests_system_merges 2023-01-18 16:45:47 +01:00
Yatsishin Ilya
1603e734f9 Make test simpler to see errors not in teardown 2023-01-18 15:36:24 +00:00
Aleksei Filatov
5e9340f682 Add integration test 2023-01-18 17:50:38 +03:00
Vitaly Baranov
7cdb2c4c7f
Merge pull request #45351 from vitlibar/fix-backup-with-killed-mutations 
Fix backup with killed mutations
 2023-01-18 13:14:27 +01:00
Ilya Yatsishin
9b5e7c00d5
Merge pull request #45369 from qoega/improve-failed-kafka-logging 
Improve failed kafka startup logging
 2023-01-18 13:09:48 +01:00
flynn
01ae8f584b fix test 2023-01-18 11:34:52 +00:00
alesapin
a4ff9027ce
Merge branch 'master' into fix_flaky_test_ttl_modify 2023-01-18 12:19:37 +01:00
Antonio Andelic
f57ee043ae
Merge pull request #45319 from ClickHouse/disable-prewhere-in-merge-different-types 
Disable PREWHERE in storage Merge if types don't match
 2023-01-18 10:02:06 +01:00
flynn
2fb32dc56c fix and add test 2023-01-18 08:33:55 +00:00
Ilya Yatsishin
a50c6c0abe
Merge branch 'master' into improve-failed-kafka-logging 2023-01-18 02:39:32 +01:00
robot-clickhouse
237bb15a9f Automatic style fix 2023-01-17 21:34:16 +00:00
Smita Kulkarni
6e06af1b25 Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
Yatsishin Ilya
5ae72fe711 Improve failed kafka startup logging 2023-01-17 16:25:05 +00:00
alesapin
261dc06be9 Fix flaky ttl test 2023-01-17 17:08:32 +01:00
Antonio Andelic
ba363c141a Fix integration test 2023-01-17 13:12:52 +00:00
Vitaly Baranov
8c5c423d67 Add test. 2023-01-17 13:11:24 +01:00
Sema Checherinda
2cd55bc398 fix/adjust tests in integration/test_partition 2023-01-17 12:02:18 +01:00
Vitaly Baranov
14a7ee8e26 Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00