thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-28 10:31:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
118,535 Commits 9,189 Branches 1,782 Tags 2.2 GiB
7281bda072
Commit Graph

6750 Commits

Author SHA1 Message Date
alesapin
e44fca8bb9 Add test 2023-03-17 12:56:31 +01:00
Aleksei Filatov
886b530963 [rev: 1] Fix review remarks 2023-03-17 13:56:05 +03:00
Aleksei Filatov
cf6ca10c83 Tests for replicated system.functions 2023-03-17 13:56:05 +03:00
Aleksei Filatov
1321f87eee Tests for replication UDF to ZooKeeper 2023-03-17 13:56:04 +03:00
alesapin
efa0622a84
Merge pull request #47631 from ClickHouse/fix_wait_for_zero_copy_lock 
Fix wait for zero copy lock during move
 2023-03-17 11:15:55 +01:00
Alexander Tokmakov
8b8215f91a fix some other tests, add logs for further debugging 2023-03-16 16:40:08 +01:00
pufit
f4d9b4a888
Merge pull request #47086 from pkit/pkit/insert_http_body 
use http request body in predefined http handlers
 2023-03-15 17:41:05 -04:00
alesapin
586b8a4733 Add test 2023-03-15 22:38:42 +01:00
Dmitry Novik
be40218a9a
Revert "Revert #46622 (test_async_insert_memory)" 2023-03-15 22:14:54 +01:00
Alexander Tokmakov
6a653060ff
Merge pull request #47213 from azat/interserver-mode-v2 
Reimplement interserver mode to avoid replay attacks
 2023-03-15 16:26:50 +03:00
avogar
b603ce63f1 Fix more tests 2023-03-15 12:18:33 +00:00
Vitaly Baranov
00c05f7f8b
Merge pull request #47546 from vitlibar/use-server-side-copy-for-restore 
Use server-side copy for restore from S3 to S3.
 2023-03-15 11:28:29 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix 
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
 2023-03-15 11:00:06 +01:00
Azat Khuzhin
bcf381c5ae Reimplement interserver mode to avoid replay attacks 
Prevous implementation (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET)
accepts the salt from the client, which make it useless.

Reimplement the protocol to send the salt by the server and use it in
the client instead.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-15 08:28:43 +01:00
Alexey Milovidov
f859b3258a Add support for Decimal256 in MySQL tables 2023-03-15 04:45:26 +01:00
Vitaly Baranov
25356786ea Simplify the implementation, create new utility function copyS3FileToDisk(). 2023-03-14 23:34:44 +01:00
Nikolay Degterinsky
eddda2eb73 Add SSL authentication to the native protocol 2023-03-14 22:10:08 +00:00
Smita Kulkarni
8cd36d2a36 Removed generated file cluster_for_concurrency_test.xml 2023-03-14 20:30:44 +01:00
Smita Kulkarni
e863e49a49 Renamed cluster configuration xml to cluster_for_disallow_concurrency_test.xml for disallow_concurreny of backup and restore test 2023-03-14 20:26:19 +01:00
SmitaRKulkarni
8db4964ebc
Revert "Revert "Backup_Restore_concurrency_check_node"" 2023-03-14 20:23:43 +01:00
Yatsishin Ilya
45c5275bfb Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-14 17:27:25 +00:00
Alexander Tokmakov
773cd5a686
Revert "Backup_Restore_concurrency_check_node" 2023-03-14 18:55:08 +03:00
Vitaly Baranov
859082c4b7
Merge pull request #47216 from ClickHouse/Backup_Restore_concurrency_check_node 
Backup_Restore_concurrency_check_node
 2023-03-14 13:36:43 +01:00
Alexander Tokmakov
5a1ee881f8
Merge pull request #47547 from ClickHouse/filter_too_frequent_logs 
Hide too noisy log messages, fix some tests
 2023-03-14 13:53:21 +03:00
Alexander Tokmakov
ba6c6255a3 hide too noisy log messages, fix some tests 2023-03-14 00:23:36 +01:00
Vitaly Baranov
1cf1ce07fe Use server-side copy during restore from S3 to S3. 2023-03-13 23:50:13 +01:00
Alexey Milovidov
a411ae10b5
Merge pull request #47486 from ClickHouse/revert_25674 
Remove "asynchronous connection drain"
 2023-03-13 21:40:39 +03:00
Alexander Tokmakov
ee6c18cbc6
Better error after failed Ordinary-to-Atomic conversion (#47487) 
* better error on failed Ordinary-to-Atomic conversion

* fix test

* Update loadMetadata.cpp
 2023-03-13 19:13:49 +03:00
MeenaRenganathan22
dc1e125b31 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-13 06:54:47 -07:00
alesapin
8db0d26519
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-13 14:48:20 +01:00
Smita Kulkarni
f76b97cb51 Set num of nodes to 4 for backup restore disallow concurrency test 2023-03-13 10:42:43 +01:00
SmitaRKulkarni
9a35a434f8
Merge branch 'master' into Backup_Restore_concurrency_check_node 2023-03-13 10:04:32 +01:00
Alexander Tokmakov
7b1b238d0b Revert "Merge pull request #25674 from amosbird/distributedreturnconnection" 
This reverts commit 5ffd99dfd4, reversing
changes made to 2796aa333f.
 2023-03-11 19:09:47 +01:00
Alexander Tokmakov
0359b3e336 Revert "Merge pull request #46622 from ClickHouse/async-insert-memory-fix" 
This reverts commit 67469ad46b, reversing
changes made to 678e4250cd.
 2023-03-11 17:01:10 +01:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
alesapin
588cc0f159
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-09 14:54:10 +01:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
MeenaRenganathan22
ed5b19f5f8 Fixed the integration test failures related with HDFS and KAFKA 2023-03-08 06:11:17 -08:00
Yatsishin Ilya
6cde37093a Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-08 13:34:18 +00:00
alesapin
4423be8332
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-08 12:59:07 +01:00
Antonio Andelic
816a9c1099
Merge branch 'master' into custom-key-parallel-replicas 2023-03-08 11:06:30 +01:00
Igor Nikonov
cc5b97b624
Merge pull request #46997 from AndyBys/log-level-change 
Change level log in executeQuery
 2023-03-08 10:36:21 +01:00
Alexey Milovidov
e2aff59a2d
Merge pull request #47106 from kssenii/allow-nested-disks-in-custom-disks 
Allow nested custom disks
 2023-03-08 03:00:55 +03:00
Alexander Tokmakov
ffd55d951d
Merge branch 'master' into followup_46681 2023-03-07 23:38:06 +03:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine 
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
 2023-03-07 20:36:46 +01:00
Alexander Tokmakov
7ce20f5cd2 fix tests 2023-03-07 14:25:28 +01:00
Antonio Andelic
35c15e6ef8 Merge branch 'master' into custom-key-parallel-replicas 2023-03-07 09:37:38 +00:00
Alexey Milovidov
7d48eae0f6
Merge pull request #47256 from ClickHouse/keeper-4lw-clean-resources 
Add Keeper 4LW for cleaning resources
 2023-03-07 04:23:15 +03:00
Igor Nikonov
838ff88abe
Merge branch 'master' into log-level-change 2023-03-06 18:00:49 +01:00
Antonio Andelic
9e3794f7d7 Skip for sanitizer builds 2023-03-06 14:36:53 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
kssenii
cb3dd3c200 Fix flaky test 2023-03-06 13:06:31 +01:00
Han Fei
b7eef62458
Merge pull request #45491 from azat/dist/async-send-refactoring 
[RFC] Rewrite distributed sends to avoid using filesystem as a queue, use in-memory queue instead
 2023-03-06 12:32:33 +01:00
Antonio Andelic
3a184880c6 Add test for clrs 2023-03-05 17:18:53 +00:00
kssenii
b8d33f4d38 Fix test 2023-03-05 13:46:23 +01:00
kssenii
d9e75e5c0a Fix test 2023-03-05 13:13:32 +01:00
kssenii
8f2d75cef8 Fix tests 2023-03-05 12:56:00 +01:00
Alexey Milovidov
41c79b0c42
Merge pull request #46086 from ClickHouse/fix-data-size 
Fix data size calculation in Keeper
 2023-03-05 14:11:36 +03:00
Sema Checherinda
85178c9609
Merge pull request #47102 from CheSema/merge-mutate-do-thread-group 
do flushUntrackedMemory when context switches
 2023-03-03 20:23:25 +01:00
robot-clickhouse
cebe323bef Automatic style fix 2023-03-03 15:56:11 +00:00
Smita Kulkarni
d2dbd5f293 Updated to use tryGet instead of get for checking stage of backups/restores in concurrency check and updated tests by increasing data size to have a longer backup/restore to ensure the overlap and increased timeout correspondingly. 2023-03-03 16:48:14 +01:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
robot-clickhouse
46667d43d8 Automatic style fix 2023-03-03 15:25:25 +00:00
Antonio Andelic
737cf8e149 Better 2023-03-03 15:14:49 +00:00
Antonio Andelic
cd4100cb19
Merge branch 'master' into fix-data-size 2023-03-03 15:33:43 +01:00
Alexander Tokmakov
5be681c5f6
Merge pull request #47152 from ClickHouse/fix_flaky_test_replicated_database 
Use unique names and paths in `test_replicated_database`
 2023-03-03 17:15:27 +03:00
Alexander Tokmakov
cadaf06829
Merge pull request #46681 from ClickHouse/fix_insert_cancellation_in_native_protocol 
Fix queries cancellation when a client dies
 2023-03-03 16:27:20 +03:00
kssenii
0fa3fb3592 Fix show grants for user which has all grants 2023-03-03 14:04:32 +01:00
Konstantin Bogdanov
1bbf5acd47
Pass headers from StorageURL to WriteBufferFromHTTP (#46996) 
* Pass headers from StorageURL to WriteBufferFromHTTP

* Add a test

* Lint

* `time.sleep(1)`

* Start echo server earlier

* Add proper handling for mock server start

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-03-03 13:55:52 +01:00
Sema Checherinda
bc8b34f74b adjust test test_seekable_formats 2023-03-03 13:16:46 +01:00
Kseniia Sumarokova
386663953c
Merge branch 'master' into named-collections-finish 2023-03-03 12:23:38 +01:00
Antonio Andelic
a6da64aac0
Merge pull request #46824 from ClickHouse/fix-single-thread-parquet 
Use initial range for fetching file size in HTTP read buffer
 2023-03-03 09:23:22 +01:00
kssenii
cd7cd0526b Fix tests 2023-03-02 21:21:04 +01:00
kssenii
0c4bb3c80f Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-03-02 19:08:29 +01:00
robot-clickhouse
fdcbec4fee Automatic style fix 2023-03-02 17:35:56 +00:00
Alexander Tokmakov
c518f3690e Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-02 18:24:08 +01:00
Alexander Tokmakov
fc8ea01c2b use unique names and paths in test_replicated_database 2023-03-02 18:23:31 +01:00
Yatsishin Ilya
d4304d2028 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-02 16:16:18 +00:00
AndyB
cf245538b9 checker fix 2023-03-02 14:31:38 +00:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
Antonio Andelic
5328a0777b Merge branch 'master' into fix-single-thread-parquet 2023-03-02 13:45:27 +00:00
kssenii
2883861795 Merge remote-tracking branch 'upstream/master' into allow-nested-disks-in-custom-disks 2023-03-02 14:30:58 +01:00
alesapin
915b4ea56a
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 14:29:21 +01:00
Constantine Peresypkin
c4ae17e495
fix black 2023-03-02 14:23:22 +01:00
Kseniia Sumarokova
e95c4b6379
Merge pull request #47011 from kssenii/fix-azure-test 
Fix flaky azure test
 2023-03-02 13:59:43 +01:00
Constantine Peresypkin
fdc6de2a27 use http request body in predefined http handlers 
adds a new "virtual" parameter `__request_body`
which can be used in http rules, see below

tremendously helps in producing arbitrary REST interfaces

for example:

```xml
<http_handlers>
  <rule>
    <methods>POST</methods>
    <url>/ingest</url>
    <handler>
      <type>predefined_query_handler</type>
      <query>INSERT INTO events(id, data) SELECT {id:UInt32}, {__request_body:String}</query>
    </handler>
  </rule>
</http_handlers>
```
 2023-03-02 12:51:48 +01:00
alesapin
189836307c Merge branch 'revert-46909-revert-45911-mutations_rename_hang' of github.com:ClickHouse/ClickHouse into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 12:49:06 +01:00
Kruglov Pavel
ce8e49a9a0
Merge pull request #45693 from Avogar/fix-kafka-protobuf 
Fix formats parser resetting, test processing bad messages in kafka
 2023-03-02 11:50:45 +01:00
AndyB
657afa849e logger level in test 2023-03-01 23:35:09 +00:00
robot-clickhouse
54336f7c98 Automatic style fix 2023-03-01 20:12:00 +00:00
alesapin
46f25d53b3 Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-01 20:09:12 +01:00
kssenii
f3e3b916c9 Allow nested custom disks 2023-03-01 19:55:59 +01:00
Alexander Gololobov
f64d08bd5c Enable lightweight delete support by default 2023-03-01 19:35:55 +01:00
alesapin
ebba37b18f
Merge pull request #47010 from ClickHouse/zero_copy_fetch 
Fix bug in zero-copy replication disk choice during fetch
 2023-03-01 15:55:00 +01:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
Kseniia Sumarokova
b9bb7bcce3
Update test.py 2023-03-01 13:14:53 +01:00
Kseniia Sumarokova
adf2d56a2d
Update test.py 2023-03-01 12:35:01 +01:00
AVMusorin
99329d8682 Improve tests for Distributed INSERT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-28 23:17:37 +01:00
Antonio Andelic
6e28406751 Merge branch 'master' into fix-data-size 2023-02-28 20:09:29 +00:00
pufit
29296cb004
Merge pull request #46550 from ClickHouse/46231-systerm-server-settings 
Implement `system.server_settings`
 2023-02-28 11:23:15 -05:00
robot-clickhouse
38d026ca6e Automatic style fix 2023-02-28 14:29:24 +00:00
Antonio Andelic
919122948f More fixes and add tests 2023-02-28 14:22:44 +00:00
robot-clickhouse
82be8eb468 Automatic style fix 2023-02-28 13:56:14 +00:00
kssenii
ef58249115 Fix 2023-02-28 14:52:11 +01:00
alesapin
bb7571427b Fix bug in zero-copy replica disk choice during fetch 2023-02-28 14:48:46 +01:00
kssenii
de81a5f92d Fix integration tests 2023-02-28 13:36:52 +01:00
robot-clickhouse
979c62af4f Automatic style fix 2023-02-28 11:24:39 +00:00
alesapin
967a47d870 Fix bug with readonly storages 2023-02-28 12:17:43 +01:00
kssenii
f43e00c3ca Add order by to test to fix flakyness 2023-02-28 11:32:33 +01:00
kssenii
69cdf401a4 Add test for materialized view with materialized postgresql 2023-02-27 22:29:16 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
kssenii
03c9eeb106 Fix tests 2023-02-27 14:29:20 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
avogar
0ef83b10ce Fix style 2023-02-27 13:01:07 +00:00
alesapin
e3961c118a
Revert "Revert "Fix several RENAME COLUMN bugs."" 2023-02-27 12:27:57 +01:00
zk_kiger
4f05eeeff9
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-02-27 17:15:02 +08:00
robot-clickhouse
5f7220e498 Automatic style fix 2023-02-26 18:15:55 +00:00
Smita Kulkarni
4c5d39725c Updated node to check BACKUP_CREATED to node1 in test_concurrent_backups_on_different_nodes 2023-02-26 19:08:26 +01:00
Smita Kulkarni
10c92b6cb0 Increased ddl timeout during DROP of table and updated node for concurrent backups on different node 2023-02-26 19:06:31 +01:00
Alexey Milovidov
9ac48dddb8
Merge pull request #46888 from vitlibar/fix-test_async_backups_to_same_destination 
Fix test test_async_backups_to_same_destination.
 2023-02-26 11:36:18 +03:00
Robert Schulze
5e68d50b39
Merge pull request #46752 from ClickHouse/rs/periods-in-kafka-topics 
Allow configuration of Kafka topics with periods
 2023-02-26 07:49:28 +01:00
Alexey Milovidov
8f40bbd5b4
Revert "Fix several RENAME COLUMN bugs." 2023-02-26 05:47:05 +03:00
Alexey Milovidov
936f57e7b2
Merge pull request #46887 from ClickHouse/fix-flaky-test-12 
Fix flaky `test_concurrent_queries_restriction_by_query_kind`
 2023-02-26 04:30:51 +03:00
Alexey Milovidov
eb89ab471f
Merge pull request #45911 from ClickHouse/mutations_rename_hang 
Fix several `RENAME COLUMN` bugs.
 2023-02-26 01:56:40 +03:00
Alexey Milovidov
656af55831
Merge pull request #46384 from ClickHouse/fixes_for_993 
Fixes for 993
 2023-02-26 01:55:20 +03:00
Vitaly Baranov
2d38c89e2a Fix test test_async_backups_to_same_destination. 2023-02-25 23:38:40 +01:00
Alexey Milovidov
88704c4d9f Fix flaky test_concurrent_queries_restriction_by_query_kind 2023-02-25 22:23:29 +01:00
Robert Schulze
fbba9e319d
Merge branch 'master' into rs/periods-in-kafka-topics 2023-02-25 21:45:20 +01:00
SmitaRKulkarni
4109fbd7cf
Merge pull request #46517 from azat/tests/fix-backup-restore-flakiness 
Fix flakiness of test_backup_restore_on_cluster/test_disallow_concurrency
 2023-02-25 19:54:21 +01:00
Alexander Tokmakov
cad1e0b768 fix 2023-02-25 01:18:34 +01:00
kssenii
6224ca9cd6 Fix 2023-02-24 17:08:05 +01:00
kssenii
357ffcb61f More review fixes 2023-02-24 16:53:16 +01:00
kssenii
8b40723fed Better fix 2023-02-24 16:19:36 +01:00
kssenii
f2a9109fe1 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-24 15:20:46 +01:00
kssenii
0555ca2724 Review fixes 2023-02-24 14:44:47 +01:00
Yatsishin Ilya
76e7e15f67 black and tty 2023-02-24 13:36:43 +00:00
avogar
c6a30d23aa Add separate test 2023-02-24 12:31:09 +00:00
Kruglov Pavel
2150b836b1
Merge branch 'master' into fix-kafka-protobuf 2023-02-24 12:48:07 +01:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Alexander Tokmakov
f76c42348b
Merge pull request #46402 from lzydmxy/apply_move_partition_to_all_replicas 
Apply `ALTER TABLE ON CLUSTER MOVE PARTITION TO DISK|VOLUME` to all replicas.
 2023-02-23 19:42:54 +03:00
Kruglov Pavel
bda1ce7367
Update test.py 2023-02-23 14:47:29 +01:00
Kseniia Sumarokova
7e064ccbd4
Merge pull request #46667 from kssenii/hide-named-collections-under-setting 
Allow to hide only values from system.named_collections while making collection visible
 2023-02-23 11:44:50 +01:00
Kseniia Sumarokova
30a8eb0c2f
Merge pull request #46670 from kssenii/hide-disk-setting 
Hide arguments of custom disk merge tree setting
 2023-02-23 11:42:53 +01:00
kigerzhang
af5a8ce74c style check 2023-02-23 17:18:56 +08:00
kigerzhang
f74f3718a0 add skip_unavailable_shards setting for table function cluste 2023-02-23 17:05:51 +08:00
Alexey Milovidov
0db943e596
Merge pull request #46687 from ClickHouse/tavplubix-patch-5 
Disable flaky test_ttl_move_memory_usage.py
 2023-02-23 10:27:25 +03:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods 
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
 2023-02-22 20:35:09 +00:00
Alexander Gololobov
b0427c2e3c
Merge pull request #46660 from ClickHouse/fix_backup_test 
Fix integration test: terminate old version without wait
 2023-02-22 15:20:26 +01:00
Antonio Andelic
7f5fb77ed5
Increase table retries in cluster copier tests (#46590) 2023-02-22 15:09:48 +01:00
Yatsishin Ilya
80857638c1 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-22 13:58:17 +00:00
kssenii
c4761d6cc6 Fix checks 2023-02-22 14:27:43 +01:00
kssenii
f0ca3ef207 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-22 14:02:29 +01:00
Alexander Tokmakov
fba2ec30a2 fix style check 2023-02-22 13:53:43 +01:00
lzydmxy
ec8b6c5590 add __init__.py for integration test test_move_partition_to_disk_on_cluster 2023-02-22 19:57:56 +08:00
kssenii
ceff5f41d1 Fix tests 2023-02-22 12:27:07 +01:00
Dmitry Novik
67469ad46b
Merge pull request #46622 from ClickHouse/async-insert-memory-fix 
Fix MemoryTracker counters for async inserts
 2023-02-22 12:27:05 +01:00
Kseniia Sumarokova
3f0d93d6e6
Merge pull request #46656 from ClickHouse/kssenii-patch-6 
Update postgres_utility.py
 2023-02-22 11:35:03 +01:00
Alexander Tokmakov
c009c2f4cb
Update test_ttl_move_memory_usage.py 2023-02-22 00:50:21 +03:00
kssenii
08b0e3c630 Fix style check 2023-02-21 18:27:37 +01:00
kssenii
9a7c71b78e Allow to hide only values from system.named_collections 2023-02-21 18:07:57 +01:00
Igor Nikonov
bf05082984
Merge branch 'master' into keeper-retries-by-default 2023-02-21 17:59:55 +01:00
robot-clickhouse
af677c7dcd Automatic style fix 2023-02-21 16:08:13 +00:00
alesapin
1d4352d82a Fix integration test: terminate old version without wait 2023-02-21 17:01:19 +01:00
Kruglov Pavel
341a776617
Disable test 2023-02-21 16:41:05 +01:00
Kseniia Sumarokova
3df7a10ac7
Update postgres_utility.py 2023-02-21 16:25:11 +01:00
Kseniia Sumarokova
655e7f29f7
Merge pull request #46595 from kssenii/update-rabbit-producer 
Fix rabbitmq test
 2023-02-21 16:18:55 +01:00
Kseniia Sumarokova
a45480c11e
Merge pull request #46596 from ClickHouse/kssenii-patch-7 
Fix meilisearch test flakyness
 2023-02-21 14:23:07 +01:00
Kseniia Sumarokova
09a979f106
Merge branch 'master' into update-rabbit-producer 2023-02-21 11:50:30 +01:00
robot-clickhouse
93aabf8c66 Automatic style fix 2023-02-21 02:06:16 +00:00
Dmitry Novik
573ce50403 Fix test 2023-02-21 01:44:10 +00:00
Dmitry Novik
16a9ac9118 Try to add test 2023-02-21 00:52:54 +00:00
robot-clickhouse
abeb1c5ba8 Automatic style fix 2023-02-20 23:49:25 +00:00
Alexey Milovidov
4a2bd6e0aa Adapt a test 2023-02-21 00:43:10 +01:00
Alexey Milovidov
dc4b52e54e Adapt a test 2023-02-21 00:41:40 +01:00
Alexey Milovidov
40d11ce422 Adapt a test 2023-02-21 00:39:32 +01:00
Kruglov Pavel
828a06b511
Merge branch 'master' into fix-kafka-protobuf 2023-02-20 21:45:43 +01:00
Kseniia Sumarokova
47604ad77e
Merge pull request #46106 from kssenii/return-materialized-postrgesql-tests-back 
Enable disabled MaterializedPostgreSQL tests back in CI
 2023-02-20 19:04:58 +01:00
kssenii
0a36398847 Update test 2023-02-20 16:53:06 +01:00
Kseniia Sumarokova
0d9a541441
Update test.py 2023-02-20 16:43:10 +01:00
kssenii
80a0aa1327 Merge remote-tracking branch 'upstream/master' into return-materialized-postrgesql-tests-back 2023-02-20 14:37:39 +01:00
kssenii
591510c20e Uodate test 2023-02-20 14:36:53 +01:00
Kseniia Sumarokova
514e3cbf90
Update test.py 2023-02-20 14:29:04 +01:00
kssenii
361678ad73 rabbitmq-test-fix 2023-02-20 14:16:40 +01:00
lzydmxy
ccf87a6afd add integration test for move partition to disk on cluster 2023-02-20 16:52:55 +08:00
Azat Khuzhin
0859bbb08b Compress tar archives with zstd in intergration tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 21:54:38 +01:00
pufit
5b10fafbb0 Additional tests 2023-02-18 13:45:33 -05:00
Alexey Milovidov
f073cd470f
Merge pull request #46478 from ClickHouse/fix_test_store_cleanup 
Fix some flaky integration tests
 2023-02-18 17:33:02 +03:00
Kseniia Sumarokova
b0ea047e76
Merge pull request #46533 from kssenii/fix-disk-setting 
Allow `disk` merge tree setting in query to override config merge tree setting `storage_policy`
 2023-02-18 12:36:54 +01:00
kssenii
ee7eb8a7dc Fix test 2023-02-18 12:28:55 +01:00
Azat Khuzhin
fb35a6852e More flakiness fiexes for test_backup_restore_on_cluster/test_disallow_concurrency 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 11:13:32 +01:00
kssenii
30748eace8 Fix black check 2023-02-17 21:02:16 +01:00
kssenii
afb36dd120 Allow disk setting to override storage_policy from config merge tree settings insteaf of exception 2023-02-17 17:11:29 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
flynn
ebd88aab41
Merge branch 'master' into iceberg 2023-02-17 21:53:29 +08:00
Alexander Tokmakov
fb3574d2cf Merge branch 'master' into fix_test_store_cleanup 2023-02-17 13:59:22 +01:00
kssenii
729c4b74d1 Fix black check 2023-02-17 13:47:45 +01:00
Mikhail f. Shiryaev
3edfb62066
Rollback unnecessary sync because of checking exit code 2023-02-17 12:28:04 +01:00
Alexander Tokmakov
9a664efeb6
Merge branch 'master' into fixes_for_993 2023-02-17 14:17:08 +03:00
Azat Khuzhin
1a352b9021 Fix flakiness of test_backup_restore_on_cluster/test_disallow_concurrency 
The problem is that if you will run first
test_concurrent_restores_on_different_node and after
test_concurrent_restores_on_same_node, like in [1], the first one will
leave the RESTORE and the second will fail.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45282/5af2967f65c3293b277872a002cb5d570200c008/integration_tests__asan__[3/6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-17 10:21:52 +01:00
Antonio Andelic
4e6587b34b
Merge pull request #46488 from ClickHouse/Avogar-patch-1 
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference
 2023-02-17 10:19:18 +01:00
Dmitry Novik
0336f0d8cc
Merge branch 'master' into background-memory-tracker 2023-02-16 20:57:44 +01:00
Alexey Milovidov
993a39e2a1
Merge pull request #46360 from genzgd/http_client_version 
Allow to provide the protocol version by HTTP clients to tune the compatibility of the Native output format.
 2023-02-16 22:17:04 +03:00
kssenii
417052e4b2 Fix remaining tests 2023-02-16 18:56:19 +01:00
kssenii
75d62ee24a Remove support of feature which does not work reliably 2023-02-16 16:41:31 +01:00
Kruglov Pavel
0ed6ddd7ab
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference 2023-02-16 16:28:47 +01:00
Alexander Tokmakov
cc4932aa35 disable flaky test with cassandra dictionaries 2023-02-16 15:11:34 +01:00
robot-clickhouse
a96d6af17e Automatic style fix 2023-02-16 13:37:40 +00:00
Alexander Tokmakov
86d177e0ee fix flaky test 2023-02-16 14:19:55 +01:00
Dmitry Novik
728434821a Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-02-16 12:35:07 +00:00
kssenii
0954a57a6a Enable back 2023-02-16 13:27:58 +01:00
Alexander Tokmakov
ac62356477 fix 2023-02-16 13:05:13 +01:00
Kseniia Sumarokova
4303ee9114
Merge pull request #46404 from kssenii/fix-rabbit-test-4 
Fix test test_rabbitmq_overloaded_insert
 2023-02-16 11:28:18 +01:00
Vitaly Baranov
7dabd18e8d
Merge pull request #46449 from vitlibar/fix-backup-tests 
Fix a backup test
 2023-02-16 10:55:01 +01:00
flynn
ecc39978d7 fix conflict 2023-02-16 02:23:55 +00:00
Dmitry Novik
718ccace80 Update test 2023-02-15 19:08:17 +00:00
Dmitry Novik
e7a94a28ee
Merge branch 'master' into background-memory-tracker 2023-02-15 19:39:28 +01:00
Vitaly Baranov
4a3ad7da85 Fix test test_backup_restore_new/test.py::test_async_backups_to_same_destination[http]. 2023-02-15 17:27:05 +01:00
robot-clickhouse
69463f852e Automatic style fix 2023-02-15 15:44:19 +00:00
Alexander Tokmakov
885f14311c fix 2023-02-15 16:37:44 +01:00
Kruglov Pavel
4f380370a9
Fix s3Cluster schema inference in parallel distributed insert select (#46381) 
* Fix s3Cluster schema inference in parallel distributed insert select
* Try fix flaky test
* Try SYSTEM SYNC REPLICA to avoid test flakiness
 2023-02-15 15:30:43 +01:00
Geoff Genz
33037334a5 Add raw content option to http helper methods 2023-02-15 07:17:28 -07:00
Kruglov Pavel
e56dead5aa
Merge branch 'master' into fix-kafka-protobuf 2023-02-15 15:16:25 +01:00
Nikolay Degterinsky
3075656e1d Merge remote-tracking branch 'upstream/master' into HEAD 2023-02-15 10:06:44 +00:00
Antonio Andelic
4dd4aac125
Merge branch 'master' into custom-key-parallel-replicas 2023-02-15 11:02:37 +01:00
Geoff Genz
fb90c57918 Fix black quotes 2023-02-14 18:44:41 -07:00
Geoff Genz
143806d8ed Fix black quotes 2023-02-14 18:36:17 -07:00
Alexander Tokmakov
ff5023049b
Update test.py 2023-02-15 02:17:02 +03:00
Geoff Genz
f3bcf26959
Merge branch 'ClickHouse:master' into http_client_version 2023-02-14 09:31:29 -07:00
Geoff Genz
5652625ef3 Add http client_protocol_version test 2023-02-14 09:30:13 -07:00
Vladimir C
726fb4bebc
Merge pull request #46368 from ClickHouse/vdimir/bugfix-validate-fix 2023-02-14 14:54:07 +01:00
flynn
e05b4e9745 fix conflict 2023-02-14 13:49:28 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
kssenii
bead024ecb Fix test 2023-02-14 12:45:57 +01:00
vdimir
19b5d21e8b
Minor fix in files locating for Bugfix validate check 2023-02-14 12:31:10 +01:00
Kseniia Sumarokova
1ed4d20e1c
Update test.py 2023-02-14 12:25:27 +01:00
Kseniia Sumarokova
810348a613
Merge pull request #46340 from ClickHouse/kssenii-patch-6 
Update cluster.py
 2023-02-14 11:43:58 +01:00
robot-clickhouse
dce8dca4e5 Automatic style fix 2023-02-13 23:53:15 +00:00
Alexander Tokmakov
e712fbecb2 fix race between drop and create 2023-02-14 00:45:28 +01:00
Nikolai Kochetov
1c0c662fe1
Merge pull request #46275 from ClickHouse/less-mem-usage-for-vertical-merge 
Less memory usage for vertical merge (non-remote disk)
 2023-02-13 21:10:43 +01:00
Kseniia Sumarokova
3977643b52
Update cluster.py 2023-02-13 13:42:21 +01:00
Kruglov Pavel
e139070043
Merge branch 'master' into fix-kafka-protobuf 2023-02-13 12:38:18 +01:00
Ilya Golshtein
f937dc3500 secure in named collections - test.py reformatted by black 2023-02-13 14:10:56 +03:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
Dan Roscigno
5dd6f25d5d
Merge pull request #46276 from ClickHouse/document-log-compression 
docs for logger stream_compression
 2023-02-12 21:55:33 -05:00
alesapin
1683cd5d6f
Merge branch 'master' into mutations_rename_hang 2023-02-12 13:06:48 +01:00
Alexey Milovidov
395d6b6bd5
Merge pull request #46282 from CurtizJ/return-back-vertical-merges 
Allow vertical merges from compact to wide parts [2]
 2023-02-12 05:51:12 +03:00
Alexey Milovidov
732a030036
Merge pull request #46288 from azat/tests/simplify-attach-from-s3 
Simplify ATTACH MergeTree table FROM S3 in tests
 2023-02-12 05:31:24 +03:00
kssenii
7beb843650 Fix 2023-02-11 19:57:41 +01:00
Kseniia Sumarokova
ed6f623f3a
Merge pull request #46168 from kssenii/resubmit-prefetches 
Allow to increase prefetching of data for reads
 2023-02-11 16:22:47 +01:00
Kruglov Pavel
e84baa9106
Merge pull request #43179 from tonickkozlov/tonickkozlov/add-interserver-dns-retries 
CLICKHOUSE-2375 Add interserver DNS retries
 2023-02-11 14:35:40 +01:00
kssenii
7e0a98cbf1 Add test 2023-02-11 12:36:25 +01:00
alesapin
5c83ddabf9 Merge branch 'master' into mutations_rename_hang 2023-02-11 12:18:58 +01:00
kssenii
3067c1d723 Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
Azat Khuzhin
67b47fe871 Simplify ATTACH MergeTree table FROM S3 in tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-11 08:46:05 +01:00
Kruglov Pavel
cf14282d79
Fix style 2023-02-11 01:45:28 +01:00
Kruglov Pavel
825a5dd806
Try prevent flaky test 2023-02-10 23:12:32 +01:00
Kseniia Sumarokova
3be36c7979
Merge pull request #41976 from kssenii/allow-single-disk-instead-of-storage-policy 
Allow configuring storage as `SETTINGS disk='<disk_name>'` (instead of `storage_policy`) and explicit disk creation `SETTINGS disk=disk(<disk_configuration>)`
 2023-02-10 21:38:50 +01:00
Kruglov Pavel
8bbf62508f
Merge branch 'master' into fix-kafka-protobuf 2023-02-10 18:32:25 +01:00
Anton Popov
1205932a19 add setting to disable vertical merges from compact parts 2023-02-10 16:33:46 +00:00
Antonio Andelic
9e11f06e79
Merge pull request #46191 from ClickHouse/s3-reorder-creds 
Prefer explicitly defined credentials for S3
 2023-02-10 16:35:54 +01:00
Sema Checherinda
4827c70b5e
Merge pull request #46233 from ClickHouse/CheSema-patch-1 
increase a time gap between insert and ttl move
 2023-02-10 15:36:56 +01:00
DanRoscigno
043c1b7d8d docs for logger stream_compression 2023-02-10 09:02:54 -05:00
robot-clickhouse
fa424ae8eb Automatic style fix 2023-02-10 14:01:19 +00:00
Nikolai Kochetov
367136697d Added tests. 2023-02-10 13:51:02 +00:00
Ilya Golshtein
3b72b3f13b secure in named collection - switched to specific_args, tests added 2023-02-10 13:42:11 +03:00
flynn
37a850bd36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into iceberg 2023-02-10 08:47:14 +00:00
flynn
db15634a01 fix conflict 2023-02-10 08:41:04 +00:00
Alexander Tokmakov
e5f8a44b87
Merge pull request #46243 from ClickHouse/tavplubix-patch-7 
Fix test_distributed_ddl_parallel
 2023-02-09 22:15:08 +03:00
Alexander Tokmakov
f7c7c9be31
Update test.py 2023-02-09 20:37:47 +03:00
Alexander Tokmakov
e2be729aea
Update test.py 2023-02-09 20:27:24 +03:00
kssenii
9e04e57949 Allow to give access only to certain named collections 2023-02-09 17:22:57 +01:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Sema Checherinda
ffc97908ef
increase a time gap between insert and ttl move 2023-02-09 15:12:21 +01:00
Kruglov Pavel
947923321c
Fix style 2023-02-09 14:55:21 +01:00
Kruglov Pavel
59c52c503d
Fix style 2023-02-09 14:09:46 +01:00
Kruglov Pavel
8821074f83
Fix style 2023-02-09 14:08:24 +01:00
Vitaly Baranov
39bacfb9dc
Merge branch 'master' into allow-single-disk-instead-of-storage-policy 2023-02-09 13:16:55 +01:00
Kruglov Pavel
c3c0356fdd
Merge branch 'master' into fix-kafka-protobuf 2023-02-09 13:04:55 +01:00
alesapin
0a82385413 Blind fix for trash test 2023-02-09 12:23:18 +01:00
robot-clickhouse
2f9ad860bd Automatic style fix 2023-02-09 08:26:36 +00:00
Antonio Andelic
ae731b739a Prefer explicitly defined creds for S3 2023-02-09 08:13:16 +00:00
pufit
7cf71d1f82
Merge pull request #46144 from ClickHouse/46131-fix-config-attributes-merge 
Fix config merge for XML attributes.
 2023-02-08 23:28:13 -05:00
Alexander Tokmakov
4fd4058259
Merge pull request #45629 from arthurpassos/fix_cares_crash 
Cancel c-ares failed requests and retry on system interrupts to prevent callbacks with dangling references and premature resolution failures
 2023-02-09 02:29:29 +03:00
Alexander Tokmakov
65cbb0fcfc
Merge pull request #46138 from vitlibar/fix-dependency-checks 
Fix dependency checks
 2023-02-09 00:54:40 +03:00
alesapin
00686ae03b Fix tests again 2023-02-08 22:34:09 +01:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
alesapin
5f33aaf59b Fix three leftovers 2023-02-08 16:31:37 +01:00
Yatsishin Ilya
c5103ae469 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-08 14:09:34 +00:00
robot-clickhouse
f81f0b351f Automatic style fix 2023-02-08 13:58:55 +00:00
alesapin
a28d10a810 Fxi 2023-02-08 14:50:30 +01:00
Kseniia Sumarokova
f6ebe11350
Merge pull request #46108 from azat/azure-fix 
Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test
 2023-02-08 12:04:46 +01:00
Alexey Milovidov
5145beb033
Merge branch 'master' into 46131-fix-config-attributes-merge 2023-02-08 10:42:54 +03:00
Alexey Milovidov
da22a770a0
Merge pull request #46107 from kssenii/rabbit-test-overloaded-insert-fix 
Fix flaky rabbitmq test
 2023-02-08 04:14:03 +03:00
robot-clickhouse
6fda4902d8 Automatic style fix 2023-02-07 23:57:14 +00:00
pufit
982f588f71 \n before EOF 2023-02-07 23:50:57 +00:00
pufit
c066c0dfdb Fix config merge for an attributes 2023-02-07 23:46:13 +00:00
Vitaly Baranov
3db9d58fcf Added test. 2023-02-07 23:46:48 +01:00
Kseniia Sumarokova
a5d3b00699
Merge pull request #46010 from kssenii/named-collections-fix-access 
Fix named collections access
 2023-02-07 23:20:22 +01:00
robot-clickhouse
0d28a8e6a8 Automatic style fix 2023-02-07 18:45:17 +00:00
Dmitry Novik
9c74443783 Trying to add a test 2023-02-07 18:38:26 +00:00
Yatsishin Ilya
1baa15d603 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-07 15:46:59 +00:00
Yatsishin Ilya
ff4e10fdd4 print what is running when can't stop clickhouse 2023-02-07 15:46:55 +00:00
kssenii
022d4308ce Address review comments 2023-02-07 13:01:55 +01:00
Azat Khuzhin
bca85c6852 Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test 
Here is an example of an error [1]:

    2023.02.06 21:59:09.076849 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Starting up disk blob_storage_disk
    2023.02.06 21:59:09.076897 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Disk blob_storage_disk started up
    2023.02.06 21:59:09.077263 [ 200 ] {} <Trace> StoragePolicy (blob_storage_policy): Storage policy blob_storage_policy created, total volumes 1
    2023.02.06 21:59:09.077318 [ 200 ] {} <Information> StoragePolicySelector: Storage policy `blob_storage_policy` loaded
    ...
    2023.02.06 21:59:09.227326 [ 1 ] {} <Error> Application: std::exception. Code: 1001, type: Azure::Storage::StorageException, e.what() = 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384, Stack trace (when copying this message, always include the lines below):

    0. ./build_docker/../contrib/llvm-project/libcxx/include/exception:134: std::runtime_error::runtime_error() @ 0x44297b8d in /usr/bin/clickhouse
    ...
    5. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::getAzureBlobContainerClient() @ 0x2f5b225f in /usr/bin/clickhouse
    6. ./build_docker/../src/Disks/ObjectStorages/AzureBlobStorage/registerDiskAzureBlobStorage.cpp:0:
    10. ./build_docker/../src/Interpreters/Context.cpp:0: DB::Context::getDisksMap() const @ 0x2f95af47 in /usr/bin/clickhouse
    ...
    13. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::AsynchronousMetrics::start() @ 0x1f4d6161 in /usr/bin/clickhouse
    14. ./build_docker/../programs/server/Server.cpp:0: DB::Server::main() @ 0x1f3a5bfb in /usr/bin/clickhouse
    15. ./build_docker/../contrib/poco/Util/src/Application.cpp:0: Poco::Util::Application::run() @ 0x3c7546bf in /usr/bin/clickhouse
    16. ./build_docker/../programs/server/Server.cpp:476: DB::Server::run() @ 0x1f381f7b in /usr/bin/clickhouse
    17. ./build_docker/../contrib/poco/Util/src/ServerApplication.cpp:612: Poco::Util::ServerApplication::run(int, char**) @ 0x3c797ee0 in /usr/bin/clickhouse
    18. ./build_docker/../programs/server/Server.cpp:0: mainEntryClickHouseServer(int, char**) @ 0x1f37a262 in /usr/bin/clickhouse
    19. ./build_docker/../programs/main.cpp:0: main @ 0xe9d21ae in /usr/bin/clickhouse
    20. __libc_start_main @ 0x7f58271a1083 in ?
    21. _start @ 0xe90ef6e in /usr/bin/clickhouse
     (version 23.2.1.1)
    2023.02.06 21:59:09.227971 [ 1 ] {} <Error> Application: 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/46045/bd4170e03c6af583a51d12d2c39fa775dcb9997b/integration_tests__asan__[6/6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-07 12:52:36 +01:00
kssenii
427f2d0257 Try fix rabbit test 2023-02-07 12:36:25 +01:00
Antonio Andelic
9cde46acff Correctly calculate size on update 2023-02-06 16:28:05 +00:00
robot-clickhouse
7aeacabe2f Automatic style fix 2023-02-06 13:20:15 +00:00
Kseniia Sumarokova
d52420c548
Update test.py 2023-02-06 14:10:33 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
kssenii
631c460c96 Add forgitten config file 2023-02-06 11:35:30 +01:00
Antonio Andelic
61ddae6c2f
Merge pull request #46041 from azat/ci/improve-integration-sanitizer-report 
Dump sanitizer errors in the integration tests logs
 2023-02-06 09:42:26 +01:00
flynn
0dd8a61a8e fix conflict 2023-02-06 03:25:12 +00:00
kssenii
9937e73fa9 Fix integration test 2023-02-05 22:38:07 +01:00
kssenii
3042e9ee6e Fix integration test 2023-02-05 13:39:13 +01:00
robot-clickhouse
fb288ad5f7 Automatic style fix 2023-02-05 11:58:51 +00:00
Kseniia Sumarokova
7a11b37dae
Update test.py 2023-02-05 12:54:03 +01:00
kssenii
84ea48b555 Merge remote-tracking branch 'origin/named-collections-fix-access' into named-collections-fix-access 2023-02-04 23:32:56 +01:00
kssenii
cb4757fc43 Fix tests 2023-02-04 22:54:49 +01:00
Azat Khuzhin
0a598c79f4 Remove misleading information that sanitizer errors are in the docker.log 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-04 11:23:26 +01:00
Azat Khuzhin
88dc85e13e Dump sanitizer errors in the integration tests logs 
Previously you need to download the artifacts (0.5G+-), or reproduce the
problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-04 11:23:26 +01:00
Antonio Andelic
8929838fcc Merge branch 'master' into add-support-for-settings-alias 2023-02-03 17:47:00 +00:00
Vitaly Baranov
45d2d678ab
Merge pull request #45800 from vitlibar/rename-new-columns-in-system-backups 
Rename new columns in system.backups
 2023-02-03 14:00:16 +01:00
kssenii
486c10bde1 Fix named collections access 2023-02-03 13:18:54 +01:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush 
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
 2023-02-03 11:50:12 +01:00
Alexey Milovidov
108d1c3442
Merge pull request #45872 from ClickHouse/fix-trash-query-kind 
Remove trash, add a feature and fix a bug
 2023-02-03 09:58:43 +03:00
kssenii
a391de18a1 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-02-02 20:49:41 +01:00
kssenii
b72810a608 Fix tests 2023-02-02 20:16:53 +01:00
Arthur Passos
108071f052 fix style 2023-02-02 13:42:17 -03:00
Arthur Passos
6e466e3a19 fix style 2023-02-02 13:28:50 -03:00
Kseniia Sumarokova
6705fafef9
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-02-02 16:06:51 +01:00
Arthur Passos
eda8ab78c2 fix integ tests 2023-02-02 11:30:16 -03:00
attack204
7ed6bad097
Merge branch 'master' into urlCluster 2023-02-02 21:12:20 +08:00
Antonio Andelic
f613bfd8d2 Merge branch 'master' into add-support-for-settings-alias 2023-02-02 11:15:39 +00:00
kssenii
d85ad3c219 Fix tests 2023-02-02 12:15:29 +01:00
Vitaly Baranov
b8078acce2
Merge pull request #45774 from vitlibar/wiping-sensitive-info-in-named-collection-overrides 
Mask sensitive info in named collection's overrides
 2023-02-02 10:06:59 +01:00
Alexey Milovidov
11e89d9aa0 Add a test 2023-02-02 04:40:45 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Arthur Passos
3d9b464758 add missing comma :) 2023-02-01 09:52:06 -03:00
Arthur Passos
e4545e1267 rename reverse_dns_config file 2023-02-01 09:37:39 -03:00
Arthur Passos
70f700941a add missing allow_reverse_dns_function 2023-02-01 08:48:46 -03:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster 
Support DELETE ON CLUSTER
 2023-02-01 10:52:01 +01:00
Antonio Andelic
ec04cf6876 Merge branch 'master' into add-support-for-settings-alias 2023-02-01 09:01:01 +00:00
Vitaly Baranov
96b140cc95 Rename columns in system.backups: num_files, num_processed_files, processed_files_size 
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
 2023-01-31 22:45:41 +01:00
kssenii
2f5842a749 Update tests 2023-01-31 20:25:08 +01:00
kssenii
4a1bdcf24c Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-31 18:11:26 +01:00
robot-clickhouse
a32818a32e Automatic style fix 2023-01-31 14:35:08 +00:00
Alexander Gololobov
51fdcb7ffd Test DELETE FROM on replicated database 2023-01-31 15:20:21 +01:00
Arthur Passos
58e4e35f0d remove unnecessary file mapping 2023-01-31 09:10:45 -03:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Kseniia Sumarokova
7d53f8bbf6
Merge pull request #45591 from bharatnc/ncb/odbc-connection-pool-fixes 
fixes to use the odbc_bridge_use_connection_pooling setting correctly
 2023-01-31 11:31:59 +01:00
flynn
ffddc0dcce fix conflict 2023-01-31 10:28:58 +00:00
Alexander Gololobov
f9133f3d85
Merge pull request #45791 from ClickHouse/fix_drop_hung 
Fix bug in tables drop which can lead to potential query hung
 2023-01-31 10:11:11 +01:00
Bharat Nallan
f1d6e3b908
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-30 15:49:04 -08:00
Vitaly Baranov
48023a297f Add missed test config. 2023-01-30 21:47:30 +01:00
alesapin
0908ce8e14 Add timeout 2023-01-30 17:02:58 +01:00
alesapin
be58d5d1af Fix bug in tables drop which can lead to potential query hung 2023-01-30 17:00:28 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Pradeep Chhetri
deaa70fb14
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 21:35:16 +08:00
Vitaly Baranov
6ee9971931 Mask sensitive info in named collection's overrides. 2023-01-30 11:33:21 +01:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files 
Added num_processed_files and processed_files_size for backup and restore processes
 2023-01-30 09:24:49 +01:00
Arthur Passos
0e7b35c9f4 fix black 2023-01-29 13:19:03 -03:00
Arthur Passos
2a63b86796 fix black 2023-01-29 11:35:04 -03:00
Arthur Passos
6c3a5871ba added integ test 2023-01-29 11:24:47 -03:00
flynn
9b517cdc76 fix conflict 2023-01-29 08:34:56 +00:00
Pradeep Chhetri
9919fb0be9
Merge branch 'master' into pchhetri/fix-45690 2023-01-29 11:35:26 +08:00
Pradeep Chhetri
d52c841d7d Fix test 2023-01-29 11:35:00 +08:00
Pradeep Chhetri
18cf0fd2c1 Fix test 2023-01-29 10:29:10 +08:00
Pradeep Chhetri
65301cf55a Format fixes 2023-01-29 09:03:51 +08:00
Pradeep Chhetri
0e02f82665 Add test for zip archive with bad settings 2023-01-29 08:40:24 +08:00
Azat Khuzhin
3903b442fb tests: fix broken disk emulation in test_jbod_ha 
The problem with chmod 000 is that it is simply ignored for the owner of
the namespace (verified with kprobe for security_capable [1]),
previously it worked only cause there was a check for uid explicitly in
FS::canRead/canWrite.

  [1]: cat-10561   [001]  1340776.172944: security_capable_retprobe: (capable_wrt_inode_uidgid+0x40/0x70 <- security_capable) arg1=0xffffffff

0xffffffff is -1 and it is EPERM

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
Azat Khuzhin
e6695196aa tests/integration: add SYS_ADMIN capability for mount/remount 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
Azat Khuzhin
1e3f33ad4b tests/integration: fix --privileged passthrough 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 21:11:10 +01:00
kssenii
68cab4bc49 Merge remote-tracking branch 'origin/storage-rabbitmq-fix-flush' into storage-rabbitmq-fix-flush 2023-01-27 17:23:05 +01:00
kssenii
f39cd0b392 Update tests 2023-01-27 17:22:24 +01:00
kssenii
9c4a97bbd1 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-27 17:17:09 +01:00
avogar
0a99d421f5 Fix formats parser resetting, test processing bad messages in kafka 2023-01-27 13:22:50 +00:00
robot-clickhouse
9cdc8d7b9d Automatic style fix 2023-01-27 09:46:51 +00:00
Antonio Andelic
defc9108f0 Extend support for aliases to constraints and profiles 2023-01-27 09:39:10 +00:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Bharat Nallan Chakravarthy
70a3ffa0e6 fix test 2023-01-25 06:47:04 -08:00
Vitaly Baranov
9014023625 Fix wiping sensitive info in INSERT INTO FUNCTION. 2023-01-25 14:50:49 +01:00
Vitaly Baranov
32efe92199
Merge pull request #45487 from vitlibar/use-new-copy-s3-functions-in-s3-obj-storage 
Use new copy s3 functions in S3ObjectStorage
 2023-01-25 13:22:04 +01:00
Bharat Nallan
2ef8fcb318
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-24 21:27:20 -08:00
Bharat Nallan Chakravarthy
fc4eba3b7b add a test 2023-01-24 16:56:56 -08:00
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
Antonio Andelic
6da9dc2407 Correctly handle case with missing custom_key 2023-01-24 14:16:26 +00:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
Smita Kulkarni
642f9ca549 Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 09:37:28 +01:00
Alexander Tokmakov
0e0e2f0f67
Update test.py 2023-01-23 19:01:06 +03:00
Aleksandr
2caeed901b
Merge branch 'master' into fix_backup_restore_num_files 2023-01-23 13:43:20 +01:00
Smita Kulkarni
383af7f3a6 Moved settings inside backups section - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-23 08:59:44 +01:00
Anton Popov
f181254fb0 fix race in destructor of ParallelParsingInputFormat 2023-01-23 01:18:58 +00:00
Smita Kulkarni
310ae62d90 Updated backup/restore status when concurrent backups & restores are not allowed 
Implementation:
* Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures.
* Renamed backup_uuid to restore_uuid in RestoreSettings.
Testing:
* Updated test test_backup_and_restore_on_cluster/test_disallow_concurrency to check for specific backup/restore id.
 2023-01-22 19:01:09 +01:00
Antonio Andelic
44ef00dc05 Merge branch 'master' into custom-key-parallel-replicas 2023-01-22 14:20:58 +00:00
Antonio Andelic
3a09415733 Refactor integration test 2023-01-22 14:20:25 +00:00
attack204
bd21424ec5
Merge branch 'master' into master 2023-01-22 07:34:42 +08:00
Vitaly Baranov
5ceb64accc Use new copy s3 functions in S3ObjectStorage. 2023-01-21 15:47:58 +01:00
Vitaly Baranov
f0fda580d0
Merge pull request #45188 from vitlibar/backup-to-s3-memory-optimization 
Optimize memory consumption during backup to S3
 2023-01-21 12:37:35 +01:00
Sema Checherinda
962894afc8
Merge pull request #44909 from CheSema/intersect-prev-part 
Do not merge over a gap with outdated undeleted parts
 2023-01-21 11:51:21 +01:00
attack204
d971e0e75d
Merge branch 'master' into master 2023-01-21 09:34:15 +08:00
Anton Popov
41a199e175
Fix crash when ListObjects request fails (#45371) 2023-01-20 20:10:23 +01:00
Antonio Andelic
2cb106f1f9 Add integration test for custom_key 2023-01-20 12:55:26 +00:00
Maksim Kita
23e26032ca
Merge pull request #45399 from aalexfvk/alexfvk/mdb-21326_fix_system_dictionaries_when_dictionary_with_bad_structure 
Fix select from system.dictionaries when there is dictionary with bad structure
 2023-01-20 13:36:32 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config 
Add <storage_policy> config parameter for system logs
 2023-01-20 10:27:57 +01:00
Aleksandr Musorin
838acb22b7
added num_processed_files and processed_files_size 2023-01-20 10:20:41 +01:00
SmitaRKulkarni
6aa63414db
Merge pull request #45072 from ClickHouse/43891_Disallow_concurrent_backups_and_restores 
Added settings to disallow concurrent backups and restores
 2023-01-20 09:17:20 +01:00
attack204
4e70c5bb78
Merge branch 'master' into master 2023-01-20 15:42:34 +08:00
Aleksei Filatov
42549e89f2 [rev 2] Fix review notes 2023-01-20 09:37:49 +03:00
Kseniia Sumarokova
1452d2588c
Update test.py 2023-01-19 18:06:43 +01:00
Kseniia Sumarokova
f80246644c
Update test.py 2023-01-19 18:04:09 +01:00
Kseniia Sumarokova
db49368f5e
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-01-19 18:03:42 +01:00
Aleksei Filatov
afada0ecb3 Fix review notes 2023-01-19 17:02:57 +03:00
alesapin
ccd41e6d14
Merge pull request #45403 from ClickHouse/fix_test_system_merges 
Reduce an amount of trash in `tests_system_merges`
 2023-01-19 12:00:54 +01:00
SmitaRKulkarni
67e2bf31f5
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 11:21:37 +01:00
attack204
406bd09b40
Merge branch 'master' into master 2023-01-19 17:50:08 +08:00
Ilya Yatsishin
f16328aa8b
Merge pull request #45402 from qoega/simpler-test_replicated_merge_tree_s3_restore 2023-01-19 10:27:42 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
attack204
5d387f27f8 fix:style 2023-01-19 16:49:44 +08:00
SmitaRKulkarni
db03dd1bb9
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 09:32:50 +01:00
attack204
ef0bed7705 add test 2023-01-19 14:19:47 +08:00
robot-clickhouse
33a4222155 Automatic style fix 2023-01-18 15:52:38 +00:00
Alexander Tokmakov
6f8c1424df reduce an amount of trash in tests_system_merges 2023-01-18 16:45:47 +01:00
Yatsishin Ilya
1603e734f9 Make test simpler to see errors not in teardown 2023-01-18 15:36:24 +00:00
Aleksei Filatov
5e9340f682 Add integration test 2023-01-18 17:50:38 +03:00
Vitaly Baranov
7cdb2c4c7f
Merge pull request #45351 from vitlibar/fix-backup-with-killed-mutations 
Fix backup with killed mutations
 2023-01-18 13:14:27 +01:00
Ilya Yatsishin
9b5e7c00d5
Merge pull request #45369 from qoega/improve-failed-kafka-logging 
Improve failed kafka startup logging
 2023-01-18 13:09:48 +01:00
flynn
01ae8f584b fix test 2023-01-18 11:34:52 +00:00
alesapin
a4ff9027ce
Merge branch 'master' into fix_flaky_test_ttl_modify 2023-01-18 12:19:37 +01:00
Antonio Andelic
f57ee043ae
Merge pull request #45319 from ClickHouse/disable-prewhere-in-merge-different-types 
Disable PREWHERE in storage Merge if types don't match
 2023-01-18 10:02:06 +01:00
flynn
2fb32dc56c fix and add test 2023-01-18 08:33:55 +00:00
Ilya Yatsishin
a50c6c0abe
Merge branch 'master' into improve-failed-kafka-logging 2023-01-18 02:39:32 +01:00
robot-clickhouse
237bb15a9f Automatic style fix 2023-01-17 21:34:16 +00:00
Smita Kulkarni
6e06af1b25 Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
Yatsishin Ilya
5ae72fe711 Improve failed kafka startup logging 2023-01-17 16:25:05 +00:00
alesapin
261dc06be9 Fix flaky ttl test 2023-01-17 17:08:32 +01:00
Antonio Andelic
ba363c141a Fix integration test 2023-01-17 13:12:52 +00:00
Vitaly Baranov
8c5c423d67 Add test. 2023-01-17 13:11:24 +01:00
Sema Checherinda
2cd55bc398 fix/adjust tests in integration/test_partition 2023-01-17 12:02:18 +01:00
Vitaly Baranov
14a7ee8e26 Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
Anton Popov
6863cd152f
Merge pull request #42181 from CurtizJ/optimize-loading-parts 
Do not load inactive parts at startup
 2023-01-16 14:38:50 +01:00
Kseniia Sumarokova
75318e4cee
Merge pull request #45180 from kssenii/fix-flacky-test-multiple-disks 
Fix flaky test test_multiple_disks/test.py::test_rename
 2023-01-13 19:05:03 +01:00
Alexander Tokmakov
db91c4a749
Merge pull request #45168 from ClickHouse/tavplubix-patch-1 
Try to fix flaky test_ttl_move_memory_usage
 2023-01-13 15:01:42 +03:00
kssenii
0110b63a95 Better fix 2023-01-13 12:12:27 +01:00
Ilya Yatsishin
94e8c57d0d
Merge pull request #45094 from ClickHouse/try-fix-keeper-map 
Try fixing KeeperMap tests
 2023-01-13 00:46:43 +01:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
Nikolai Kochetov
e21fe952c6
Update test_ttl_move_memory_usage.py 2023-01-12 18:45:19 +01:00
Nikolai Kochetov
1911c25a7b
Merge branch 'master' into tavplubix-patch-1 2023-01-12 18:44:39 +01:00
Antonio Andelic
1f2ec534f4 Add EXISTS clauses 2023-01-12 15:39:04 +00:00
Antonio Andelic
dc4262f338 Merge branch 'master' into try-fix-keeper-map 2023-01-12 15:19:51 +00:00
Antonio Andelic
fb23a399b5
Merge pull request #45213 from ClickHouse/fix-flaky-keeper-test 
Fix flaky `test_keeper_three_nodes_two_alive`
 2023-01-12 14:57:40 +01:00
Yakov Olkhovskiy
344fa16184
Merge pull request #42991 from ClickHouse/tests-connection-error 
add retries on ConnectionError
 2023-01-12 08:32:03 -05:00
Ilya Yatsishin
23c80d77a0
Merge pull request #45206 from ClickHouse/try-fix-overcommit-test 
Disable check to make test_overcommit_tracker not flaky
 2023-01-12 14:16:11 +01:00
alesapin
df8ceeefdc
Merge pull request #45134 from ClickHouse/fix_flaky_azure_test 
Fix flaky azure test
 2023-01-12 13:02:34 +01:00
Nikita Mikhaylov
62d544e742
Fix integration test test_replicated_users::test_rename_replicated (#45192) 
* Done

* Update tests/integration/test_replicated_users/test.py

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-01-12 12:36:36 +01:00
robot-clickhouse
d61e202416 Automatic style fix 2023-01-12 11:35:03 +00:00
Antonio Andelic
feaad2bd43 try avoiding bad file descriptor 2023-01-12 11:28:41 +00:00
Antonio Andelic
97266ccabc Merge branch 'master' into try-fix-keeper-map 2023-01-12 11:16:35 +00:00
Kseniia Sumarokova
56f8899df8
Update tests/integration/test_multiple_disks/test.py 
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
 2023-01-12 12:06:31 +01:00
Antonio Andelic
0fc279e2bb Don't allow third node to become leader 2023-01-12 08:44:55 +00:00
Dmitry Novik
bed39f3762 Disable check to make test on flaky 2023-01-11 23:52:13 +00:00
kssenii
e3a1af6542 Fix flacky test 2023-01-11 23:51:03 +01:00
Ilya Yatsishin
bca117b26d
Merge pull request #45099 from ClickHouse/qoega-patch-4 
Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml
 2023-01-11 23:37:03 +01:00
Nikolai Kochetov
653d18cb8c
Merge pull request #45162 from ClickHouse/disable-test_move_and_s3_memory_usage 
Disable test_ttl_move_memory_usage as too flaky.
 2023-01-11 20:30:28 +01:00
Ilya Yatsishin
cc352804df
Merge pull request #45156 from qoega/green-ci-5 
Fix flaky test_tcp_handler_interserver_listen_host
 2023-01-11 19:09:22 +01:00
Antonio Andelic
2c33c9e62c
Merge branch 'master' into try-fix-keeper-map 2023-01-11 15:05:04 +01:00
Alexander Tokmakov
764abb6410
try to fix flaky test_ttl_move_memory_usage 2023-01-11 15:55:18 +03:00
Nikolai Kochetov
07a3967d6b Disable test_ttl_move_memory_usage as too flaky. 2023-01-11 11:20:02 +00:00
Alexander Tokmakov
b156209ed6
Update test.py 2023-01-11 14:17:44 +03:00
Yatsishin Ilya
77f0724629 Fix flaky test_tcp_handler_interserver_listen_host 2023-01-11 10:28:30 +00:00
robot-clickhouse
6d6e803cfb Automatic style fix 2023-01-11 10:09:43 +01:00
Ilya Yatsishin
f871949d85 Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml 2023-01-11 10:09:43 +01:00
Anton Popov
6c4f53bdca Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-11 01:00:57 +00:00
alesapin
6d86b8dd47 Fix flaky azure test 2023-01-10 19:05:02 +01:00
Antonio Andelic
7d948c9c77
Merge branch 'master' into try-fix-keeper-map 2023-01-10 15:44:28 +01:00
Antonio Andelic
134cc3e273
Change table name 2023-01-10 14:16:28 +01:00
Maksim Kita
d4a2dd43ce
Merge pull request #44891 from azat/tests/rewrite-update_field-test 
Convert integration test_dictionaries_update_field to a stateless
 2023-01-10 15:14:53 +03:00
Antonio Andelic
d7ca0c04fa
remove drop if exists 2023-01-10 11:35:02 +01:00
Antonio Andelic
7aef7d95de Small fixes for keeper_map tests 2023-01-10 09:15:07 +00:00
robot-clickhouse
46b21629ed Automatic style fix 2023-01-09 17:23:02 +00:00
Smita Kulkarni
93530e8d34 Added settings to disallow concurrent backups and restores 
Implementation:
* Added server level settings to disallow concurrent backups and restores, which are read and set when BackupWorker is created in Context.
* Settings are set to true by default.
* Before starting backup or restores, added a check to see if any other backups/restores are running (except internal ones).
Testing:
* Added a test test_backup_and_restore_on_cluster/test_disallow_concurrency.
 2023-01-09 18:14:39 +01:00
Nikita Mikhaylov
857799fbca
Parallel distributed insert select with s3Cluster [3] (#44955) 
* Revert "Revert "Resurrect parallel distributed insert select with s3Cluster (#41535)""

This reverts commit b8d9066004.

* Fix build

* Better

* Fix test

* Automatic style fix

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-01-09 13:30:32 +01:00
Kseniia Sumarokova
9ae5ad202a
Merge pull request #44707 from xiedeyantu/s3-add-config 
S3 support upload object using storage class INTELLIGENT_TIERING
 2023-01-09 13:28:53 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
851e4ae59f Fix typos 2023-01-08 07:08:20 +01:00
Antonio Andelic
c8d9368009 Retry on invalid snapshot 2023-01-07 17:08:25 +00:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
Alexey Milovidov
590ad41cbf
Merge pull request #44978 from azat/tests/fix-test_replicated_users 
tests: fix test_replicated_users flakiness
 2023-01-07 03:51:31 +03:00
Alexey Milovidov
d122d72ea8
Merge pull request #44996 from vitlibar/fix-test_grpc_protocol_progress 
Fix test test_grpc_protocol/test.py::test_progress
 2023-01-07 03:48:30 +03:00
Vitaly Baranov
e8355971bb Fix test test_grpc_protocol/test.py::test_progress 2023-01-06 19:58:20 +01:00
kssenii
dd6a2c2d37 Fix style check 2023-01-06 16:53:24 +01:00
kssenii
2a030c1dc0 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-01-06 15:58:27 +01:00
Vitaly Baranov
92be50bd68 Add test for IMDS session token. 2023-01-06 15:55:26 +01:00
Vitaly Baranov
0d12d90fb5 Move common code to helpers/mock_servers.py 2023-01-06 15:55:21 +01:00
kssenii
c980e16345 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-06 15:51:25 +01:00
Anton Popov
b25f875674
Merge pull request #44875 from ClickHouse/fix-another-one-cannot-read-all-data-for-lc-dict-error 
Fix right offset for reading LowCardinality dictionary from remote fs
 2023-01-06 15:24:36 +01:00
Kseniia Sumarokova
573d3283b0
Merge pull request #44327 from kssenii/use-new-named-collections-code-2 
Replace old named collections code with new (from #43147) part 2
 2023-01-06 13:06:26 +01:00
Nikolai Kochetov
12192ef099
Merge pull request #44938 from ClickHouse/try-fix-test_multiple_disks-test_freeze 
Stop merges to avoid a race between merge and freeze.
 2023-01-06 12:45:10 +01:00
Azat Khuzhin
7859346e40 tests: fix test_replicated_users flakiness 
Alter for users/quotas/... does not wait until all replicas will be up
to date, so use *_with_retries() helperx.

CI: https://s3.amazonaws.com/clickhouse-test-reports/44922/bd885be9229cf47752c5c98392f09129261550f9/integration_tests__tsan__[6/6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-06 12:45:03 +01:00
Azat Khuzhin
c03510cf6b tests/integration: add query_and_get_error_with_retry() helper 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-06 12:45:03 +01:00
Alexey Milovidov
08ebdc9b82
Merge pull request #44903 from ClickHouse/less-flaky-test-concurrent-queries 
Fix flaky `test_concurrent_queries_restriction_by_query_kind`
 2023-01-06 03:18:28 +03:00
robot-clickhouse
62a9b33bbb Automatic style fix 2023-01-05 16:29:58 +00:00
Ilya Yatsishin
a28d6fb490
Merge pull request #44848 from qoega/green-ci-2 
Pre-pulling images for integration tests to detect broken infrastructure earlier
 2023-01-05 17:29:39 +01:00
Nikolai Kochetov
90f3f5789f Speedup a bit. 2023-01-05 16:23:49 +00:00
Nikolai Kochetov
dc5009d401 Stop merges to aviod a race between merge and freeze. 2023-01-05 15:28:56 +00:00
Anton Popov
ed00399eb6 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-05 14:12:02 +00:00
Yatsishin Ilya
1b03a60e43 Do not report status if we failed to pull images. 2023-01-05 13:53:45 +00:00
Ilya Yatsishin
c5f01a653c
Merge pull request #44880 from qoega/green-ci-4 
Rewrite test_postgres_protocol test
 2023-01-05 12:34:33 +01:00
Antonio Andelic
7dd8ac717a
Merge branch 'master' into less-flaky-test-concurrent-queries 2023-01-05 12:23:30 +01:00
Ilya Yatsishin
5d0f3e7819
Merge pull request #44921 from ClickHouse/fix-flaky-test-5 
Fix flaky test `test_lost_part`
 2023-01-05 10:28:07 +01:00
xiedeyantu
dfaa16b7a0 fix 2023-01-05 09:09:42 +08:00
xiedeyantu
110f95bae6 fix 2023-01-05 09:00:53 +08:00
Nikita Mikhaylov
e3ca9fb3e9 Blakc 2023-01-04 20:30:52 +00:00
Nikita Mikhaylov
ea7c338a7b Done 2023-01-04 20:28:03 +00:00
Yatsishin Ilya
ccb6226d22 install CH before test 2023-01-04 20:07:52 +00:00
Yakov Olkhovskiy
dadd96ba6f
Merge pull request #44135 from ClickHouse/feature-protocol-proxy 
Improve support for PROXYv1 protocol.
 2023-01-04 14:06:17 -05:00
Yatsishin Ilya
daf2ccab81 Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 18:27:19 +00:00
xiedeyantu
2f59b1d002 better 2023-01-05 00:27:07 +08:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
Antonio Andelic
8ee589c5c1
Merge pull request #44898 from ClickHouse/try-fix-test-storage-kafka 
Try to fix flaky `test_storage_kafka::test_kafka_produce_key_timestamp`
 2023-01-04 16:54:47 +01:00
Yatsishin Ilya
03582f4b87 move logic to runner 2023-01-04 15:52:34 +00:00
Yatsishin Ilya
9cf599e58b Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 15:49:22 +00:00
Yatsishin Ilya
d8d012523d add pre-pull to runner 2023-01-04 15:47:50 +00:00
alesapin
92255e5d4b
Merge pull request #43020 from vitlibar/update-aws-c-submodules 
Update aws-c* submodules
 2023-01-04 16:25:22 +01:00
Antonio Andelic
1a1afc6a74 Make test_concurrent_queries_restriction_by_query_kind less flaky 2023-01-04 14:18:35 +00:00
Nikita Mikhaylov
e9c7555365
Use TablesDependencyGraph in DatabaseReplicated recovery process (#44697) 2023-01-04 14:49:39 +01:00
Yatsishin Ilya
4d5131ed7d debug quotes 2023-01-04 13:16:31 +00:00
Antonio Andelic
890f094829 Set retention policy for Kafka topic 2023-01-04 12:04:00 +00:00
Yatsishin Ilya
08fbf6e5b2 again 2023-01-04 11:48:28 +00:00
alesapin
c09f83654d
Merge pull request #44533 from ClickHouse/40951_Allow_macro_substitution_in_endpoint 
Allow macro substitution in endpoint of disks
 2023-01-04 12:29:57 +01:00
Azat Khuzhin
0ab0f76737 Convert integration test_dictionaries_update_field to a stateless 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-04 11:05:00 +01:00
Antonio Andelic
9b58c97563 Store ZK generated data in archive 2023-01-04 09:10:16 +00:00
Alexey Milovidov
66e6f53698
Merge pull request #44839 from ClickHouse/move-odbc-test 
Move `test_dies_with_parent` to another module
 2023-01-04 05:17:19 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code 
What if I will remove two lines of code?
 2023-01-04 04:50:52 +03:00
Ilya Yatsishin
49155d9614
Merge pull request #44711 from qoega/green-ci-1 
Improve some integration tests and add pytest-random
 2023-01-03 22:39:54 +01:00
Yatsishin Ilya
bb288c1f14 how many more? 2023-01-03 21:38:59 +00:00
Yatsishin Ilya
bbc02c0762 black 2023-01-03 21:28:54 +00:00
Yatsishin Ilya
14274d650b Rewrite test_postgres_protocol test 2023-01-03 19:30:14 +00:00
Yatsishin Ilya
683df2dea5 fix 2023-01-03 18:56:24 +00:00
Robert Schulze
27f5aad49e
What happens if I remove 156 lines of code? 2023-01-03 18:51:16 +00:00
robot-clickhouse
d6c090b530 Automatic style fix 2023-01-03 18:29:09 +00:00
Nikolai Kochetov
da26f62a9b Fix right offset for reading LowCardinality dictionary from remote fs in case if right mark was in the middle of compressed block. 2023-01-03 18:19:51 +00:00
Alexey Milovidov
a06d03e097
Merge pull request #44851 from qoega/green-ci-3 
No more retries in integration tests
 2023-01-03 19:40:34 +03:00
Yatsishin Ilya
3deada0c29 fix 2023-01-03 16:05:20 +00:00
kssenii
67509aa2d5 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2023-01-03 16:41:30 +01:00
Antonio Andelic
a88171b594 Add timeout for ZK stop 2023-01-03 09:59:06 +00:00
Antonio Andelic
4ccd828a44 Wait for ZK process to stop 2023-01-03 09:39:14 +00:00
Nikita Mikhaylov
b34fc8650c
Merge branch 'master' into move-odbc-test 2023-01-02 21:22:50 +01:00
SmitaRKulkarni
16dd6ca02f
Merge branch 'master' into 40951_Allow_macro_substitution_in_endpoint 2023-01-02 20:34:24 +01:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Ilya Yatsishin
8a9bb9b107 No more retries in integration tests 2023-01-02 18:56:24 +01:00
Yatsishin Ilya
3251d9278c black 2023-01-02 17:44:04 +00:00
Yatsishin Ilya
9ab5cf7d62 Download inside runner 2023-01-02 16:46:24 +00:00
Antonio Andelic
509fd873ec
Try restarting zookeeper if connection failed (#44834) 2023-01-02 16:24:57 +01:00
Yatsishin Ilya
b40f6c0b10 Pre-pull docker image and fail check completely if it failed 2023-01-02 15:04:14 +00:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Alexey Milovidov
17e792ca0b
Merge pull request #44825 from azat/ci/integration-fixes 
Fix misleading integration tests reports for parametrized tests
 2023-01-02 17:49:57 +03:00
robot-clickhouse
675fe5cd91 Automatic style fix 2023-01-02 13:38:18 +00:00
Nikita Mikhaylov
ec5e8ee9cf Done 2023-01-02 13:31:19 +00:00
Smita Kulkarni
5592d30798 Updated to skip access check for hdfs , as done for other tests - Allow macro substitution in endpoint 2023-01-02 14:03:51 +01:00
Yatsishin Ilya
54e2df724f fix test 2023-01-02 12:43:16 +01:00
Yatsishin Ilya
6ec3bf40b1 black 2023-01-02 12:43:16 +01:00
Yatsishin Ilya
f779fe3c0a Improve some integration tests 2023-01-02 12:43:16 +01:00
Azat Khuzhin
c3b3ae886f tests/integration: ignore exit code for a running group 
tee is useful there, otherwise logs are empty on CI

This reverts commit 92fd7def39.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 12:08:44 +01:00
Azat Khuzhin
f2c069b852 tests/integration: allow to split parametrized tests between parallel groups 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 12:06:56 +01:00
Smita Kulkarni
2f73bf48b8 Added config to integration test test_endpoint_macro_substitution - Allow macro substitution in endpoint 2023-01-02 11:43:19 +01:00
Alexey Milovidov
b89513e789
Merge pull request #44823 from azat/tests/fix-flaky-test_multiple_disks 
Fix flaky test_multiple_disks::test_jbod_overflow
 2023-01-02 05:25:27 +03:00
Azat Khuzhin
4b71b481c7 tests/integration: do not split paramaterized tests into multiple groups 
There is also one assumption the runner already, that leads to
misleading reports like in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/44762/89c071e291980e355f2c2be42dc15047caabc9bc/integration_tests__asan__%5B4/6%5D.html

Here the test test_multiple_disks/test.py::test_jbod_overflow had been
splitted into multiple groups, however because of that one assumption
it had been runned as a whole in both groups and in one it failed but
succeeded in another.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-01 23:35:21 +01:00
Azat Khuzhin
700943a2b0 tests/integration: remove logging message for undone thing 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-01 23:13:00 +01:00
Azat Khuzhin
fa78569c39 tests/integration: fix logging message 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-01 23:12:25 +01:00
Azat Khuzhin
92fd7def39 tests/integration: fix detecting exit code for a running group 
Because of tee the exit code is the result of tee, not of the pytest.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-01 23:09:12 +01:00
Azat Khuzhin
3123761980 Fix flaky test_multiple_disks::test_jbod_overflow 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-01 22:21:24 +01:00
Alexey Milovidov
f5fc9b2825 Fix tests for bridges 2023-01-01 22:00:08 +01:00
Vitaly Baranov
426e2a9da1 Add test for getting credentials from AWS EC2 metadata. 2022-12-31 18:56:40 +01:00
alesapin
4948a8c17b
Remove disk restart proxy and disk decorator (#44647) 
* Remove disk restart proxy and disk decorator
* Automatic style fix
* Returned some trash back
* Fix build again
* Fix failing test

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2022-12-30 14:47:30 +01:00
SmitaRKulkarni
f9a3aeb172
Merge branch 'master' into 40951_Allow_macro_substitution_in_endpoint 2022-12-30 10:43:14 +01:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
robot-clickhouse
c09d1bc758 Automatic style fix 2022-12-29 15:16:50 +00:00
Smita Kulkarni
8cc3b2e26c Fixed integration flaky test issue by specifying hdfs client in each test- Allow macro substitution in endpoint 2022-12-29 16:10:06 +01:00
Nikita Mikhaylov
ffaff7167b
Fix flaky tests (#44690) 2022-12-29 14:32:10 +01:00
Alexey Milovidov
9378194320
Merge pull request #44688 from ClickHouse/improve-odbc-test 
Improve odbc test
 2022-12-29 15:40:47 +03:00
taiyang-li
d5dcf93775 fix import erorr 2022-12-29 16:37:20 +08:00
Azat Khuzhin
90b707d130 tests: more fixes for test_keeper_auth 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-29 09:29:24 +01:00
taiyang-li
84f33a3114 commit again 2022-12-29 14:56:09 +08:00
Alexey Milovidov
f7b2b961f7
Merge pull request #44667 from azat/tests/integration/dmesg-fix 
Move dmesg dumping out from runner to ci-runner.py
 2022-12-29 01:56:34 +03:00
Alexey Milovidov
23ea273f73 Edit another test 2022-12-28 19:49:57 +01:00
Alexey Milovidov
edd78da0cb ODBC test: avoid poisoning other tests 2022-12-28 19:45:01 +01:00
Alexey Milovidov
0263499b0c
Merge pull request #44666 from azat/tests/integration/kazoo-stop 
tests/integration: add missing kazoo client termination
 2022-12-28 21:20:14 +03:00
Anton Popov
bc122d368a Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-28 17:45:04 +00:00
Azat Khuzhin
03f80bae90 Move dmesg dumping out from runner to ci-runner.py 
runner is used by developers to run tests, while ci-runner.py is used
only by CI scripts, and to avoid requiring CAP_SYSLOG for manual dmesg
clear/dump had been moved.

Also for manual runs this can be done manually.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-28 15:47:46 +01:00
Vitaly Baranov
8a2fbbe88c
Merge pull request #43947 from azat/backups/dedup 
RFC: Add ability to disable deduplication for BACKUP
 2022-12-28 15:24:53 +01:00
Nikolay Degterinsky
ccfece0428 Add test 2022-12-28 13:48:47 +00:00
Alexey Milovidov
1b4121459d
Merge pull request #44645 from ClickHouse/keeper-test-fix 
Fix flaky test `test_keeper_multinode_simple`
 2022-12-28 16:38:17 +03:00
taiyang-li
dc34393f66 add another test 2022-12-28 18:27:36 +08:00
Azat Khuzhin
bc6adc88c8 tests/integration: add workaround for a bug in kazoo driver 
Refs: python-zk/kazoo#688
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-28 10:52:49 +01:00
taiyang-li
28f726f825 add zookeeper integration tests 2022-12-28 16:58:21 +08:00
taiyang-li
437c31eca3 merge master and fix conflicts 2022-12-28 15:02:37 +08:00
Vitaly Baranov
b211dff013 Increase the create table timeout in test "test_backup_restore_on_cluster". 2022-12-28 00:17:19 +01:00
Nikita Mikhaylov
00ecf6dd05 Better 2022-12-27 17:04:47 +00:00
Nikita Mikhaylov
ce6264b684 Done 2022-12-27 17:03:57 +00:00
Azat Khuzhin
e1ad5cee7e tests/integration: add missing kazoo client termination 
pytest play games with logging output [1].

  [1]: https://github.com/pytest-dev/pytest/issues/5502

But this does not actually affect ClickHouse tests, the only reason is
that the kazoo client is not stopped correctly without calling
kazoo.client.KazooClient.stop(), and that's why you can see the
following messages:

<details>

    test_storage_rabbitmq/test.py::test_rabbitmq_big_message --- Logging error ---
    Traceback (most recent call last):
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 179, in _socket_error_handling
        yield
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 659, in _connect
        self._socket = self.handler.create_connection(
      File "/usr/local/lib/python3.8/dist-packages/kazoo/handlers/threading.py", line 178, in create_connection
        return utils.create_tcp_connection(socket, *args, **kwargs)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/handlers/utils.py", line 265, in create_tcp_connection
        sock = module.create_connection(address, timeout_at)
      File "/usr/lib/python3.8/socket.py", line 808, in create_connection
        raise err
      File "/usr/lib/python3.8/socket.py", line 796, in create_connection
        sock.connect(sa)
    socket.timeout: timed out

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 579, in _connect_attempt
        read_timeout, connect_timeout = self._connect(host, hostip, port)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 659, in _connect
        self._socket = self.handler.create_connection(
      File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__
        self.gen.throw(type, value, traceback)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 182, in _socket_error_handling
        raise ConnectionDropped("socket connection error: %s" % (err,))
    kazoo.exceptions.ConnectionDropped: socket connection error: None

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "/usr/lib/python3.8/logging/__init__.py", line 1088, in emit
        stream.write(msg + self.terminator)
    ValueError: I/O operation on closed file.
    Call stack:
      File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
        self._bootstrap_inner()
      File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
        self.run()
      File "/usr/lib/python3.8/threading.py", line 870, in run
        self._target(*self._args, **self._kwargs)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 512, in zk_loop
        if retry(self._connect_loop, retry) is STOP_CONNECTING:
      File "/usr/local/lib/python3.8/dist-packages/kazoo/retry.py", line 126, in __call__
        return func(*args, **kwargs)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 552, in _connect_loop
        status = self._connect_attempt(host, hostip, port, retry)
      File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 622, in _connect_attempt
        self.logger.warning('Connection dropped: %s', e)
    Message: 'Connection dropped: %s'
    Arguments: (ConnectionDropped('socket connection error: None'),)

</details>

Which eventually leads to incorrectly parsed report.

This patch is an addition to the `logging.raiseExceptions=False` - #44618

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-27 17:01:06 +01:00
Kruglov Pavel
c3405be272
Increase the number of attempts in tests 2022-12-27 16:49:32 +01:00
Azat Khuzhin
c9c590071d Add ability to disable deduplication for BACKUP 
Right now BACKUP omit similar files, and will not allow to use this
backup as a regular table, and usually those similar files are quite
small (i.e. columns.txt).

So by using `BACKUP TO S3() deduplicate_files=0` you will be possible to
use `ATTACH TABLE` directly from S3.

P.S. right now it is possible only for the table with one part, since,
usually, there is nothing to deduplicate (if the columns are different).

v2: Add deduplicate_files into metadata
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-27 15:56:06 +01:00
Alexey Milovidov
7e447592b1
Merge pull request #44618 from azat/tests/integration/pytest-logging-fix 
tests/integration: suppress exceptions during logging (due to pytest)
 2022-12-27 14:33:37 +03:00
Alexey Milovidov
79d43c836a
Merge pull request #44572 from ClickHouse/fix-hdfs-test 
Fix HDFS test
 2022-12-27 14:31:00 +03:00
Alexey Milovidov
41fc65b47b
Merge pull request #44573 from ClickHouse/fix-distributed-queries-stress 
Fix test_distributed_queries_stress
 2022-12-27 14:30:28 +03:00
Azat Khuzhin
8b2ed0e3cd tests/integration: disable logging.raiseExceptions 
Due to pytest play games with logging [1] it is better to ignore it.

  [1]: https://github.com/pytest-dev/pytest/issues/5502

This is due to incorrect kazoo client usage (not all clients calls
stop())

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-26 22:57:54 +01:00
Alexey Milovidov
a92a9b4d55
Merge pull request #44535 from azat/tests/integration-dmesg 
tests: capture dmesg in integration tests
 2022-12-26 23:49:02 +03:00
Roman Vasin
465cc36526 Update Exception messages in test.py 2022-12-26 13:17:22 +00:00
Roman Vasin
483e26cf2f
Merge branch 'master' into ADQM-634 2022-12-26 15:34:38 +03:00
Roman Vasin
3cdc9b3f81 Remove -vvv from kinit call in tests 2022-12-26 11:59:37 +00:00
Roman Vasin
a70e3c20fa Make calls of test from Ubuntu client 2022-12-26 11:56:45 +00:00
Alexey Milovidov
a06c8268ea Remove the offender 2022-12-26 11:28:26 +01:00
Alexey Milovidov
f9f0f9446d Fix distributed_queries_stress 2022-12-25 09:46:51 +01:00
robot-clickhouse
19f05d4fb4 Automatic style fix 2022-12-25 08:38:02 +00:00
Alexey Milovidov
cbf140633b Fix HDFS test 2022-12-25 09:30:20 +01:00
Anton Popov
0722020cae Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-23 18:15:55 +00:00
Smita Kulkarni
84362461fb Updated test to use macro substitution for hdfs disk - Allow macro substitution in endpoint 2022-12-23 16:07:56 +01:00
Azat Khuzhin
69fadd2193 tests: capture dmesg in integration tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-23 15:50:10 +01:00
Smita Kulkarni
3d62bc2635 Allow macro substitution in endpoint of disks 
Implementation:
* Updated to substitute macros in endpoint for all disks (s3, hfs, web).
Testing:
* Added an integration test test/integration/test_endpoint_macro_substitution.
 2022-12-23 15:09:24 +01:00
Mikhail f. Shiryaev
6d0cd35cd0
Ignore exit code 1 for tar in integration tests 2022-12-23 13:08:59 +01:00
kssenii
8308177361 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-23 12:14:46 +01:00
Vladimir C
7482ea54ab
Merge pull request #43972 from ClickHouse/vdimir/tmp-data-in-fs-cache-2 2022-12-23 11:59:27 +01:00
kssenii
853f2ea123 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-23 11:49:02 +01:00
kssenii
8f1145f6e4 Fix tests 2022-12-23 11:47:51 +01:00
kssenii
11c0aa189a Better error message 2022-12-22 15:29:35 +01:00
Nikolai Kochetov
773de7a8a6
Merge pull request #44472 from CurtizJ/fix-mutations 
Fix mutations with setting `max_streams_for_merge_tree_reading`
 2022-12-22 14:05:20 +01:00
kssenii
a58b8b8e6c Fix tests 2022-12-22 12:27:42 +01:00
kssenii
ab458e68cd Fix tests 2022-12-22 12:24:20 +01:00
vdimir
182b34c11e
Fixes 2022-12-22 10:22:57 +00:00
vdimir
511e8d698d
Rename config param tmp_cache -> temporary_data_in_cache 2022-12-22 10:22:56 +00:00
vdimir
d30d25dbbe
Temporary files evict fs cache 2022-12-22 10:22:49 +00:00
Roman Vasin
2d9f3c242b Add test_bad_path_to_keytab test 2022-12-22 08:07:16 +00:00
Yakov Olkhovskiy
cea5b92536 binary backward compatibility test is added 2022-12-22 07:38:49 +00:00
kssenii
d3db1dd6a7 Fix tests 2022-12-22 00:27:22 +01:00
Anton Popov
5d6064cd28 better config in test 2022-12-21 11:35:11 +00:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Anton Popov
4b7f1e0cf2 fix mutations with setting 'max_streams_for_merge_tree_reading' 2022-12-21 01:59:53 +00:00
kssenii
1d75f740d7 Fix tests 2022-12-20 22:33:54 +01:00
kssenii
499565a604 Fix tests 2022-12-20 20:02:18 +01:00
Yakov Olkhovskiy
8462b724ca
Merge branch 'master' into feature-protocol-proxy 2022-12-20 13:12:07 -05:00
robot-clickhouse
82203e629c Automatic style fix 2022-12-20 17:46:17 +00:00
Yakov Olkhovskiy
9092134544 auth_use_forwarded_address config setting added, using forwarded address for proxied TCP and HTTP connection, likely bug is fixed in AccessControl, relevant test is appended 2022-12-20 17:39:40 +00:00
alesapin
80cae1aa3d Better 2022-12-20 17:37:03 +01:00
alesapin
33389f01e6 Disable tsan assertion for test 2022-12-20 17:33:08 +01:00
Konstantin Bogdanov
93375fc3e5
Merge pull request #44411 from thevar1able/fix-settings-constraints 
Fix settings constraints
 2022-12-20 10:19:07 +01:00
Konstantin Bogdanov
a094af9a49
Lint 2022-12-20 04:00:45 +01:00
Konstantin Bogdanov
b07001e7d7
Add a test 2022-12-20 03:26:31 +01:00
kssenii
a0c8d34775 RabbitMQ: respect flushing data by flush interval and by block size 2022-12-19 21:07:44 +01:00
Roman Vasin
8a692432de Remove unneeded headers from test.py 2022-12-19 11:48:10 +00:00
Roman Vasin
c26c257c57 Refactor test.py 2022-12-19 11:39:30 +00:00
Roman Vasin
64c0c6ae99 Refactor test_kerberos_auth test 2022-12-19 11:28:49 +00:00
Antonio Andelic
55dd591392 Try restarting ZK cluster on failed connection 2022-12-19 09:28:59 +00:00
Antonio Andelic
0162632275
Merge pull request #44306 from ClickHouse/another-fix-for-test-server-reload 
Another fix `test_server_reload`
 2022-12-19 09:14:03 +01:00
Nikolay Degterinsky
7a29bf0e4c
Merge pull request #43993 from evillique/fix_settings_constraints 
Fix CREATE query constraints
 2022-12-16 18:01:04 +01:00
Anton Popov
8b9b8b083c
Merge pull request #43726 from CurtizJ/optimize-storage-s3 
Improve performance of storage `S3` with large number of small files
 2022-12-16 14:38:10 +01:00
Antonio Andelic
372c187773 Correctly compare get result 2022-12-16 09:48:47 +00:00
Roman Vasin
775c700c24 Add second test for the case when there is no keytab 2022-12-16 08:20:01 +00:00
Nikolay Degterinsky
1861e670e9
Merge branch 'master' into fix_settings_constraints 2022-12-15 21:54:02 +01:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Roman Vasin
5491aa9627 Implement wait_kerberos_kdc_is_available 2022-12-15 11:50:23 +00:00
Anton Popov
c4bcfe54cd fix test 2022-12-15 04:19:16 +00:00
Vitaly Baranov
fb8aca8319
Merge pull request #44158 from vitlibar/improve-referential-deps 
Improve referential dependencies
 2022-12-14 21:17:02 +01:00
Roman Vasin
e2ced517dd Add integration test test_kerberos_auth 2022-12-14 13:39:23 +00:00
kssenii
ea5b06023a Merge remote-tracking branch 'refs/remotes/upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-14 13:59:51 +01:00
Sema Checherinda
fdecb85dc4
Merge pull request #44156 from CheSema/fix_flaky_test_attach_detach 
make calls to be sure that parts are deleted
 2022-12-14 12:39:39 +01:00
Antonio Andelic
b2cce09004
Merge pull request #44184 from ClickHouse/close-grpc-channel-in-tests 
Close GRPC channels in tests
 2022-12-14 09:47:36 +01:00
Anton Popov
3008e701ea fix tests 2022-12-14 01:36:03 +00:00
Anton Popov
cce3257f39
Merge branch 'master' into optimize-storage-s3 2022-12-13 21:35:12 +01:00
Nikolay Degterinsky
809f15ac81
Merge branch 'master' into fix_settings_constraints 2022-12-13 20:33:16 +01:00
Nikolay Degterinsky
443bc3e656
Merge pull request #43719 from evillique/password_complexity_rules 
Add password complexity rules
 2022-12-13 17:56:45 +01:00
Anton Popov
0c87031e80 Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-13 16:33:21 +00:00
Mikhail f. Shiryaev
9879d03bc4
Use contextmanager for grpc_channels 2022-12-13 12:43:48 +01:00
Antonio Andelic
b8f76ce0e5 Close GRPC channels in tests 2022-12-13 10:25:54 +00:00
Vitaly Baranov
5c1f490b3a Implement referential dependencies for table engine "Distributed" 
and for functions cluster() and clusterAllReplicas().
 2022-12-13 11:09:42 +01:00
Nikolay Degterinsky
f352403af2 Fix style 2022-12-13 09:41:31 +00:00
Nikolay Degterinsky
034269087f Fix tests 2022-12-13 09:16:23 +00:00
Anton Popov
0b396bab14 Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-12 18:08:27 +00:00
Vitaly Baranov
5aaff60650 Fix referential dependencies when host & post in a clickHouse dictionary source are set by default. 2022-12-12 18:22:14 +01:00
Vitaly Baranov
76ba8ab3d4 Add new tests. 2022-12-12 18:22:09 +01:00
Anton Popov
a2fee110b8 add query for waiting of loading parts and fix test_transactions 2022-12-12 14:33:42 +00:00
Sema Checherinda
aecc509f80 make calls to be sure that parts are deleted 2022-12-12 12:37:52 +01:00
Nikolay Degterinsky
19e95e8cd8 Better implementation of password rules 2022-12-11 23:59:04 +00:00
Sema Checherinda
9a1152339c
Merge branch 'master' into do-not-run-clear-old-parts-at-shutdown 2022-12-10 09:44:56 +01:00
Nikolay Degterinsky
a8545a29a4 Better test 2022-12-10 01:32:15 +00:00
Sergei Trifonov
7c37e48092
Merge pull request #43903 from ClickHouse/merge_tree_settings_constraints 
Constraints on merge tree settings
 2022-12-09 14:16:14 +01:00
Kseniia Sumarokova
e21d4a93b8
Merge pull request #44050 from ClickHouse/fix_clickhouse_disk 
Slightly better clickhouse disks and remove DiskMemory
 2022-12-09 13:09:59 +01:00
Alexey Milovidov
68e506d48f Unify __init__.py files 2022-12-08 23:04:56 +01:00
Alexey Milovidov
f880644d3a
Merge branch 'master' into nv/fix-mutate-fetch 2022-12-09 00:51:54 +03:00
Sergei Trifonov
bae1519970
Merge branch 'master' into merge_tree_settings_constraints 2022-12-08 22:25:16 +01:00
robot-clickhouse
98ce0dbb12 Automatic style fix 2022-12-08 17:27:23 +00:00
alesapin
7a223f4956 Slightly better clickhouse disks and remove DiskMemory 2022-12-08 18:20:54 +01:00
serxa
6428b8a1bb check one more case in test 2022-12-07 20:36:04 +00:00
Alexey Milovidov
9c81fd7afc
Merge pull request #43517 from ClickHouse/password-reset-message 
Move password reset message from client to server
 2022-12-07 23:26:58 +03:00
serxa
05788245dd add test 2022-12-07 20:16:10 +00:00
Nikolay Degterinsky
8a53f5364b
Fix style 2022-12-07 10:36:16 +01:00
Nikolay Degterinsky
bb9fdc0839 Fix CREATE query constraints 2022-12-07 00:53:27 +00:00
Sema Checherinda
0b2a3195c8 adjust integration/test_partition/test_detached_part_dir_exists 2022-12-05 17:39:27 +01:00
Sema Checherinda
1f96ef57d2 remove integration/test_parts_removal 2022-12-05 17:24:54 +01:00
kssenii
d278a0dbfb Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-05 12:59:44 +01:00
kssenii
dca3444283 Merge remote-tracking branch 'upstream/master' into named-collections-sql-commands 2022-12-04 15:56:02 +01:00
Vitaly Baranov
e1f7f04752
Referential dependencies for RESTORE (#43834) 
* Rename DDLDependencyVisitor -> DDLLoadingDependencyVisitor.

* Move building a loading graph to TablesLoader.

* Implement referential dependencies for tables and use them
when restoring tables from a backup.

* Remove StorageID::operator < (because of its inconsistency with ==).

* Add new tests.

* Fix test.

* Fix memory leak.

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2022-12-02 15:05:46 +01:00
Vladimir C
7d6950d397
Revert "Temporary files evict fs cache" 2022-12-02 14:50:56 +01:00
Alexander Tokmakov
edbd460997
Merge pull request #43848 from elenatorro/fix_reset_setting_on_cluster 
Add RESET_SETTING to check if it is a settings alter
 2022-12-02 15:06:28 +03:00
Alexander Tokmakov
c2a19fc354
Update test.py 2022-12-01 19:41:29 +03:00
Nikita Mikhaylov
9ef54c6ecc
Try to use exchanges during database replicated replica recovery process (#43628) 2022-12-01 13:50:56 +01:00
vdimir
08b8d335f0
add integration/test_temporary_data_in_cache 2022-12-01 11:49:25 +00:00
vdimir
7a814d2854
wip: temporary files evict fs cache 2022-12-01 11:49:24 +00:00
Elena Torró
5630412944
Merge branch 'master' into fix_reset_setting_on_cluster 2022-11-30 21:47:43 +01:00
Elena
0a35a072d9 Add RESET_SETTING to check if is a settings alter 2022-11-30 21:44:19 +01:00
Robert Schulze
6f564c59bd
Merge pull request #42641 from Enmk/fix_profile_names_mismatch 
Fixed exception when user tries to log in
 2022-11-30 13:01:57 +01:00
Anton Popov
df6d2f2163 Merge remote-tracking branch 'upstream/master' into HEAD 2022-11-29 23:21:23 +00:00
Alexey Milovidov
72bf1115e9
Merge branch 'master' into password-reset-message 2022-11-29 23:51:46 +01:00
Vasily Nemkov
3d0c07ac5b Updated tests to match improved behaviour of currentProfiles() 2022-11-30 02:32:27 +04:00
Anton Popov
2a1fd48e91 fix tests 2022-11-29 17:33:35 +00:00
robot-clickhouse
ad66e01ace Automatic style fix 2022-11-29 14:48:05 +00:00
Alexander Tokmakov
12a7d64ef5
Update test.py 2022-11-29 17:33:02 +03:00
Antonio Andelic
db46842c8a Merge branch 'master' into more-aggresive-batching-keeper 2022-11-29 12:58:33 +00:00
alesapin
a800a80ab6
Merge pull request #43770 from ClickHouse/fix_flaky_store_cleanup2 
Fix flaky `test_store_cleanup`
 2022-11-29 13:11:57 +01:00
Antonio Andelic
e39f97a255 Properly close connections and add retries 2022-11-29 09:13:23 +00:00
Anton Popov
486da48ae7 fix tests 2022-11-28 21:15:41 +00:00
Alexander Tokmakov
40d28e3489 fix flaky test 2022-11-28 18:31:22 +01:00
Alexander Tokmakov
06e6844ec0
Update test.py 2022-11-28 18:22:03 +03:00
Antonio Andelic
af7f0257c3
Merge pull request #43658 from ClickHouse/try-fix-flaky-keeper-map 
Fix flaky `KeeperMap` integration tests
 2022-11-28 12:04:04 +01:00
Nikita Taranov
8ed5cfc265
Memory bound merging for distributed aggregation in order (#40879) 
* impl

* fix style

* make executeQueryWithParallelReplicas similar to executeQuery

* impl for parallel replicas

* cleaner code for remote sorting properties

* update test

* fix

* handle when nodes of old versions participate

* small fixes

* temporary enable for testing

* fix after merge

* Revert "temporary enable for testing"

This reverts commit cce7f8884c.

* review fixes

* add bc test

* Update src/Core/Settings.h
 2022-11-28 00:41:31 +01:00
Antonio Andelic
cade21b76e Fix 4LW test 2022-11-26 19:24:10 +00:00
Antonio Andelic
65dba31c3a
Merge branch 'master' into try-fix-flaky-keeper-map 2022-11-26 19:00:30 +01:00
Sema Checherinda
15a6ce254b
Merge pull request #41145 from CheSema/lock-free-drop-partition 
Delete parts by replacing them with empty parts
 2022-11-25 12:54:30 +01:00
Antonio Andelic
f3b01d455b Use dummy pool 2022-11-25 11:12:01 +00:00
Anton Popov
c65be55da1 Merge remote-tracking branch 'upstream/master' into HEAD 2022-11-24 14:30:23 +00:00
Alexander Tokmakov
52d33fff00
Merge pull request #43366 from zzsmdfj/issue_15357_MaterializeMySQL_support_drop_mulit_table 
MaterializeMySQL_support_drop_mulit_table
 2022-11-24 14:54:24 +03:00
Sema Checherinda
6fd7dcf26f
Merge branch 'master' into lock-free-drop-partition 2022-11-24 12:34:19 +01:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key 
Enable compress marks and primary key for CI
 2022-11-24 12:24:04 +01:00
Sema Checherinda
4f592bc208 fix isolation breach, droping outdated part should't be ignored 2022-11-23 15:16:09 +00:00
Sema Checherinda
f0294cd6ed fix test_merge_tree_s3_restore 2022-11-23 15:16:09 +00:00
Sema Checherinda
597421014e fix style check 2022-11-23 15:16:08 +00:00
Sema Checherinda
db86cd0f0a fix several critical races, fix tests 2022-11-23 15:16:08 +00:00
Sema Checherinda
49539e6862 fix test_partition 2022-11-23 15:16:08 +00:00
Sema Checherinda
62d3e9da4d fix test_merge_tree_hdfs 2022-11-23 15:16:08 +00:00
Sema Checherinda
d43d7ed6ea fix test_merge_tree_empty_parts and test_ttl_replicated 2022-11-23 15:16:08 +00:00
Sema Checherinda
dd93d331c1 fix 01168_mutations_isolation 2022-11-23 15:16:08 +00:00
Sema Checherinda
9edad4a078 make test_detached_parts_metrics wait delete inactive and empty parts 2022-11-23 15:16:08 +00:00
Sema Checherinda
44a8f2f460 work with test_merge_tree_s3 and test_merge_tree_s3_restore 2022-11-23 15:16:08 +00:00
Sema Checherinda
cddf44034d address test_transactions 2022-11-23 15:16:08 +00:00
Sema Checherinda
dc19141d84 fix test_detached_parts_metrics 2022-11-23 15:16:08 +00:00
Sema Checherinda
15012c7070 address the review comments 2022-11-23 15:16:08 +00:00