Commit Graph

9397 Commits

Author SHA1 Message Date
unashi
fb16b6d3a2 [fix] test again 2024-04-29 19:23:24 +08:00
kssenii
f79bb23a1b Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-04-29 11:49:05 +02:00
Eduard Karacharov
979efcad49 allow YAML sources in include_from 2024-04-29 12:42:56 +03:00
Azat Khuzhin
3e68103ac8 Fix interserver secret for Distributed over Distributed from remote()
Right if you are executing remote() and later the query will
go to the cluster with interserver secret, then you should have the same
user on the nodes from that cluster, otherwise the query will fail with:

    DB::NetException: Connection reset by peer

And on the remote node:

    <Debug> TCPHandler: User (initial, interserver mode): new_user (client: 172.16.1.5:40536)
    <Debug> TCP_INTERSERVER-Session: d29ecf7d-2c1c-44d2-8cc9-4ab08175bf05 Authentication failed with error: new_user: Authentication failed: password is incorrect, or there is no user with such name.
    <Error> ServerErrorHandler: Code: 516. DB::Exception: new_user: Authentication failed: password is incorrect, or there is no user with such name. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below):

The problem is that remote() will not use passed to it user in
any form, and instead, the initial user will be used, i.e. "cli_user"
not "query_user":

    chc --user cli_user -q "select * from remote(node, default, some_dist_table, 'query_user')"

Fix this by using the user from query for the remote().

Note, that the Distributed over Distributed in case of tables still wont
work, for this you have to have the same users on all nodes in all
clusters that are involved in case of interserver secret is enabled (see
also test).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

v2: move client initial_user adjustment into ClusterProxy/executeQuery.cpp
v3: we cannot check for interserver_mode in
    updateSettingsAndClientInfoForCluster() since it is not yet
    interserver in remote() context
2024-04-29 07:12:17 +02:00
unashi
b3a20cb4b4 [fix] style check fix 2024-04-29 10:48:00 +08:00
unashi
c0a2fba00f [fix] check style fix 2024-04-29 10:19:18 +08:00
unashi
51db98a158 [fix] Add space after config 2024-04-28 21:29:27 +08:00
unashi
9d94a3cf95 [update] fix the integration test 2024-04-28 21:26:35 +08:00
kssenii
8c4476d7db Merge remote-tracking branch 'origin/master' into less-contentaion-in-cache-part4 2024-04-28 13:36:16 +02:00
unashi
73c6d09eff [solve config] 2024-04-28 19:20:57 +08:00
kssenii
7a416f2e76 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-28 12:19:32 +02:00
unashi
b15141f1b1 [feature fix] 1. replace can't work between different disks; 2. Add freezeRemote for attach partition 2024-04-28 17:34:26 +08:00
Alexey Milovidov
d9fa3fdceb
Merge pull request #63069 from azat/tests/integration-old-analyzer
Fix integration tests with old analyzer (and fix some leftovers of enabling it)
2024-04-27 21:43:07 +00:00
Alexey Milovidov
753dd30a40
Merge pull request #63070 from azat/tests/dist-inter-server-backward
Get back test for old inter-server mode (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET non-v2)
2024-04-27 21:42:11 +00:00
Azat Khuzhin
98df6b88a0 tests: forbid allow_experimental_analyzer if tag was specified
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 15:49:09 +02:00
Azat Khuzhin
5facb1d099 Get back test for old inter-server mode (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET non-v2)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 15:29:14 +02:00
Azat Khuzhin
52091916dc Fix leftovers of enabling new analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 11:19:03 +02:00
Azat Khuzhin
03d52e7e49 Better handling of old analyzer check in intergraion tests runner
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 10:32:27 +02:00
Azat Khuzhin
85ea46de77 Fix integration tests with old analyzer
This reverts commit 67d39a22ac.
2024-04-27 10:29:13 +02:00
Pablo Marcos
9002d4c751 Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-27 08:57:29 +02:00
Konstantin Bogdanov
64de52397e
Merge pull request #62978 from ClickHouse/fix-grpc-ipv6-crash
gRPC: fix crash on IPv6 peer connection
2024-04-27 06:22:41 +00:00
Nikita Mikhaylov
ed7e4291ab
Merge pull request #62937 from ClickHouse/docs-remove-replicated-experimental-tag
Remove experimental tag from Replicated database engine
2024-04-26 17:56:06 +00:00
kssenii
91014456b5 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-26 19:24:07 +02:00
kssenii
434d2d16f1 Cleanuo 2024-04-26 19:23:33 +02:00
Vitaly Baranov
faae8a4f2b Add tests for backup on cluster with 2 shards and 2 replicas. 2024-04-26 10:10:45 +02:00
Nikita Mikhaylov
a8683a8bd5 Remove the setting from tests 2024-04-25 22:13:14 +02:00
Pablo Marcos
24b84ef68a Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-25 18:26:14 +02:00
Konstantin Bogdanov
7326e2a0fa
Fix aborting on IPv6 peer address 2024-04-25 16:44:16 +02:00
Nikita Mikhaylov
5ea95cbbec
Merge branch 'master' into access-controls-enable-by-default 2024-04-25 13:21:23 +02:00
Andrey Zvonov
b83a59271a Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-s3-globs 2024-04-24 22:14:55 +00:00
robot-clickhouse
cf7dd8b86a Automatic style fix 2024-04-24 21:24:08 +00:00
Igor Nikonov
33b9e589c6 Add test_skip_replicas_without_table 2024-04-24 21:13:07 +00:00
Igor Nikonov
6db303cea3 Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-24 18:56:49 +00:00
Igor Nikonov
abf5be05b8 Set table for parallel replicas with analyzer 2024-04-24 18:56:03 +00:00
alesapin
1b562ce569
Merge pull request #61769 from kirillgarbar/modify-engine
Search for convert_to_replicated flag at the correct path
2024-04-24 18:17:29 +00:00
Han Fei
42621b2060 Merge branch 'master' into hanfei/stats_uniq 2024-04-24 19:55:15 +02:00
Han Fei
3a380642cc address comments 2024-04-24 18:20:48 +02:00
Vitaly Baranov
e42967c724 Add test. 2024-04-20 16:48:26 +01:00
Kruglov Pavel
37620e23a1
Merge branch 'master' into better-exception-s3-globs-partitions 2024-04-20 15:42:38 +01:00
kssenii
191937c0c6 Fix style check 2024-04-20 10:19:55 +01:00
kssenii
e2e6071063 Fix a few more tests 2024-04-19 13:44:07 +01:00
Pablo Marcos
c28af20e2a Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-18 17:53:11 +02:00
jsc0218
7525b2acf4
Merge pull request #60117 from jsc0218/TableEngineGrant_version2
TableEngineGrant_version2
2024-04-18 14:30:34 +00:00
Pablo Marcos
8d4d5a84f2 fixup! Fix test_grant_and_revoke/test.py::test_grant_all_on_table with new entry 2024-04-18 15:12:11 +02:00
Pablo Marcos
6e5fe39e57 Fix test_grant_and_revoke/test.py::test_grant_all_on_table with new entry 2024-04-18 13:13:28 +02:00
jsc0218
6e5afb8b89 grant all table engines in allow_database 2024-04-18 02:00:28 +00:00
Igor Nikonov
043c62931d Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-17 16:48:40 +00:00
jsc0218
80fa1ab89a fix 2024-04-17 00:31:15 +00:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
kssenii
ed460aa13f Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-15 16:39:36 +01:00
Vitaly Baranov
4efa03717b
Merge pull request #62601 from vitlibar/avoid-evaluating-table-defaults-while-restoring
Avoid evaluating table DEFAULT expressions while executing RESTORE
2024-04-15 15:32:42 +00:00
Robert Schulze
2a3b5bd74d
Merge pull request #58956 from AVMusorin/kafka-settings
Separate consumer/producer settings for Kafka
2024-04-15 15:11:19 +00:00
kssenii
3312c6675f Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-04-15 11:37:11 +01:00
Kruglov Pavel
c458920ee5
Merge pull request #62425 from Avogar/fix-partitioned-write
Respect settings truncate_on_insert/create_new_file_on_insert in s3/hdfs/azure engines during partitioned write
2024-04-15 10:29:18 +00:00
kssenii
27672e1dfc Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-15 11:28:14 +01:00
Vitaly Baranov
6c6faaa05d Add test. 2024-04-12 15:45:58 +02:00
Nikita Taranov
17315e53b8
Merge pull request #62577 from ClickHouse/revert-61551-better-marks-loading
Revert "More optimal loading of marks"
2024-04-12 13:00:20 +00:00
SmitaRKulkarni
09cbd7e8be
Merge pull request #62447 from ClickHouse/Fix_azure_restore
Fix backup restore path for AzureBlobStorage
2024-04-12 08:54:09 +00:00
Nikita Taranov
3ce02239c6
Revert "More optimal loading of marks" 2024-04-11 23:12:11 +02:00
Smita Kulkarni
3d9bead362 Merge branch 'master' into Fix_azure_restore 2024-04-11 16:08:27 +02:00
Alexander Tokmakov
c1c7cf56bd
Revert "[feature]: allow to attach parts from a different disk" 2024-04-11 13:43:51 +02:00
Yakov Olkhovskiy
a1dc43cd71
Merge pull request #62206 from vitlibar/fix-parsing-booleans-in-settings
Fix parsing booleans in settings
2024-04-10 21:30:29 +00:00
Igor Nikonov
912592ca78 Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-10 18:35:33 +00:00
kssenii
04ca143758 Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-04-10 19:11:14 +02:00
Anton Popov
4a8c1bf6a3
Merge pull request #62306 from CurtizJ/azure-retryable-errors
Better handling of errors from azure storage
2024-04-10 13:38:33 +00:00
Smita Kulkarni
49a9fc8d59 Merge branch 'master' into Fix_azure_restore 2024-04-10 15:14:21 +02:00
Andrey Zvonov
9ffc105f98 Merge branch 'zvonand-s3-globs' of github.com:zvonand/ClickHouse into zvonand-s3-globs 2024-04-10 12:02:18 +00:00
Andrey Zvonov
c9b05eac02 fix test_s3_glob_many_objects_under_selection 2024-04-10 12:02:01 +00:00
Andrey Zvonov
4566fe02e5
Merge branch 'ClickHouse:master' into zvonand-s3-globs 2024-04-10 11:02:17 +02:00
Kseniia Sumarokova
19658194da
Merge branch 'master' into less-contentaion-in-cache-part4 2024-04-10 10:59:59 +02:00
Andrey Zvonov
093b71b858 added test for selection globs with many files under 2024-04-09 21:01:01 +00:00
kssenii
ef0231e781 Merge remote-tracking branch 'origin/master' into less-contentaion-in-cache-part4 2024-04-09 17:28:49 +02:00
Nikolai Kochetov
283fc115ba Updating the test. 2024-04-09 15:17:26 +00:00
robot-clickhouse
950d1dfb86 Automatic style fix 2024-04-09 14:02:35 +00:00
Smita Kulkarni
33c0ac5cc6 Fix backup restore path for AzureBlobStorage 2024-04-09 15:50:15 +02:00
Han Fei
e5aa439ca0 Merge branch 'master' into hanfei/stats_uniq 2024-04-09 12:15:31 +02:00
avogar
8accf395fb Fix for HDFS and Azure 2024-04-08 20:37:06 +00:00
avogar
ef518946f3 Respect settings truncate_on_insert/create_new_file_on_insert in s3/hdfs/azure engines 2024-04-08 20:18:47 +00:00
Vitaly Baranov
ade0a311cf Fix tests 2024-04-08 20:04:14 +02:00
robot-clickhouse
7fcfbffd0c Automatic style fix 2024-04-08 15:01:11 +00:00
Nikolai Kochetov
b97e16f2b4
Merge bcccbe2b19 into c369d2171d 2024-04-08 16:54:43 +02:00
Nikolai Kochetov
82b2adef97 Fix GLOBAL IN table queries with analyzer. 2024-04-08 14:50:13 +00:00
Andrey Zvonov
98ca507f93 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-s3-globs 2024-04-08 14:04:34 +00:00
kssenii
7404e7d27b Add a test 2024-04-08 15:24:00 +02:00
Robert Schulze
d30b48f54e
Disable session caching to work around tsan races 2024-04-08 11:16:06 +00:00
Robert Schulze
c556f62f51
Fix test_ssl_cert_authentication 2024-04-08 11:03:51 +00:00
Robert Schulze
0674582028
Fix test_replicated_merge_tree_encryption_codec 2024-04-08 11:03:47 +00:00
alesapin
22caa3eb73 Merge remote-tracking branch 'origin/master' into try_global_trace_collector 2024-04-06 11:21:27 +02:00
Anton Popov
fa01f26def add test 2024-04-05 17:39:12 +00:00
kssenii
357e5e3ae6 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-05 16:15:56 +02:00
Vitaly Baranov
3012e4bc27
Merge pull request #62207 from vitlibar/fix-restoring-parts-while-readonly
Fix restoring parts while readonly
2024-04-05 13:57:27 +02:00
alesapin
e514a8b49d Merge remote-tracking branch 'origin/master' into try_global_trace_collector 2024-04-05 12:40:25 +02:00
zvonand
e385810796 fix black 2024-04-04 22:18:41 +02:00
Vitaly Baranov
43687e5732
Update tests/integration/test_backup_restore_on_cluster/test_slow_rmt.py
Co-authored-by: pufit <pufit@yandex.ru>
2024-04-04 22:10:16 +02:00
Vitaly Baranov
43d8988744
Update tests/integration/test_backup_restore_on_cluster/test_slow_rmt.py
Co-authored-by: pufit <pufit@yandex.ru>
2024-04-04 22:10:06 +02:00
zvonand
f4487d080a Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-s3-globs 2024-04-04 21:57:10 +02:00
Andrey Zvonov
ce3969e25d adapt test to new behavior 2024-04-04 19:47:34 +00:00
kssenii
29ae0800b0 Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-04-04 14:02:34 +02:00
kssenii
1e982a2368 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-04 13:26:06 +02:00
kssenii
be30806dbe Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-04 13:20:12 +02:00
Antonio Andelic
6197a62f0f
Merge pull request #62175 from ClickHouse/user-specific-s3-backup-on-cluster
User specific S3 endpoint for Backup/Restore on cluster
2024-04-04 12:46:29 +02:00
alesapin
58c79af80b Simpler 2024-04-04 12:22:11 +02:00
jsc0218
a1e3a4a58c fix test 2024-04-04 02:02:58 +00:00
jsc0218
ee589f8a8b Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-04-03 17:17:33 +00:00
Han Fei
5df9152332 Merge branch 'master' into hanfei/stats_uniq 2024-04-03 17:25:38 +02:00
Sema Checherinda
19e85c58cf
Merge pull request #62068 from ClickHouse/chesema-fix-url-storage
ReadWriteBufferFromHTTP set right header host when redirected
2024-04-03 12:52:49 +02:00
Antonio Andelic
cc31b837f2 User specific S3 endpoint backup/restore ON CLUSTER 2024-04-03 08:55:56 +02:00
Vitaly Baranov
44fa62c0a4 Add test. 2024-04-02 23:44:49 +02:00
robot-clickhouse
a3028ed9cd Automatic style fix 2024-04-02 16:20:09 +00:00
alesapin
add92939da
Merge d11d10050b into e037e68130 2024-04-02 16:08:10 +00:00
alesapin
f5c5146153 [RFC] Try to add global Real and CPU trace collector 2024-04-02 18:04:53 +02:00
kssenii
0664ca3e7e Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-04-02 17:55:20 +02:00
vdimir
f1345723d0
Merge pull request #61972 from ClickHouse/vdimir/storage_join_load_order
Fix storage join files loading order
2024-04-02 17:08:08 +02:00
Han Fei
11a4ae516d Merge branch 'master' into hanfei/stats_uniq 2024-04-01 22:46:28 +02:00
Anton Popov
0c25ea2230
Merge pull request #61551 from CurtizJ/better-marks-loading
More optimal loading of marks
2024-04-01 18:31:01 +02:00
vdimir
e5f218c4cc
Merge branch 'master' into vdimir/storage_join_load_order 2024-04-01 14:15:01 +02:00
robot-clickhouse
267ebba3c0 Automatic style fix 2024-03-31 23:43:28 +00:00
Sema Checherinda
4c08c7c1da
Merge 9a9f0161bb into 5e7a90f85f 2024-03-31 23:33:53 +00:00
Sema Checherinda
9a9f0161bb add test 2024-04-01 01:33:40 +02:00
Han Fei
419ac380f1
Merge pull request #61953 from hanfei1991/hanfei/fix-quorum-retry
fix logical-error when undoing quorum insert transaction
2024-03-28 20:49:32 +01:00
kssenii
961704ba17 Style check 2024-03-28 15:00:49 +01:00
Kseniia Sumarokova
0244e0851a
Merge pull request #61954 from ClickHouse/follow-up-broken-projections
Follow up to #60452
2024-03-28 14:23:28 +01:00
kssenii
5c63d09c5b More tests fixes 2024-03-28 14:15:14 +01:00
Nikita Fomichev
a63f4783bf
Merge pull request #61869 from fm4v/fix-flaky-tests2
Fix flaky tests 2 (stateless, integration)
2024-03-28 10:57:19 +01:00
kssenii
ca1c119115 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-27 22:32:44 +01:00
Kseniia Sumarokova
ffd29f8b72
Update test.py 2024-03-27 22:29:36 +01:00
Alexey Milovidov
795026af72
Merge pull request #61911 from ClickHouse/jamesweb
Make userspace page cache work with 'web' disks
2024-03-28 00:18:27 +03:00
Han Fei
343b51ccfa fix style 2024-03-27 21:27:07 +01:00
Nikita Taranov
7b17b14aa0
Merge pull request #61671 from GrigoryPervakov/master
Reload certificate chain during certificate reload
2024-03-27 21:19:32 +01:00
kssenii
480251e593 Fix style check 2024-03-27 19:28:11 +01:00
kssenii
e0c02bf3af Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-27 19:27:07 +01:00
kssenii
6a585600f0 Update test 2024-03-27 19:21:13 +01:00
kssenii
7a991de488 Fix tests 2024-03-27 19:06:19 +01:00
Han Fei
e849c48e21 add a test 2024-03-27 18:56:13 +01:00
Aleksandr Musorin
f9d81bc774 refactore: improve reading several configurations for kafka
Simplify and do some refactoring for kafka client settings.

Allows to set up separate
settings for consumer and producer like:

```
<consumer>
    ...
</consumer>

<producer>
    <kafka_topic>
        <name>topic_name</name>
        ...
    </kafka_topic>
</producer>
```

Moreover, this fixes warnings from kafka client like:
`Configuration property session.timeout.ms is a consumer property and
will be ignored by this producer instance`
2024-03-27 14:53:33 +01:00
Yarik Briukhovetskyi
844bb4f06c
Merge pull request #61727 from yariks5s/fix_undrop_query
Revert "Revert "Un-flake test_undrop_query""
2024-03-27 13:12:50 +01:00
vdimir
128c51c6fc
Fix storage join loading order 2024-03-27 11:27:30 +00:00
kssenii
2ce0d647f2 Small test fix 2024-03-26 21:39:23 +01:00
Dmitry Novik
65121b712e Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-26 19:02:30 +01:00
kssenii
a777045dd3 Fix and more tests for broken projections handling 2024-03-26 18:47:48 +01:00
Yarik Briukhovetskyi
24b9bde70a
Update test.py 2024-03-26 18:30:44 +01:00
Yarik Briukhovetskyi
5275a7f8bf
black check 2024-03-26 18:26:32 +01:00
yariks5s
4db84187f1 speed up tests 2024-03-26 17:04:04 +00:00
yariks5s
c01448f0b6 Make tests faster + docs improvement 2024-03-26 17:00:35 +00:00
Nikita Fomichev
33e3d831f8 integration tests: add test test_replicated_database_compare_parts 2024-03-26 17:55:37 +01:00
Nikita Fomichev
e98d6fd24c integration tests: persist pdb history between test runs
Run pytest --pdb. On failure or breakpoint, it will fall back to PDB. Commands written here will be saved to a local file and loaded at the start of the next test run.
2024-03-26 17:55:37 +01:00
Nikita Fomichev
012431c043 integration tests: ClickHouseCluster.get_docker_handle() wait docker frequently and less time 2024-03-26 17:55:37 +01:00
Nikita Fomichev
31cd44457f integration tests: fix flaky tests 2024-03-26 17:55:37 +01:00
robot-clickhouse
bbb14955a6 Automatic style fix 2024-03-26 12:48:01 +00:00
Igor Nikonov
972af33400 Timeout injection 2024-03-26 12:30:16 +00:00
kssenii
14c60dea8e Fix flaky test_broken_projestions/test.py::test_broken_ignored_replicated 2024-03-26 12:19:30 +01:00
Kseniia Sumarokova
fd8e34a0ba
Merge pull request #60452 from ClickHouse/revert-refert-of-broken-projections-handling
Revert "Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling""
2024-03-26 10:34:48 +01:00
robot-clickhouse
cd167cf429 Automatic style fix 2024-03-26 09:15:05 +00:00
Michael Kolupaev
1f0de3de64 Add a test and remove unrelated unused profile events 2024-03-26 09:14:55 +00:00
Max K
b4ed7ded9a
Merge pull request #61778 from ClickHouse/ci_disable_grpc_tests_on_arm
CI: disable grpc tests on ARM
2024-03-25 21:50:58 +01:00
Alexey Milovidov
1928e7d1f6
Merge pull request #60886 from ArctypeZach/master
Add support for `START TRANSACTION` syntax
2024-03-25 21:09:48 +03:00
Yarik Briukhovetskyi
30df4589ed
black check 2024-03-25 18:18:17 +01:00
Yarik Briukhovetskyi
67ba86e7d3
Update test.py 2024-03-25 17:30:01 +01:00
yariks5s
b0cbbe6ec0 fix 2024-03-25 16:24:46 +00:00
Han Fei
61052e17b3 Merge branch 'master' into hanfei/stats_uniq 2024-03-25 17:23:12 +01:00
yariks5s
9227305950 Merge branch 'fix_undrop_query' of github.com:yariks5s/ClickHouse into fix_undrop_query 2024-03-25 16:22:05 +00:00
yariks5s
81bf65c555 fix tests flakiness 2024-03-25 16:14:06 +00:00
kssenii
46941e7243 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-25 15:10:11 +01:00
Pervakov Grigorii
570dc32b07 fix style 2024-03-25 14:09:53 +00:00
Pervakov Grigorii
6b50f5bf10 Reload certificate chain during certificate reload 2024-03-25 14:09:53 +00:00
kssenii
e3d2fb28cf Merge remote-tracking branch 'origin/master' into revert-refert-of-broken-projections-handling 2024-03-25 13:54:39 +01:00
Yarik Briukhovetskyi
8bdbfce43c
Merge branch 'master' into fix_undrop_query 2024-03-25 13:06:46 +01:00
SmitaRKulkarni
a642f4d3ec
Merge pull request #59929 from ClickHouse/Azure_write_buffer
Asynchronous WriteBuffer for AzureBlobStorage
2024-03-25 10:32:56 +01:00
SmitaRKulkarni
f16dffaefc
Merge pull request #61503 from ClickHouse/Azure_read_buffer
Add support of ParallelReadBuffer to ReadBufferFromAzureBlobStorage
2024-03-25 09:51:59 +01:00
Alexey Milovidov
06a9ac7126 Fix tests 2024-03-24 23:23:13 +01:00
Dmitry Novik
64301191b1 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-24 21:07:26 +00:00
Dmitry Novik
67d39a22ac Fix cluster.py 2024-03-24 21:06:13 +00:00
Alexey Milovidov
9210712f4f
Merge pull request #60112 from Unalian/feat-59377
[feature]: allow to attach parts from a different disk
2024-03-24 23:12:43 +03:00
Smita Kulkarni
0d54dbf460 Merge branch 'master' into Azure_write_buffer 2024-03-24 20:09:47 +01:00
Alexey Milovidov
2282213e08
Merge pull request #61816 from fm4v/fix-flaky-tests
Fix flaky tests (stateless, integration)
2024-03-24 19:25:58 +03:00
alesapin
a41c005a6e
Merge branch 'master' into Azure_write_buffer 2024-03-24 15:04:18 +01:00
Alexey Milovidov
008c252a26
Merge pull request #61365 from evillique/fix-attach-on-cluster
Fix ATTACH query with external ON CLUSTER
2024-03-24 04:17:42 +03:00
Nikita Fomichev
f7b100a885 Integration tests: fix flaky tests 2024-03-23 20:01:26 +01:00
Nikita Fomichev
789772caa1 Integration tests: rich exception message raised from ClickHouseInstance.query_with_retry() 2024-03-23 19:44:38 +01:00
Nikita Fomichev
39732174e9 Integration tests: set host user for mysql docker containers
When run pytest locally, tests fail because of `Permission denied: 'logs'`
2024-03-23 16:58:58 +01:00
Smita Kulkarni
19e7022a87 Merge branch 'master' into Azure_write_buffer 2024-03-23 11:48:10 +01:00
Smita Kulkarni
a8238ded09 Merge branch 'master' into Azure_read_buffer 2024-03-23 11:46:32 +01:00
Sean Haynes
dc677f0f18 Use scheduleOrThrow in MergeTree data selector thread pool
At the moment, the use of scheduleOrThrowOnError doesn't currently
have a timeout. So if you reach a point of saturation and use all
threads available in the global pool, threads block infinitely
and lead to a deadlock.

This changes that behaviour so that MergeTree data selector threads
will have a timeout and return a "No threads available" exception
to clients.

Credit to Nikita Mikhaylov for the proposition here:

https://github.com/ClickHouse/ClickHouse/pull/56431
2024-03-22 16:46:20 +00:00
Max Kainov
91e52ebee5 disable mysql57 tests 2024-03-22 16:40:17 +00:00
Nikolay Degterinsky
83ccd2a144 Merge remote-tracking branch 'upstream/master' into fix-attach-on-cluster 2024-03-22 16:06:01 +00:00
Dmitry Novik
df88eb26a5
Merge branch 'master' into enable-analyzer 2024-03-22 15:56:32 +01:00
Max K
57f9e0cbb2
Merge branch 'master' into ci_skip_never_fails_integr_test 2024-03-22 15:55:08 +01:00
Max Kainov
abbbd21b7e CI: disable grpc tests on ARM 2024-03-22 14:28:49 +00:00
Max K
d3965f27c1
Merge pull request #61542 from ClickHouse/ci_arm_support_kerberos
CI: ARM integration test - skip hdfs, kerberos, kafka
2024-03-22 15:25:30 +01:00
Max Kainov
ef0fa1963d CI: use ci-runner as module
#no_merge_commit
 #ci_set_integration
 #batch_0
2024-03-22 14:22:53 +00:00
Anton Popov
887a9ef184 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-22 13:37:46 +00:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Кирилл Гарбар
51ff688f9f Use storage policy to find convert_to_replicated flag path 2024-03-22 16:04:10 +03:00
Dmitry Novik
411c535ac9 Fix integration tests 2024-03-22 13:59:44 +01:00
Han Fei
a367e07ae9 Merge branch 'master' into hanfei/stats_uniq 2024-03-22 12:48:39 +01:00
Alexey Milovidov
09c252f438
Update ci-runner.py 2024-03-22 04:17:24 +03:00
Alexey Milovidov
b91d478c93 There is no such thing as broken tests 2024-03-22 00:56:57 +01:00
robot-clickhouse
50bc8acc37 Automatic style fix 2024-03-21 21:26:53 +00:00
SmitaRKulkarni
3822e41f7d
Merge a2836b0887 into 30df0fcd60 2024-03-21 21:17:57 +00:00
Smita Kulkarni
3f653bbc32 Added test with log check 2024-03-21 20:28:52 +01:00
yariks5s
6a19b77d9e init 2024-03-21 18:39:05 +00:00
Vitaly Baranov
1acc0ebe79
Merge pull request #61356 from vitlibar/fix-replace-dictionary
Fix CREATE OR REPLACE DICTIONARY
2024-03-21 16:45:06 +01:00
Dmitry Novik
e4209218d4
Merge pull request #60497 from ClickHouse/analyzer-distr-json
Analyzer: Support different ObjectJSON on shards
2024-03-21 16:25:30 +01:00
Smita Kulkarni
71eee6a300 Merge branch 'master' into Azure_write_buffer 2024-03-21 16:22:28 +01:00
Alexander Tokmakov
2be2ca4605
Merge pull request #61105 from ClickHouse/fix_rdb_active
Fix removing is_active node after re-creation
2024-03-21 15:29:59 +01:00
Dmitry Novik
188bc3cbaf Update some tests 2024-03-21 15:00:27 +01:00
Smita Kulkarni
6c5e881da7 Merge branch 'master' into Azure_write_buffer 2024-03-21 11:12:19 +01:00
Max Kainov
9f3c625ab5 fix mysql client tests to use mysql8 image
#ci_set_integration
 #ci_set_arm
2024-03-20 17:35:11 +00:00
Max Kainov
55737de0e6 disable more hdfs and kafka inttests
#ci_set_arm
2024-03-20 17:24:55 +00:00
Max K
984c7e69a0 disable test_allowed_url_with_config tests with HDFS
#no_merge_commit
 #ci_set_arm
2024-03-20 17:24:55 +00:00
Max Kainov
7b8c5f35b5 disable test_strage_hdfs module
#ci_set_arm
 #batch_2
 #no_merge_commit
2024-03-20 17:24:55 +00:00
Max Kainov
4f273c60c3 CI: disable some kerberos and hdfs integration tests for arm
#ci_set_arm
 #batch_2
 #no_merge_commit
2024-03-20 17:24:55 +00:00
Robert Schulze
35cc335597
Revert "Un-flake test_undrop_query" 2024-03-20 18:04:35 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker
CI: remove compose files from integration test docker
2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker
#ci_set_integration
2024-03-20 14:11:47 +00:00
Dmitry Novik
b74a0359e5 Update integration tests 2024-03-20 13:43:18 +01:00
Dmitry Novik
f0e7b78f8b Inverse analyzer in tests 2024-03-20 13:35:30 +01:00
Smita Kulkarni
9f2d44fc65 Merge branch 'master' into Azure_write_buffer 2024-03-20 11:02:48 +01:00
vdimir
9a43f7941b
Merge pull request #61456 from kitaisreal/temporary-data-use-temporary-files-codec-setting
Temporary data use temporary_files_codec setting
2024-03-20 10:54:17 +01:00
Kseniia Sumarokova
05516112ca
Merge pull request #61537 from ClickHouse/s3queue-disallow-sharded-processing
Disallow s3queue sharded mode
2024-03-20 10:53:51 +01:00
Han Fei
b2ceeba0f2 Merge branch 'master' into hanfei/stats_uniq 2024-03-19 23:47:08 +01:00
Alexander Tokmakov
02d5c4625f Merge branch 'master' into fix_rdb_active 2024-03-19 21:09:07 +01:00
kssenii
0122c3e883 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-19 19:31:02 +01:00
Alexander Tokmakov
1c61ef7155 Merge branch 'master' into start-transaction 2024-03-19 19:30:26 +01:00
vdimir
b19540f5b6
Fix style tests/integration/test_temporary_data_in_cache/test.py 2024-03-19 19:03:20 +01:00
Dmitry Novik
302179c81d Merge remote-tracking branch 'origin/master' into analyzer-distr-json 2024-03-19 18:56:04 +01:00
Maksim Kita
764c72b6c9 Fixed code review issues 2024-03-19 20:41:39 +03:00
Smita Kulkarni
824092b619 Updated to use single part upload for single block of small size and fixed test fail 2024-03-19 18:38:02 +01:00
Kseniia Sumarokova
7ebab45bef
Update users.xml 2024-03-19 17:21:03 +01:00
Kseniia Sumarokova
574647ed2a
Update config for another test 2024-03-19 17:16:53 +01:00
Nikolay Degterinsky
ce11428764 Merge remote-tracking branch 'upstream/master' into fix-test 2024-03-19 14:53:09 +00:00
robot-ch-test-poll4
a07d214fbf
Merge pull request #61396 from Algunenano/default_cluster
Remove default cluster from default config from test config
2024-03-19 13:58:01 +01:00
János Benjamin Antal
9cd7e6155c
Merge pull request #60031 from azat/merge_tree_mutations_cleanup-fix
Fix finished_mutations_to_keep=0 for MergeTree (as docs says 0 is to keep everything)
2024-03-19 12:55:46 +01:00
János Benjamin Antal
7adf585460
Merge pull request #61236 from ClickHouse/fix-flaky-test-merge-tree-load-parts-corrupted
Fix `test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted`
2024-03-19 12:02:19 +01:00
János Benjamin Antal
a1eb8e4bae
Merge pull request #61235 from ClickHouse/improve-test-failed-mutations
Improve `test_failed_mutations`
2024-03-19 11:58:39 +01:00
kssenii
12cd566681 Update config for test 2024-03-19 11:47:53 +01:00
Anton Popov
5ac15574b7 do not load marks on merges 2024-03-18 20:28:10 +00:00
Raúl Marín
0637da0339 Merge remote-tracking branch 'blessed/master' into default_cluster 2024-03-18 16:11:50 +01:00
Raúl Marín
6b19c5ea75 Fix integration tests 2024-03-18 16:07:10 +01:00
Raúl Marín
53159070b5 Remove default cluster in tests 2024-03-18 15:52:16 +01:00
Han Fei
8a54c85f3c
Merge pull request #61049 from hanfei1991/hanfei/check-limit-periodically
Check cgroups memory limit update periodically
2024-03-18 15:15:46 +01:00
Dmitry Novik
15e19206b4 Merge remote-tracking branch 'origin/master' into analyzer-distr-json-copy 2024-03-18 14:24:51 +01:00
János Benjamin Antal
4a1ce10c20 Merge remote-tracking branch 'origin/master' into fix-flaky-test-merge-tree-load-parts-corrupted 2024-03-18 10:36:36 +00:00
János Benjamin Antal
6ba073861d Merge remote-tracking branch 'origin/master' into improve-test-failed-mutations 2024-03-18 10:35:38 +00:00
alesapin
0faf4eacb8
Merge pull request #61299 from ClickHouse/merge_config
Add ability to merge includes for config preprocessor for configs
2024-03-18 11:22:42 +01:00
Robert Schulze
eb26bb2a1c
Merge pull request #61348 from rschu1ze/flaky-test_uncrop_query
Un-flake `test_undrop_query`
2024-03-18 08:56:22 +01:00
Alexey Milovidov
cb8d859453
Merge branch 'master' into analyzer-distr-json 2024-03-17 15:15:06 +03:00
jsc0218
1676cf6dd3 fix test 2024-03-16 22:18:42 +00:00
Alexey Milovidov
24e77a6b5a
Merge pull request #61477 from CurtizJ/fix-test-polymorphic-parts
Fix test `test_polymorphic_parts`
2024-03-16 13:51:06 +03:00
Anton Popov
bc6cd6e769 fix test_polymorphic_parts 2024-03-15 22:32:04 +00:00
Han Fei
e1730c070e fix style 2024-03-15 21:00:42 +01:00
Han Fei
694f5416b9 refine tests 2024-03-15 16:32:57 +01:00
Robert Schulze
f132eef63b
Merge remote-tracking branch 'rschu1ze/master' into flaky-test_uncrop_query 2024-03-15 15:12:58 +00:00
Kruglov Pavel
d045ab150e
Merge pull request #61362 from ClickHouse/revert-61359-revert-61234-Avogar-patch-2
Revert "Revert "Fix usage of session_token in S3 engine""
2024-03-15 16:00:05 +01:00
Max K
ff456ffb33
Revert "CI: ARM integration tests: disable tests with HDFS " 2024-03-15 15:08:03 +01:00
robot-ch-test-poll
2b93606ddd
Merge pull request #61182 from ClickHouse/ci_fix_arm_integration_tests_2
CI: ARM integration tests: disable tests with HDFS
2024-03-15 14:53:52 +01:00
Max Kainov
bf8ae84cb6 fixup! CI: skip hdfs tests for arm #do_not_test #batch_0 #no_merge_commit 2024-03-15 13:43:03 +00:00
alesapin
38cd6ef27d Merge branch 'master' into merge_config 2024-03-15 13:52:52 +01:00
Kruglov Pavel
fef38bded1
Merge pull request #61395 from Avogar/fox-test-clusters-actual-information
Fix test test_system_clusters_actual_information flakiness
2024-03-15 12:33:46 +01:00
Vitaly Baranov
f55e4f8f28 Add test. 2024-03-15 12:03:23 +01:00
Max Kainov
e8b3cc2851 CI: skip hdfs tests for arm
#do_not_test
 #batch_0
 #no_merge_commit

 #ci_set_arm
2024-03-14 20:19:10 +00:00
Kruglov Pavel
e8da3bb2eb
Fix style 2024-03-14 19:06:02 +01:00
avogar
a6f1e09e69 Test test test_system_clusters_actual_information flakiness 2024-03-14 17:35:10 +00:00
Nikolay Degterinsky
b064cff245 Fix test_failed_async_inserts 2024-03-14 16:57:17 +00:00
Dmitry Novik
90669ef487 Merge remote-tracking branch 'origin/master' into analyzer-distr-json 2024-03-14 17:43:26 +01:00
Kruglov Pavel
107acf54c6
Fix tests 2024-03-14 13:42:07 +01:00
vdimir
0b97f3ac16
Merge pull request #61320 from ClickHouse/vdimir/fix_rabbitmq_logical_error
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-14 13:28:05 +01:00
Kruglov Pavel
6ac6c49d55
Merge pull request #61314 from Avogar/fix-test-distributed-settings
Don't use default cluster in test test_distibuted_settings
2024-03-14 13:00:27 +01:00
Nikolay Degterinsky
a0044f3aa4 Fix ATTACH query with external ON CLUSTER 2024-03-14 11:44:35 +00:00
Kruglov Pavel
0569f44186
Merge pull request #61322 from Avogar/fix-parallel-parsing-memory-tracking-test
Fix test test_input_format_parallel_parsing_memory_tracking
2024-03-14 12:23:04 +01:00
jsc0218
b3b46ea708 Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-03-14 00:36:29 +00:00
Robert Schulze
bd6bed161c
Try to fix flaky test_undrop_query 2024-03-13 20:56:42 +00:00
avogar
4670f05564 Fix test test_input_format_parallel_parsing_memory_tracking 2024-03-13 17:18:13 +00:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns 2024-03-13 16:41:35 +00:00
kssenii
5b15ec6ae1 Move test from stateless to integration 2024-03-13 17:10:55 +01:00
avogar
868d24415b Fix style 2024-03-13 15:48:29 +00:00
avogar
a366acf59c Don't use default cluster in test test_distibuted_settings 2024-03-13 15:36:53 +00:00
Kseniia Sumarokova
893ea7e4fe
Merge pull request #60396 from ClickHouse/fix-usage-of-plain-metadata
Fix usage of plain metadata type with new disks configuration option
2024-03-13 14:18:36 +01:00
robot-clickhouse
24626d431c Automatic style fix 2024-03-13 12:35:27 +00:00
alesapin
6203d45b96 working version with comments 2024-03-13 13:12:48 +01:00
Konstantin Bogdanov
a704ea510a
Fix test_placement_info (#61057)
* Fix test

* Fix last minute changes

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-03-13 12:03:42 +01:00
kssenii
4a3c740e7e Merge remote-tracking branch 'origin/master' into make-rabbitmq-reject-broken-messages 2024-03-13 11:22:21 +01:00
alesapin
a8028b0bdc Merge branch 'master' into merge_config 2024-03-13 10:39:28 +01:00
Alexander Sapin
47dfefd6b3 config substitutions 2024-03-13 10:37:51 +01:00
Han Fei
cb3ffc6f1a fix style 2024-03-13 07:28:41 +01:00
Han Fei
044eed8d82 fix style 2024-03-13 06:40:47 +01:00
unashi
c78224c2ff Merge branch 'master' into feat-59377 2024-03-13 11:24:00 +08:00
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
kssenii
c947484fe0 Fxi again 2024-03-12 19:36:10 +01:00
Kseniia Sumarokova
f7ac982a6b
Merge branch 'master' into use-iobject-storage-for-table-engines-1 2024-03-12 15:18:19 +01:00
János Benjamin Antal
f63970769b Make test less flaky 2024-03-12 12:23:09 +00:00
robot-clickhouse
e9ef18c3ac Automatic style fix 2024-03-12 11:54:56 +00:00
János Benjamin Antal
aa9b5741e1 Improve tests 2024-03-12 11:43:08 +00:00
robot-clickhouse
4ce5245157 Automatic style fix 2024-03-12 11:03:39 +00:00
Kseniia Sumarokova
61543edc8b
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-12 11:53:00 +01:00
alesapin
ed22c4c86e
Merge pull request #61136 from azat/tests/fix-test_distributed_directory_monitor_split_batch_on_failure
Fix test_distributed_directory_monitor_split_batch_on_failure flakienss
2024-03-12 11:39:04 +01:00
Azat Khuzhin
4bd6d4456e Fix expectations for test_all_projection_files_are_dropped_when_part_is_dropped
Since after DROP PART mutations are not cleaned anymore.

Here an example:

                objects_at_the_end = list_objects(cluster)
    >           assert objects_at_the_end == objects_empty_table
    E           AssertionError: assert ['data/evt/iczupcswcatzvjikqwmovahturdht', 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'] == ['data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs']
    E             At index 0 diff: 'data/evt/iczupcswcatzvjikqwmovahturdht' != 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'
    E             Left contains one more item: 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'
    E             Full diff:
    E               [
    E             +  'data/evt/iczupcswcatzvjikqwmovahturdht',
    E                'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs',
    E               ]

    test_replicated_zero_copy_projection_mutation/test.py:155: AssertionError

And decoded paths:

    node1 :) select local_path from system.blob_storage_log where remote_path = 'data/evt/iczupcswcatzvjikqwmovahturdht'

    SELECT local_path
    FROM system.blob_storage_log
    WHERE remote_path = 'data/evt/iczupcswcatzvjikqwmovahturdht'

    Query id: 9ee5a9c0-c3b7-46ad-82bd-64c8bcbda78d

    ┌─local_path────────────────────────────────────────────────────────┐
    │ store/bce/bcea71c9-35cd-4368-9504-c563253b1964/tmp_mutation_1.txt │
    │ store/bce/bcea71c9-35cd-4368-9504-c563253b1964/mutation_1.txt     │
    └───────────────────────────────────────────────────────────────────┘

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
kssenii
5a71636411 Fxi 2024-03-11 19:44:52 +01:00
Nikita Mikhaylov
fcf8a3821d Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 19:12:49 +01:00
Kseniia Sumarokova
38ba6990bb
Merge branch 'master' into use-iobject-storage-for-table-engines-1 2024-03-11 18:47:56 +01:00