thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-12 18:45:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
146,862 Commits 9,123 Branches 1,774 Tags 2 GiB
90142b73ad
Commit Graph

472 Commits

Author SHA1 Message Date
SmitaRKulkarni
951d9ac144
Disable randomization of allow_experimental_block_number_column flag (#56474) 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-11-13 15:44:06 +01:00
Kseniia Sumarokova
e428e4ed7a
Merge branch 'master' into cache-config-improvement 2023-11-13 10:09:58 +01:00
kssenii
c28c1ac4a2 Allow getting cache configuration from named collection 2023-11-09 18:39:16 +01:00
Salvatore Mesoraca
7d206cbc3c
NamedCollections: prevent fields overriding in functions call 
Add syntax in SQL and XML to mark specific fields to allow
override or not.
Also add a new setting to control the default behaviour when
overriding support is not specified.
 2023-11-09 17:25:16 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci 
Randomize block_number column setting in ci
 2023-10-30 12:30:51 +01:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Smita Kulkarni
7f05b3d546 Added comment in merge_tree_settings.xml 2023-10-26 10:43:01 +02:00
Smita Kulkarni
7a3fdc149e Fix typo 2023-10-23 17:00:23 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
Smita Kulkarni
c98782bd2b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 14:47:17 +02:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702) 
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
 2023-10-20 11:38:44 +02:00
Smita Kulkarni
13ffebf559 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-14 20:08:49 +02:00
Smita Kulkarni
8b54172983 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-12 12:32:43 +02:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Smita Kulkarni
c11aa4515b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-09-24 11:52:57 +02:00
Smita Kulkarni
ca07275143 Support compression for keeper protocol 2023-09-24 11:38:08 +02:00
Antonio Andelic
7ffe998f1d Randomize settings 2023-09-18 11:13:32 +00:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Vitaly Baranov
988fd9e208 Add test. 2023-09-05 00:51:43 +02:00
Antonio Andelic
365bc584ec Merge branch 'master' into keeper-batch-flushes 2023-09-04 07:24:21 +00:00
Alexey Milovidov
7cb4d52d92 Deprecate metadata cache, part 2 2023-09-03 03:56:11 +02:00
Sergei Trifonov
cf5ea46713
Merge pull request #53338 from azat/throttling-fixes 
Fix IO throttling during copying whole directories
 2023-09-01 18:29:15 +02:00
Antonio Andelic
dd824fe558 Merge branch 'master' into keeper-batch-flushes 2023-08-31 14:35:36 +00:00
Azat Khuzhin
ed401cba9b Add a test for IO throttling for ALTER TABLE MOVE PARTITION TO VOLUME 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-29 23:43:03 +02:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Antonio Andelic
322b53dd62 Merge branch 'master' into keeper-batch-flushes 2023-08-24 09:08:47 +00:00
Antonio Andelic
59557ddd7c Merge branch 'master' into keeper-batch-flushes 2023-08-23 08:11:43 +00:00
kssenii
951081c8fb Merge remote-tracking branch 'upstream/master' into fix-upgrade-check 2023-08-21 19:28:19 +02:00
kssenii
307e5d6b9b Fix 2023-08-20 10:37:20 +02:00
Igor Nikonov
a69ea02418 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-19 21:43:25 +00:00
Kseniia Sumarokova
6270c6aaa8
Update s3_storage_policy_by_default.xml 2023-08-12 18:51:16 +04:00
kssenii
84471778f1 Fux 2023-08-09 11:10:38 +02:00
kssenii
2cfb4c0264 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-09 11:09:34 +02:00
Antonio Andelic
ef3e0f7b83 Use async replication in tests 2023-08-09 06:25:47 +00:00
kssenii
2d197dfbf7 Fix 2023-08-08 12:03:01 +02:00
kssenii
0c174a7ec1 Allow to restrict fs caches paths 2023-08-07 18:00:26 +02:00
Igor Nikonov
a8b782ca5a Parallel reading from replicas over disributed with several shards 2023-08-05 23:19:09 +00:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Kseniia Sumarokova
97c1b9d2cf
Merge branch 'master' into kssenii-patch-6 2023-07-21 13:56:28 +02:00
Nikita Mikhaylov
4a3f5234af
Merge pull request #51038 from evillique/headers-blacklist 
Add HTTP header filtering
 2023-07-19 15:49:12 +02:00
Nikita Mikhaylov
ee0bbc0e54
Merge branch 'master' into headers-blacklist 2023-07-17 19:08:52 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
kssenii
09d8ca0a40 Update 2023-07-17 11:30:21 +02:00
kssenii
9d645488c6 Merge remote-tracking branch 'upstream/master' into fix-assertions-4 2023-07-17 11:29:37 +02:00
Vitaly Baranov
2f23b6a593
Merge branch 'master' into backups-native-copy 2023-07-15 08:40:17 +02:00
Azat Khuzhin
2db092f9d8 Cleanup remote_servers in dist config.xml 
At first, there was no such amount of clusters in dist config, they
added when someone need to write some new cluster for tests.

So let's move them to the clusters.xml that is deployed only for tests,
and leave only default cluster.

And cleanup also some configs that had been copied from dist config in
the repo (about test_config_* integration tests, this should be OK,
since there are more_clusters.xml as well, that covers additional
cases).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-09 16:55:27 +02:00
Azat Khuzhin
00cf66ab7a Add ability to disable native copy for BACKUP/RESTORE 
Native copy uses CopyObject for S3/GCS, but in GCS the CopyObject is
buggy - it does not always works.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-09 08:19:10 +02:00
Nikolay Degterinsky
e98d136243
Merge branch 'master' into headers-blacklist 2023-07-07 04:44:06 +02:00
Alexander Sapin
da61a8c509 Fix 2023-07-06 17:16:00 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Kseniia Sumarokova
244b30d659
Merge branch 'master' into resubmit-51149 2023-07-05 12:12:21 +02:00
kssenii
e5fa845dd3 Fix 2023-07-05 12:11:08 +02:00
Kseniia Sumarokova
e42d78ebfe
Merge branch 'master' into fix-assertions-4 2023-07-05 12:02:49 +02:00
Alexey Milovidov
3371e038cf
Merge pull request #51498 from ClickHouse/vdimir/test_alter_moving_garbage_51342 
Fix `test_alter_moving_garbage`: lock between getActiveContainingPart and swapActivePart in parts mover
 2023-07-05 00:32:21 +03:00
kssenii
3646b36a08 Merge remote-tracking branch 'upstream/master' into fix-assertions-4 2023-07-03 15:02:06 +02:00
Kseniia Sumarokova
19508a01a5
Merge branch 'master' into resubmit-51149 2023-07-03 13:12:53 +02:00
Nikolay Degterinsky
8dfa773f44
Merge branch 'master' into headers-blacklist 2023-06-30 23:40:17 +02:00
Alexey Milovidov
068b2b6ab9
Merge branch 'master' into vdimir/test_alter_moving_garbage_51342 2023-06-29 23:12:25 +03:00
Antonio Andelic
6e1aec6e0b
Merge branch 'master' into keeper-add-api-version-config 2023-06-29 11:36:49 +02:00
Alexey Milovidov
a4d7e48bc9
Merge branch 'master' into resubmit-51149 2023-06-29 11:07:01 +03:00
Antonio Andelic
0320ab4a70
Try making Keeper in DatabaseReplicated tests more stable (#51473) 
* Try making Keeper in DatabaseReplicated less flaky

* lower log level to debug

* Revert back to information
 2023-06-28 13:16:16 +03:00
vdimir
79b6792548
Enable allow_remove_stale_moving_parts for stateless tests 2023-06-27 17:15:11 +00:00
Antonio Andelic
efbe01b6bb Merge branch 'master' into keeper-add-api-version-config 2023-06-27 10:11:04 +00:00
kssenii
b3ce64caa5 Fix tests 2023-06-22 12:55:05 +02:00
kssenii
0efaecab51 Revert "Merge pull request #51149 from ClickHouse/revert-48821-localfilefunction" 
This reverts commit a09e6bbb8e, reversing
changes made to ce38d64c5a.
 2023-06-21 00:29:46 +02:00
Alexander Tokmakov
f973bd7516 suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling 
Improve scheduling of background tasks in ReplicatedMergeTree
 2023-06-20 16:25:19 +03:00
Alexander Tokmakov
caceb7c862
Revert "Added ability to implicitly use file/hdfs/s3 table functions in clickhouse-local" 2023-06-19 13:21:09 +03:00
Alexander Tokmakov
b4e455430c
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
Alexey Milovidov
df9abccfaa
Merge branch 'master' into localfilefunction 2023-06-17 00:45:54 +03:00
Nikolay Degterinsky
9a25958be8 Add HTTP header filtering 2023-06-15 13:49:49 +00:00
Antonio Andelic
4ac090b122 Fix tests 2023-06-13 11:01:44 +00:00
Alexander Tokmakov
d2aa1779ed Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-07 14:58:50 +02:00
Alexander Tokmakov
4209ccfc08 fix 2023-06-02 17:42:04 +02:00
Alexander Tokmakov
d8f936987e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-25 12:36:41 +02:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780) 
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-05-25 12:50:14 +03:00
Alexander Tokmakov
b8305503d8 more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
alekseygolub
70b9077bb2
Merge branch 'ClickHouse:master' into localfilefunction 2023-05-21 17:49:29 +03:00
Alexey Milovidov
4dbe5b8329 Support them in tests 2023-05-19 11:13:28 +02:00
Kseniia Sumarokova
8c0b634a64
Update storage_conf.xml 2023-05-07 14:38:27 +02:00
Kseniia Sumarokova
431b2e94a9
Update storage_conf.xml 2023-05-05 19:10:12 +02:00
kssenii
9032e23f87 Clean up storage_conf.xml, use dynamic disks for tests 2023-05-05 15:43:23 +02:00
alekseygolub
963d6be120 Added configurations for DatabaseS3 2023-05-04 16:44:08 +00:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage 
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
 2023-05-04 11:47:43 +02:00
Kseniia Sumarokova
b00c859838
Merge branch 'master' into kssenii-patch-6 2023-05-01 12:24:39 +02:00
Alexey Milovidov
911d4e9977
Merge branch 'master' into fix_some_tests3 2023-04-28 17:23:46 +03:00
kssenii
298ed454ce Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-28 13:26:55 +02:00
kssenii
9374666c0c Deprecetae local object storage on fake metadata storage 2023-04-15 13:53:11 +02:00
Alexander Tokmakov
70c1000c22 fix some tests 2023-04-14 19:42:17 +02:00
Kseniia Sumarokova
d04a19e160
Merge branch 'master' into kssenii-patch-6 2023-04-14 13:15:34 +02:00
kssenii
09c23287aa Merge remote-tracking branch 'upstream/master' into cache-better-locks 2023-04-13 13:25:45 +02:00
kssenii
8b98701edc Remove unfixably flaky test 2023-04-06 22:04:43 +02:00
kssenii
a405d06e8a Merge remote-tracking branch 'upstream/master' into cache-better-locks 2023-04-05 18:46:52 +02:00
Kseniia Sumarokova
b3854b09dc
Fix outdated cache configuration in tests s3_storage_policy_by_default.xml 2023-04-05 14:33:34 +02:00
Azat Khuzhin
218b1f9c29 Add ability to throttle BACKUPs on per-server/backup basis 
Server settings:
- backup_read_bandwidth_for_server
- backup_write_bandwidth_for_server

Query settings:
- backup_read_bandwidth
- backup_write_bandwidth

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-05 09:39:48 +02:00
Antonio Andelic
f31f11dd67 Disable env credentials for stateless tests 2023-03-31 09:12:41 +00:00
kssenii
9acbcb5d50 Make max_size less in CI (for more pressure on cache) 2023-03-29 15:34:00 +02:00
kssenii
4cf2862a0e Merge remote-tracking branch 'upstream/master' into cache-better-locks 2023-03-29 12:50:36 +02:00
kssenii
88f631b297 Review fixes, perform delayed removal in background 2023-03-26 16:53:33 +02:00
Raúl Marín
bf7b0c5cfe Different approach to inject timeouts 2023-03-24 17:12:14 +01:00
Antonio Andelic
0ad436aa2c Revert debug changes 2023-03-09 08:07:59 +00:00
Antonio Andelic
37b09ce46a add back trace log 2023-03-07 12:16:01 +00:00
Antonio Andelic
cda4ff0df7 Remove trace logs 2023-03-01 19:54:22 +00:00
Antonio Andelic
32c198be45 trace raft logs 2023-03-01 12:47:31 +00:00
alesapin
3f2afa1fa0 Temporary enable force_sync for keeper in CI 2023-02-28 15:28:17 +01:00
Vitaly Baranov
39bacfb9dc
Merge branch 'master' into allow-single-disk-instead-of-storage-policy 2023-02-09 13:16:55 +01:00
kssenii
a391de18a1 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-02-02 20:49:41 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Nikita Taranov
fdea042991
Add delete by ttl for zookeeper_log (#45419) 2023-01-19 13:42:16 +01:00
kssenii
2a030c1dc0 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-01-06 15:58:27 +01:00
kssenii
67509aa2d5 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2023-01-03 16:41:30 +01:00
alesapin
93b9d0a8a6
Revert strange change 2022-12-27 12:52:03 +01:00
Alexey Milovidov
91c1f9de8f Faster server startup after stress test 2022-12-26 18:13:50 +01:00
kssenii
853f2ea123 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-23 11:49:02 +01:00
kssenii
4cd4d2cc07 Fix test 2022-12-18 16:14:56 +01:00
kssenii
30547d2dcd Replace old named collections code for url 2022-12-17 00:24:05 +01:00
Kseniia Sumarokova
d3fed3b96a
Update storage_conf.xml 2022-12-15 22:40:04 +01:00
kssenii
dfefd8dfcd Fix write-throw-cache possible write finish 2022-12-15 19:58:54 +01:00
kssenii
ea5b06023a Merge remote-tracking branch 'refs/remotes/upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-14 13:59:51 +01:00
alesapin
d2f076768f Remove leftovers 2022-12-08 23:21:44 +01:00
kssenii
d278a0dbfb Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-05 12:59:44 +01:00
Nikita Taranov
8ed5cfc265
Memory bound merging for distributed aggregation in order (#40879) 
* impl

* fix style

* make executeQueryWithParallelReplicas similar to executeQuery

* impl for parallel replicas

* cleaner code for remote sorting properties

* update test

* fix

* handle when nodes of old versions participate

* small fixes

* temporary enable for testing

* fix after merge

* Revert "temporary enable for testing"

This reverts commit cce7f8884c.

* review fixes

* add bc test

* Update src/Core/Settings.h
 2022-11-28 00:41:31 +01:00
alesapin
e7717d7407 Enable compressed marks in CI 2022-11-18 15:54:22 +01:00
kssenii
50c4beeef6 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-11-08 14:45:42 +01:00
kssenii
b5b25c2676 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-11-07 17:02:41 +01:00
Vladimir C
0481999e35 Fix displayName test, add doc 2022-11-07 14:34:47 +01:00
Vladimir C
136f589343 Set display_name in functional tests 2022-11-07 14:34:47 +01:00
kssenii
301c7c90ef Add local disk path restriction 2022-10-21 23:59:53 +02:00
KinderRiven
32cf2c7623 add test for bypass_cache_threshold 2022-10-19 06:54:09 +00:00
Alexey Milovidov
59b37bf4a0
Merge pull request #40684 from ClickHouse/add-missing-tests-geobase 
Add missing tests for legacy geobase
 2022-09-28 14:08:30 +03:00
Alexey Milovidov
fcd443f0e3
Merge branch 'master' into add-missing-tests-geobase 2022-09-28 01:58:02 +03:00
Kseniia Sumarokova
134157df3d
Update storage_conf.xml 2022-09-27 22:42:39 +02:00
alesapin
34d9794ab7
Merge pull request #41653 from ClickHouse/investigating_more_bugs 
Add very explicit logging on disk choice for fetch
 2022-09-24 16:15:02 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
Kseniia Sumarokova
133446a404
Update storage_conf.xml 2022-09-22 17:00:48 +02:00
kssenii
f038c7ea00 Better config for cache 2022-09-22 14:50:29 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Antonio Andelic
baf7255cff
Merge pull request #39976 from ClickHouse/keeper-storage 
KeeperMap storage engine
 2022-09-13 14:15:09 +02:00
Alexander Tokmakov
4d146b05a9
Merge pull request #38262 from PolyProgrammist/fix-ordinary-system-unfreeze 
Fix SYSTEM UNFREEZE for ordinary database
 2022-09-13 14:55:11 +03:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Antonio Andelic
1cd43d8e5c Merge branch 'master' into keeper-storage 2022-09-12 13:42:51 +00:00
Alexey Milovidov
61278c81e4 Merge branch 'master' into remove-useless-line 2022-09-10 05:07:10 +02:00
Antonio Andelic
32483aeec8 Merge branch 'master' into keeper-storage 2022-09-09 12:24:01 +00:00
Sergei Trifonov
6217559175
Merge branch 'master' into readonly-settings-allow 2022-09-06 16:10:48 +02:00
ianton-ru
39e1fc7a0f
Merge branch 'master' into fix-ordinary-system-unfreeze 2022-09-05 17:10:59 +03:00
Alexey Milovidov
0e5c94ce80 Merge branch 'master' into add-missing-tests-geobase 2022-09-04 03:32:29 +02:00
Alexey Milovidov
13a129bee7 Merge branch 'master' into remove-useless-line 2022-09-04 03:24:40 +02:00