thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 19:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
118,051 Commits 9,190 Branches 1,782 Tags 2.2 GiB
22c8f1c0be
Commit Graph

6695 Commits

Author SHA1 Message Date
alesapin
934df5e5bb Rename to AzureBlobStorage 2023-06-06 19:44:41 +02:00
alesapin
d902592703 Fix new tests 2023-06-06 19:38:15 +02:00
alesapin
454c23fecb Merge branch 'azure_table_function' of github.com:ClickHouse/ClickHouse into azure_table_function 2023-06-06 19:34:22 +02:00
alesapin
7100bc5152 Fixes for azure table function 2023-06-06 19:31:50 +02:00
Smita Kulkarni
6a96cf441e Renamed to azure_blob_storage 2023-06-06 19:19:17 +02:00
robot-clickhouse
ae97f45c1c Automatic style fix 2023-06-06 17:10:48 +00:00
alesapin
a6185da220 Merge branch 'azure_table_function' of github.com:ClickHouse/ClickHouse into azure_table_function 2023-06-06 18:50:51 +02:00
alesapin
e76a7022fc Add some tests 2023-06-06 18:50:45 +02:00
robot-clickhouse
3bda231203 Automatic style fix 2023-06-06 15:11:21 +00:00
alesapin
14470b46c7 Merge branch 'azure_table_function' of github.com:ClickHouse/ClickHouse into azure_table_function 2023-06-06 16:58:05 +02:00
alesapin
ebae79f7d4 Schema inference 2023-06-06 16:57:51 +02:00
robot-clickhouse
e054fbccd8 Automatic style fix 2023-06-06 13:09:53 +00:00
alesapin
6caf8080b0 Merge branch 'azure_table_function' of github.com:ClickHouse/ClickHouse into azure_table_function 2023-06-06 14:55:56 +02:00
alesapin
a1f3bd9e23 Fix reads 2023-06-06 14:55:17 +02:00
robot-clickhouse
18decb090c Automatic style fix 2023-06-06 11:11:50 +00:00
alesapin
d497562a07 Copy and paste 2023-06-06 13:01:21 +02:00
alesapin
8028184e30 Fix read 2023-06-06 12:27:40 +02:00
Michael Kolupaev
9f80900d6f Changes related to an internal feature 2023-06-05 18:20:38 -07:00
robot-clickhouse
cf9936ad32 Automatic style fix 2023-06-05 23:58:43 +00:00
Nikolay Degterinsky
ad85faabd1 Fix test 2023-06-05 17:58:56 +00:00
Alexander Sapin
bc8ee56a19 Support settings, test truncate 2023-06-05 14:46:52 +02:00
Alexander Sapin
2866bac089 Add named collections and remove host filter support 2023-06-05 14:03:19 +02:00
Alexander Sapin
c9c9e1e969 Merge branch 'master' into azure 2023-06-05 12:19:29 +02:00
Alexey Milovidov
afdf7eaed7
Merge pull request #50558 from ClickHouse/remove-flaky-test 
Remove flaky test
 2023-06-05 11:14:03 +03:00
Alexey Milovidov
3b8c781b2c
Merge pull request #50448 from ClickHouse/rm_parts_from_zk_paranoid 
Paranoid fix for removing parts from ZooKeeper
 2023-06-05 04:42:15 +03:00
Alexey Milovidov
af1c025496
Merge pull request #50480 from Avogar/try-fix-flaky-test 
Try fix flaky test test_async_query_sending
 2023-06-05 04:40:17 +03:00
Alexey Milovidov
112826a666
Merge pull request #50485 from ClickHouse/remove-keeper-test 
Remove unneeded Keeper test
 2023-06-05 04:37:03 +03:00
Alexey Milovidov
4234c4f36a Remove flaky test 2023-06-05 02:51:11 +02:00
alesapin
8d8d06285f Add integration test 2023-06-04 18:59:22 +02:00
Alexey Milovidov
c84c0be1a7
Merge branch 'master' into try-fix-flaky-test 2023-06-04 05:06:40 +03:00
pufit
1aaac69e13
Merge branch 'master' into roles_in_config 2023-06-03 14:42:10 -04:00
Alexey Milovidov
8018e58b74
Merge pull request #49894 from evillique/postgresql-uuid 
Add UUID data type to PostgreSQL
 2023-06-03 07:13:41 +03:00
Nikita Mikhaylov
362055ce60
Merge branch 'master' into 46229-repl-clickhouse-keeper 2023-06-02 23:58:07 +02:00
Alexander Tokmakov
4209ccfc08 fix 2023-06-02 17:42:04 +02:00
Antonio Andelic
ae497d398a Remove unneeded test 2023-06-02 14:23:04 +00:00
avogar
d9a4f8115f Add new line delimiter 2023-06-02 13:19:41 +00:00
avogar
8e076c33d5 Try fix flaky test test_async_query_sending 2023-06-02 13:19:13 +00:00
Alexander Tokmakov
e148c60d5a
Fixes for MergeTree with readonly disks (#50244) 
* fixes for MergeTree with readonly disks

* Automatic style fix

* Update test.py

* Automatic style fix

* Update test.py

* Update test.py

* Automatic style fix

* Update test.py

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-06-02 16:18:32 +03:00
Kruglov Pavel
9922053419
Merge pull request #49948 from Avogar/handshake-timeout 
Add separate handshake_timeout for receiving Hello packet from replica
 2023-06-02 14:07:27 +02:00
JackyWoo
119c2200a9 fix merged error 2023-06-02 10:05:54 +08:00
JackyWoo
4302ba44d4 fix code style 2023-06-02 10:05:54 +08:00
JackyWoo
bcf22c1ec7 fix code style 2023-06-02 10:05:54 +08:00
JackyWoo
0106704573 add truncate to redis storage 2023-06-02 10:05:54 +08:00
JackyWoo
1df1dfc3e5 add update/delete/insert to redis storage 2023-06-02 10:05:54 +08:00
JackyWoo
f4f939162d new redis engine schema design 2023-06-02 10:05:54 +08:00
JackyWoo
357df40c8f fix tests 2023-06-02 10:05:54 +08:00
JackyWoo
8c822a7edf add tests to redis engine 2023-06-02 10:05:54 +08:00
JackyWoo
ff961834d6 add tests to redis engine 2023-06-02 10:05:54 +08:00
JackyWoo
412d9ba259 add tests for redis storage 2023-06-02 10:05:54 +08:00
JackyWoo
b35867d907 unify storage type 2023-06-02 10:05:54 +08:00
Michael Kolupaev
b51064a508 Get rid of SeekableReadBufferFactory, add SeekableReadBuffer::readBigAt() instead 2023-06-01 18:48:30 -07:00
Alexey Milovidov
54144d15ab
Merge pull request #50319 from ClickHouse/nickitat-patch-12 
Enable `enable_memory_bound_merging_of_aggregation_results` by default
 2023-06-02 03:48:44 +03:00
Alexey Milovidov
52ffaa4630
Merge pull request #50203 from Avogar/head-requests-on-shcema-inference 
Don't send head request for all keys in Iceberg schema inference
 2023-06-02 01:28:00 +03:00
Nikita Taranov
a75598ea65 fix test 2023-06-01 16:16:39 +02:00
pufit
fdfd56e765
Merge branch 'master' into roles_in_config 2023-06-01 08:03:59 -04:00
Alexander Tokmakov
05c90f8987
Merge branch 'master' into reuse_s3_mocks 2023-06-01 13:20:23 +03:00
Sema Checherinda
0aa30ef129 reuse s3_mocks, rewrite test test_paranoid_check_in_logs 2023-06-01 01:29:37 +02:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Sema Checherinda
dd2d43a491
Merge branch 'master' into fix-test-profile-events 2023-05-31 18:57:52 +02:00
Alexander Tokmakov
a18b998076
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-31 19:47:29 +03:00
Nikita Mikhaylov
a225663b8f
Merge branch 'master' into 46229-repl-clickhouse-keeper 2023-05-31 16:17:34 +02:00
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882) 
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-31 13:11:10 +02:00
pufit
dbd3766f5f Specify roles in users.xml 2023-05-30 20:42:49 -04:00
Nikita Mikhaylov
31829f7cfc
Merge branch 'master' into 46229-repl-clickhouse-keeper 2023-05-31 02:29:08 +02:00
avogar
d4efbbfbd3 Allow to skip empty files in file/s3/url/hdfs table functions 2023-05-30 19:32:24 +00:00
Alexander Tokmakov
c8bb1f64ad fix 2023-05-30 18:46:49 +02:00
Alexander Tokmakov
82e1d5ae67 Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-30 17:40:13 +02:00
Sema Checherinda
bec8186b2f do not fix the event list 2023-05-30 13:59:31 +02:00
Sema Checherinda
0b4ea3e2e1 remove reminder comments 2023-05-30 12:26:20 +02:00
Sema Checherinda
fe3939287b add test, fix .gin_sid files 2023-05-30 12:26:20 +02:00
alesapin
6b7e2a0041
Merge pull request #49961 from CheSema/mem-consumption-s3-write 
Introduce a limitation of async calls inside s3 write buffer, make a test that memory is bounded even when s3 is slow
 2023-05-29 13:29:01 +02:00
Han Fei
806ef08e5f
Merge pull request #50306 from helifu/master1 
Fix a typo
 2023-05-29 10:34:38 +02:00
helifu
1821933995 Fix a typo 2023-05-29 15:12:16 +08:00
helifu
e9ffc383da Add input parameter 'base_config_dir' 2023-05-28 12:59:34 +08:00
helifu
7c3fa3658d fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
6a64fa6c6c Node2 cannot be started due to a conflict with config.xml merge 2023-05-28 12:59:34 +08:00
helifu
1d1d84497e Fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
e98cd5d44c Fix failed test cases 
test_system_logs/test_system_logs.py::test_system_logs_order_by_expr PASSED   [ 33%]
test_system_logs/test_system_logs.py::test_system_logs_engine_expr PASSED     [ 66%]
test_system_logs/test_system_logs.py::test_system_logs_settings_expr PASSED   [100%]
 2023-05-28 12:59:34 +08:00
helifu
b2d7a48095 fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
780e9df08d fix the config file name 2023-05-28 12:59:34 +08:00
helifu
01158e783a Add test case for 'engine','settings' configuration 2023-05-28 12:59:34 +08:00
helifu
4013ec982f Add test case for 'order_by' configuration 2023-05-28 12:59:34 +08:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Sema Checherinda
7031796d3f fixing tests 2023-05-26 18:59:21 +02:00
Sema Checherinda
206efee9b7 add test with merge tree table 2023-05-26 18:59:21 +02:00
Sema Checherinda
4249bda449 s3_max_inflight_parts_for_one_file with tests 2023-05-26 18:59:11 +02:00
Aleksei Filatov
2a2c35e4c1 Fix changed IP for https session 2023-05-26 09:08:34 +03:00
Nikita Mikhaylov
cf6ff7ab32 Merge branch 'master' of github.com:ClickHouse/ClickHouse into 46229-repl-clickhouse-keeper 2023-05-25 13:41:25 +00:00
Kruglov Pavel
fd49821e98
Fix tests 2023-05-25 12:46:53 +02:00
Alexander Tokmakov
d8f936987e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-25 12:36:41 +02:00
Kseniia Sumarokova
2e17503d36
Merge pull request #50187 from kssenii/fix-pg-source 
Fix PostgreSQLSource reading all unread the data in onFinish
 2023-05-24 22:51:48 +02:00
Alexander Tokmakov
4c94b3d6bc
Update test.py 2023-05-24 20:13:37 +03:00
robot-clickhouse
a237b8b839 Automatic style fix 2023-05-24 14:19:37 +00:00
Alexander Tokmakov
242c3bc9a9 fix 2023-05-24 16:01:28 +02:00
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Kruglov Pavel
8bc25c4ea3
Fix style 2023-05-24 14:40:27 +02:00
Kruglov Pavel
9545100c9e
Merge pull request #45427 from attack204/urlCluster 
Add urlCluster table function and refactor all *Cluster table functions
 2023-05-24 13:32:56 +02:00
Alexander Tokmakov
f3b4959e05 fix 2023-05-23 20:45:16 +02:00
SmitaRKulkarni
f39c81d13e
Merge pull request #49982 from ClickHouse/Fix_flaky_test_ssl_cert_authentication 
Fix flaky test_ssl_cert_authentication to use urllib3
 2023-05-23 13:57:22 +02:00
avogar
3c1aeaaa79 Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
Antonio Andelic
3e6314675c
Merge pull request #49930 from AVMusorin/write-buffer-from-s3 
Fix metrics `WriteBufferFromS3Bytes`, `WriteBufferFromS3Microseconds` and `WriteBufferFromS3RequestsErrors`
 2023-05-23 12:26:05 +02:00
Alexander Tokmakov
60a696b88b Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-23 12:18:07 +02:00
Alexander Tokmakov
dbf08b25fb better scheduling of merge selecting task 2023-05-23 01:25:17 +02:00
avogar
88e4c93abc Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-22 19:19:57 +00:00
Alexander Tokmakov
b8305503d8 more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
Nikolay Degterinsky
7bed59e1d2
Merge pull request #50000 from evillique/add-schema-inference 
Add schema inference to more table engines
 2023-05-22 17:24:30 +02:00
Kruglov Pavel
b5cad024e0
Merge branch 'master' into urlCluster 2023-05-22 14:59:34 +02:00
Alexander Tokmakov
c89f92e1f6
Merge pull request #50052 from amosbird/fix_49913 
Fix reporting broken projection parts
 2023-05-22 14:20:06 +03:00
Nikolay Degterinsky
183f90e45a Update MongoDB protocol 2023-05-22 09:05:23 +00:00
robot-clickhouse
a0b384bc48 Automatic style fix 2023-05-22 08:30:04 +00:00
Smita Kulkarni
855f0abcf9 Removed unneeded try-except 2023-05-22 10:20:45 +02:00
Antonio Andelic
3a46fe1803
Merge branch 'master' into write-buffer-from-s3 2023-05-22 09:28:14 +02:00
Antonio Andelic
93cd47fd5f
Merge pull request #50026 from ClickHouse/fix-deadlock-attach-thread 
Avoid deadlock when starting table in attach thread of `ReplicatedMergeTree`
 2023-05-22 09:22:33 +02:00
Amos Bird
8a40a48a49
Fix python format 2023-05-22 00:44:17 +08:00
Amos Bird
0a3d986e42
Fix reporting projection broken part 2023-05-21 20:58:58 +08:00
Antonio Andelic
4af8187464 Activate restarting thread in both cases 2023-05-19 15:06:02 +00:00
Antonio Andelic
7f60af11cb
Merge branch 'master' into write-buffer-from-s3 2023-05-19 15:17:05 +02:00
robot-clickhouse
f947d1cc0a Automatic style fix 2023-05-19 13:00:26 +00:00
Antonio Andelic
3107070e76 Avoid deadlock when starting table in attach thread 2023-05-19 12:48:19 +00:00
Sergei Trifonov
5db5f6e44b
Merge branch 'master' into fix-throttlers 2023-05-19 14:08:36 +02:00
Nikolay Degterinsky
a09a8d60c4
Merge branch 'master' into postgresql-uuid 2023-05-19 13:44:17 +02:00
alesapin
6676285f02
Merge pull request #49921 from azat/tests/fix-test_distributed_load_balancing 
Fix flakiness of test_distributed_load_balancing test
 2023-05-19 13:00:38 +02:00
alesapin
632ab8a3d1
Merge pull request #49996 from ClickHouse/az 
Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails
 2023-05-19 12:58:47 +02:00
alesapin
e5b001abda
Merge branch 'master' into fix_some_tests4 2023-05-19 12:34:03 +02:00
Alexey Milovidov
c1b96fd2f5
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-19 12:37:55 +03:00
Azat Khuzhin
dc353faf44 Simplify obtaining query shard in test_distributed_load_balancing 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-19 06:07:58 +02:00
Azat Khuzhin
e37e8f83bb Fix flakiness of test_distributed_load_balancing 
I saw the following in the logs for the failed test:

    2023.05.16 07:12:12.894051 [ 262 ] {74575ac0-b296-4fdc-bc8e-3476a305e6ea} <Warning> ConnectionPoolWithFailover: Connection failed at try №1, reason: Timeout exceeded while reading from socket (socket (172.16.3.2:9000), receive timeout 2000 ms)

And I think that the culprit is the
test_distributed_replica_max_ignored_errors for which it is normal,
however not for others, and this should not affect other tests.

So fix this by calling SYSTEM RELOAD CONFIG, which should reset error
count.

CI: https://s3.amazonaws.com/clickhouse-test-reports/49380/5abc1a1c68ee204c9024493be1d19835cf5630f7/integration_tests__release__[3_4].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-19 06:07:58 +02:00
Michael Kolupaev
e84f0895e7 Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
Nikolay Degterinsky
b8be714830 Add schema inference to more table engines 2023-05-19 00:44:27 +00:00
Michael Kolupaev
8dc59c1efe Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails 2023-05-18 21:40:24 +00:00
robot-clickhouse
378beb20e8 Automatic style fix 2023-05-18 07:46:02 +00:00
SmitaRKulkarni
b7c9964710
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-18 09:27:32 +02:00
Smita Kulkarni
2893f14c54 Updated test_ssl_cert_authentication to use urllib3 2023-05-18 09:20:38 +02:00
alesapin
a7c179e401
Merge branch 'master' into make_test_less_flaky 2023-05-17 15:44:24 +02:00
Kruglov Pavel
0f26a82000
Fix style 2023-05-17 15:32:40 +02:00
Nikolay Degterinsky
ad637c6824 Add test 2023-05-17 13:14:10 +00:00
Kruglov Pavel
b5cc77512a
Fix style 2023-05-17 15:02:15 +02:00
AVMusorin
7df4820af7
Fix metrics WriteBufferFromS3Bytes, WriteBufferFromS3Microseconds and WriteBufferFromS3RequestsErrors 
Ref: https://github.com/ClickHouse/ClickHouse/pull/45188
 2023-05-17 14:50:38 +02:00
Alexander Tokmakov
1e529263d0
Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-17 13:57:50 +03:00
Vitaly Baranov
6c8a923c9d
Merge branch 'master' into write-encrypted-to-backup 2023-05-17 12:37:05 +02:00
Azat Khuzhin
9fe4f1a934 Extensive coverage for bandwidth limiting settings 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-17 12:12:39 +02:00
Azat Khuzhin
3c80e30f02 Fix per-query IO/BACKUPs throttling settings (when default profile has them) 
When some of this settings was set for default profile (in
users.xml/users.yml), then it will be always used regardless of what
user passed.

Fix this by not inherit per-query throttlers, for this they should be
reset before making query context and they should not be initialized as
before in Context::makeQueryContext(), since makeQueryContext() called
too early, when user settings was not read yet.

But there we had also initialization of per-server throttling, move this
into the ContextSharedPart::configureServerWideThrottling(), and call it
once we have ServerSettings set.

Also note, that this patch makes the following settings - server
settings:
- max_replicated_fetches_network_bandwidth_for_server
- max_replicated_sends_network_bandwidth_for_server
But this change should not affect anybody, since it is done with
compatiblity (i.e. if this setting is set in users profile it will be
read from it as well as a fallback).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-17 12:12:39 +02:00
Kruglov Pavel
353791b2dd
Try to fix flaky test_distributed_load_balancing tests (#49912) 
* Try to fix flaky test_distributed_load_balancing tests

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-05-16 18:26:22 +03:00
avogar
633c37e3e1 Update tests 2023-05-16 14:54:52 +00:00
Kruglov Pavel
4530f38fdf
Merge branch 'master' into urlCluster 2023-05-16 16:21:23 +02:00
Alexander Tokmakov
b6716a8f0f Merge branch 'master' into fix_some_tests4 2023-05-16 14:46:27 +02:00
Vitaly Baranov
943707963f Add backup setting "decrypt_files_from_encrypted_disks" 2023-05-16 14:27:27 +02:00
Vitaly Baranov
d0fd81fa27 Add tests. 2023-05-16 14:27:27 +02:00
Vitaly Baranov
c48c20fac8 Use combined checksums for encrypted immutable files. 2023-05-16 14:27:27 +02:00
Vitaly Baranov
101aa6eff0 Add function copyS3FileFromDisk(). 2023-05-16 14:25:37 +02:00