thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
119,123 Commits 9,326 Branches 1,783 Tags 2.1 GiB
dacc8cb4c9
Commit Graph

6814 Commits

Author SHA1 Message Date
JackyWoo
412d9ba259 add tests for redis storage 2023-06-02 10:05:54 +08:00
JackyWoo
b35867d907 unify storage type 2023-06-02 10:05:54 +08:00
Michael Kolupaev
b51064a508 Get rid of SeekableReadBufferFactory, add SeekableReadBuffer::readBigAt() instead 2023-06-01 18:48:30 -07:00
Alexey Milovidov
54144d15ab
Merge pull request #50319 from ClickHouse/nickitat-patch-12 
Enable `enable_memory_bound_merging_of_aggregation_results` by default
 2023-06-02 03:48:44 +03:00
Alexey Milovidov
52ffaa4630
Merge pull request #50203 from Avogar/head-requests-on-shcema-inference 
Don't send head request for all keys in Iceberg schema inference
 2023-06-02 01:28:00 +03:00
Nikita Taranov
a75598ea65 fix test 2023-06-01 16:16:39 +02:00
robot-clickhouse
92ee24acd3 Automatic style fix 2023-06-01 13:10:50 +00:00
Antonio Andelic
514beb783b Merge branch 'master' into keeper-with-disks 2023-06-01 12:19:43 +00:00
Antonio Andelic
0b4d29ff98 Add tests for disks 2023-06-01 12:19:00 +00:00
pufit
fdfd56e765
Merge branch 'master' into roles_in_config 2023-06-01 08:03:59 -04:00
Alexander Tokmakov
05c90f8987
Merge branch 'master' into reuse_s3_mocks 2023-06-01 13:20:23 +03:00
Sema Checherinda
0aa30ef129 reuse s3_mocks, rewrite test test_paranoid_check_in_logs 2023-06-01 01:29:37 +02:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Sema Checherinda
dd2d43a491
Merge branch 'master' into fix-test-profile-events 2023-05-31 18:57:52 +02:00
Alexander Tokmakov
a18b998076
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-31 19:47:29 +03:00
Nikita Mikhaylov
a225663b8f
Merge branch 'master' into 46229-repl-clickhouse-keeper 2023-05-31 16:17:34 +02:00
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882) 
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-31 13:11:10 +02:00
pufit
dbd3766f5f Specify roles in users.xml 2023-05-30 20:42:49 -04:00
Nikita Mikhaylov
31829f7cfc
Merge branch 'master' into 46229-repl-clickhouse-keeper 2023-05-31 02:29:08 +02:00
avogar
d4efbbfbd3 Allow to skip empty files in file/s3/url/hdfs table functions 2023-05-30 19:32:24 +00:00
Alexander Tokmakov
c8bb1f64ad fix 2023-05-30 18:46:49 +02:00
Alexander Tokmakov
82e1d5ae67 Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-30 17:40:13 +02:00
Sema Checherinda
bec8186b2f do not fix the event list 2023-05-30 13:59:31 +02:00
Sema Checherinda
0b4ea3e2e1 remove reminder comments 2023-05-30 12:26:20 +02:00
Sema Checherinda
fe3939287b add test, fix .gin_sid files 2023-05-30 12:26:20 +02:00
Antonio Andelic
67746bfff2 Merge branch 'master' into keeper-with-disks 2023-05-30 09:50:12 +00:00
alesapin
6b7e2a0041
Merge pull request #49961 from CheSema/mem-consumption-s3-write 
Introduce a limitation of async calls inside s3 write buffer, make a test that memory is bounded even when s3 is slow
 2023-05-29 13:29:01 +02:00
Han Fei
806ef08e5f
Merge pull request #50306 from helifu/master1 
Fix a typo
 2023-05-29 10:34:38 +02:00
helifu
1821933995 Fix a typo 2023-05-29 15:12:16 +08:00
helifu
e9ffc383da Add input parameter 'base_config_dir' 2023-05-28 12:59:34 +08:00
helifu
7c3fa3658d fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
6a64fa6c6c Node2 cannot be started due to a conflict with config.xml merge 2023-05-28 12:59:34 +08:00
helifu
1d1d84497e Fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
e98cd5d44c Fix failed test cases 
test_system_logs/test_system_logs.py::test_system_logs_order_by_expr PASSED   [ 33%]
test_system_logs/test_system_logs.py::test_system_logs_engine_expr PASSED     [ 66%]
test_system_logs/test_system_logs.py::test_system_logs_settings_expr PASSED   [100%]
 2023-05-28 12:59:34 +08:00
helifu
b2d7a48095 fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
780e9df08d fix the config file name 2023-05-28 12:59:34 +08:00
helifu
01158e783a Add test case for 'engine','settings' configuration 2023-05-28 12:59:34 +08:00
helifu
4013ec982f Add test case for 'order_by' configuration 2023-05-28 12:59:34 +08:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Sema Checherinda
7031796d3f fixing tests 2023-05-26 18:59:21 +02:00
Sema Checherinda
206efee9b7 add test with merge tree table 2023-05-26 18:59:21 +02:00
Sema Checherinda
4249bda449 s3_max_inflight_parts_for_one_file with tests 2023-05-26 18:59:11 +02:00
Aleksei Filatov
2a2c35e4c1 Fix changed IP for https session 2023-05-26 09:08:34 +03:00
Antonio Andelic
6a8a21e09a Add test for s3 disk restore 2023-05-25 16:01:40 +00:00
Nikita Mikhaylov
cf6ff7ab32 Merge branch 'master' of github.com:ClickHouse/ClickHouse into 46229-repl-clickhouse-keeper 2023-05-25 13:41:25 +00:00
Kruglov Pavel
fd49821e98
Fix tests 2023-05-25 12:46:53 +02:00
Alexander Tokmakov
d8f936987e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-25 12:36:41 +02:00
Antonio Andelic
ae84716eba Merge branch 'master' into keeper-with-disks 2023-05-25 08:45:19 +00:00
Antonio Andelic
7e68f61df1 Fix snapshot recovery 2023-05-25 08:43:11 +00:00
Kseniia Sumarokova
2e17503d36
Merge pull request #50187 from kssenii/fix-pg-source 
Fix PostgreSQLSource reading all unread the data in onFinish
 2023-05-24 22:51:48 +02:00
Alexander Tokmakov
4c94b3d6bc
Update test.py 2023-05-24 20:13:37 +03:00
robot-clickhouse
a237b8b839 Automatic style fix 2023-05-24 14:19:37 +00:00
Alexander Tokmakov
242c3bc9a9 fix 2023-05-24 16:01:28 +02:00
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Kruglov Pavel
8bc25c4ea3
Fix style 2023-05-24 14:40:27 +02:00
Kruglov Pavel
9545100c9e
Merge pull request #45427 from attack204/urlCluster 
Add urlCluster table function and refactor all *Cluster table functions
 2023-05-24 13:32:56 +02:00
Alexander Tokmakov
f3b4959e05 fix 2023-05-23 20:45:16 +02:00
SmitaRKulkarni
f39c81d13e
Merge pull request #49982 from ClickHouse/Fix_flaky_test_ssl_cert_authentication 
Fix flaky test_ssl_cert_authentication to use urllib3
 2023-05-23 13:57:22 +02:00
avogar
3c1aeaaa79 Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
Antonio Andelic
3e6314675c
Merge pull request #49930 from AVMusorin/write-buffer-from-s3 
Fix metrics `WriteBufferFromS3Bytes`, `WriteBufferFromS3Microseconds` and `WriteBufferFromS3RequestsErrors`
 2023-05-23 12:26:05 +02:00
Alexander Tokmakov
60a696b88b Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-05-23 12:18:07 +02:00
Alexander Tokmakov
dbf08b25fb better scheduling of merge selecting task 2023-05-23 01:25:17 +02:00
avogar
88e4c93abc Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-22 19:19:57 +00:00
Alexander Tokmakov
b8305503d8 more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
Nikolay Degterinsky
7bed59e1d2
Merge pull request #50000 from evillique/add-schema-inference 
Add schema inference to more table engines
 2023-05-22 17:24:30 +02:00
Kruglov Pavel
b5cad024e0
Merge branch 'master' into urlCluster 2023-05-22 14:59:34 +02:00
Alexander Tokmakov
c89f92e1f6
Merge pull request #50052 from amosbird/fix_49913 
Fix reporting broken projection parts
 2023-05-22 14:20:06 +03:00
Nikolay Degterinsky
183f90e45a Update MongoDB protocol 2023-05-22 09:05:23 +00:00
robot-clickhouse
a0b384bc48 Automatic style fix 2023-05-22 08:30:04 +00:00
Smita Kulkarni
855f0abcf9 Removed unneeded try-except 2023-05-22 10:20:45 +02:00
Antonio Andelic
3a46fe1803
Merge branch 'master' into write-buffer-from-s3 2023-05-22 09:28:14 +02:00
Antonio Andelic
93cd47fd5f
Merge pull request #50026 from ClickHouse/fix-deadlock-attach-thread 
Avoid deadlock when starting table in attach thread of `ReplicatedMergeTree`
 2023-05-22 09:22:33 +02:00
Amos Bird
8a40a48a49
Fix python format 2023-05-22 00:44:17 +08:00
Amos Bird
0a3d986e42
Fix reporting projection broken part 2023-05-21 20:58:58 +08:00
Antonio Andelic
4af8187464 Activate restarting thread in both cases 2023-05-19 15:06:02 +00:00
Antonio Andelic
7f60af11cb
Merge branch 'master' into write-buffer-from-s3 2023-05-19 15:17:05 +02:00
robot-clickhouse
f947d1cc0a Automatic style fix 2023-05-19 13:00:26 +00:00
Antonio Andelic
3107070e76 Avoid deadlock when starting table in attach thread 2023-05-19 12:48:19 +00:00
Sergei Trifonov
5db5f6e44b
Merge branch 'master' into fix-throttlers 2023-05-19 14:08:36 +02:00
Nikolay Degterinsky
a09a8d60c4
Merge branch 'master' into postgresql-uuid 2023-05-19 13:44:17 +02:00
alesapin
6676285f02
Merge pull request #49921 from azat/tests/fix-test_distributed_load_balancing 
Fix flakiness of test_distributed_load_balancing test
 2023-05-19 13:00:38 +02:00
alesapin
632ab8a3d1
Merge pull request #49996 from ClickHouse/az 
Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails
 2023-05-19 12:58:47 +02:00
alesapin
e5b001abda
Merge branch 'master' into fix_some_tests4 2023-05-19 12:34:03 +02:00
Alexey Milovidov
c1b96fd2f5
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-19 12:37:55 +03:00
Azat Khuzhin
dc353faf44 Simplify obtaining query shard in test_distributed_load_balancing 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-19 06:07:58 +02:00
Azat Khuzhin
e37e8f83bb Fix flakiness of test_distributed_load_balancing 
I saw the following in the logs for the failed test:

    2023.05.16 07:12:12.894051 [ 262 ] {74575ac0-b296-4fdc-bc8e-3476a305e6ea} <Warning> ConnectionPoolWithFailover: Connection failed at try №1, reason: Timeout exceeded while reading from socket (socket (172.16.3.2:9000), receive timeout 2000 ms)

And I think that the culprit is the
test_distributed_replica_max_ignored_errors for which it is normal,
however not for others, and this should not affect other tests.

So fix this by calling SYSTEM RELOAD CONFIG, which should reset error
count.

CI: https://s3.amazonaws.com/clickhouse-test-reports/49380/5abc1a1c68ee204c9024493be1d19835cf5630f7/integration_tests__release__[3_4].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-19 06:07:58 +02:00
Michael Kolupaev
e84f0895e7 Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
Nikolay Degterinsky
b8be714830 Add schema inference to more table engines 2023-05-19 00:44:27 +00:00
Michael Kolupaev
8dc59c1efe Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails 2023-05-18 21:40:24 +00:00
robot-clickhouse
378beb20e8 Automatic style fix 2023-05-18 07:46:02 +00:00
SmitaRKulkarni
b7c9964710
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-18 09:27:32 +02:00
Smita Kulkarni
2893f14c54 Updated test_ssl_cert_authentication to use urllib3 2023-05-18 09:20:38 +02:00
alesapin
a7c179e401
Merge branch 'master' into make_test_less_flaky 2023-05-17 15:44:24 +02:00
Kruglov Pavel
0f26a82000
Fix style 2023-05-17 15:32:40 +02:00
Nikolay Degterinsky
ad637c6824 Add test 2023-05-17 13:14:10 +00:00
Kruglov Pavel
b5cc77512a
Fix style 2023-05-17 15:02:15 +02:00
AVMusorin
7df4820af7
Fix metrics WriteBufferFromS3Bytes, WriteBufferFromS3Microseconds and WriteBufferFromS3RequestsErrors 
Ref: https://github.com/ClickHouse/ClickHouse/pull/45188
 2023-05-17 14:50:38 +02:00
Alexander Tokmakov
1e529263d0
Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-17 13:57:50 +03:00
Vitaly Baranov
6c8a923c9d
Merge branch 'master' into write-encrypted-to-backup 2023-05-17 12:37:05 +02:00
Azat Khuzhin
9fe4f1a934 Extensive coverage for bandwidth limiting settings 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-17 12:12:39 +02:00
Azat Khuzhin
3c80e30f02 Fix per-query IO/BACKUPs throttling settings (when default profile has them) 
When some of this settings was set for default profile (in
users.xml/users.yml), then it will be always used regardless of what
user passed.

Fix this by not inherit per-query throttlers, for this they should be
reset before making query context and they should not be initialized as
before in Context::makeQueryContext(), since makeQueryContext() called
too early, when user settings was not read yet.

But there we had also initialization of per-server throttling, move this
into the ContextSharedPart::configureServerWideThrottling(), and call it
once we have ServerSettings set.

Also note, that this patch makes the following settings - server
settings:
- max_replicated_fetches_network_bandwidth_for_server
- max_replicated_sends_network_bandwidth_for_server
But this change should not affect anybody, since it is done with
compatiblity (i.e. if this setting is set in users profile it will be
read from it as well as a fallback).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-17 12:12:39 +02:00
Kruglov Pavel
353791b2dd
Try to fix flaky test_distributed_load_balancing tests (#49912) 
* Try to fix flaky test_distributed_load_balancing tests

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-05-16 18:26:22 +03:00
avogar
633c37e3e1 Update tests 2023-05-16 14:54:52 +00:00
Kruglov Pavel
4530f38fdf
Merge branch 'master' into urlCluster 2023-05-16 16:21:23 +02:00
Alexander Tokmakov
b6716a8f0f Merge branch 'master' into fix_some_tests4 2023-05-16 14:46:27 +02:00
Vitaly Baranov
943707963f Add backup setting "decrypt_files_from_encrypted_disks" 2023-05-16 14:27:27 +02:00
Vitaly Baranov
d0fd81fa27 Add tests. 2023-05-16 14:27:27 +02:00
Vitaly Baranov
c48c20fac8 Use combined checksums for encrypted immutable files. 2023-05-16 14:27:27 +02:00
Vitaly Baranov
101aa6eff0 Add function copyS3FileFromDisk(). 2023-05-16 14:25:37 +02:00
Vitaly Baranov
fd2731845c Simplify interface of IBackupWriter: Remove supportNativeCopy() function. 2023-05-16 14:25:36 +02:00
robot-clickhouse
b3fc7d1a86 Automatic style fix 2023-05-16 11:15:15 +00:00
alesapin
a4f84cecfd Retry connection expired in test_rename_column/test.py 2023-05-16 13:05:36 +02:00
avogar
f9e0eb47d7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-15 16:35:24 +00:00
Alexander Tokmakov
05ae7b2c2d fix some tests 2023-05-15 18:28:12 +02:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine 
```
create table kafka
(
 a UInt32,
 a_str String Alias toString(a)
) engine = Kafka;

create table data
(
  a UInt32;
  a_str String
) engine = MergeTree
order by tuple();

create materialized view data_mv to data
(
  a UInt32,
  a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.

Ref: https://github.com/ClickHouse/ClickHouse/pull/47138

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
 2023-05-15 15:39:58 +02:00
Sema Checherinda
a1ee7d52e1
Merge pull request #49432 from CheSema/lost-blobs 
all s3-blobs removed when merge aborted, remove part from failed fetch without unlock keper
 2023-05-12 13:19:27 +02:00
Nikita Mikhaylov
66badcd59c
Merge pull request #49725 from vitlibar/incremental-backup-append-table-def 
Fix writing appended files to incremental backups
 2023-05-12 11:37:49 +02:00
Vitaly Baranov
478140f8b4 Fix LimitSeekableReadBuffer. 2023-05-11 22:58:05 +02:00
Vitaly Baranov
ec011b9113
Merge branch 'master' into user-grants-from-config 2023-05-11 17:08:06 +02:00
avogar
3ee8de792c Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-11 12:46:20 +00:00
Sema Checherinda
66e3712dca
Merge branch 'master' into lost-blobs 2023-05-11 08:23:25 +02:00
Nikolay Degterinsky
39deaf4f2a
Merge pull request #49632 from evillique/fix-ssl-test 
Try to fix integration test 'test_ssl_cert_authentication'
 2023-05-09 11:53:21 +02:00
Alexey Milovidov
a8bdb20fc4
Merge pull request #48787 from ClickHouse/background-memory-tracker 
Add MemoryTracker for the background tasks [Resubmit]
 2023-05-09 07:58:36 +03:00
Alexey Milovidov
9a73a04fe3
Merge pull request #42587 from ClickHouse/compress-marks-primary-key-by-default 
Compress marks and primary key by default
 2023-05-09 06:43:10 +03:00
Alexander Tokmakov
5629d73bdb
Merge pull request #49560 from ClickHouse/fix_dictionaries_loading_order 
Fix dictionaries loading order
 2023-05-08 16:07:40 +03:00
Nikolay Degterinsky
ee4ce7db47 Fix style 2023-05-08 12:33:24 +00:00
Smita Kulkarni
f20901d9d3 Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-08 13:53:19 +02:00
Alexey Milovidov
e083acc361 Merge branch 'compress-marks-primary-key-by-default' of github.com:ClickHouse/ClickHouse into compress-marks-primary-key-by-default 2023-05-08 07:02:55 +02:00
Alexey Milovidov
88d0d94933 Update test 2023-05-08 07:02:41 +02:00
Alexey Milovidov
3cf1da7bf3
Merge branch 'master' into deprecate-in-memory-parts 2023-05-08 01:38:00 +03:00
Alexander Tokmakov
abf6c60ad2 Merge branch 'master' into fix_dictionaries_loading_order 2023-05-08 00:31:03 +02:00
Nikolay Degterinsky
c841a187ab Try to fix integration test 'test_ssl_cert_authentication' 2023-05-07 18:34:34 +00:00
robot-clickhouse
fe76bde5b5 Automatic style fix 2023-05-07 16:33:07 +00:00
Alexey Milovidov
a2daeb849e Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 18:25:01 +02:00
Alexey Milovidov
ea9249b0ac Merge branch 'compress-marks-primary-key-by-default' of github.com:ClickHouse/ClickHouse into compress-marks-primary-key-by-default 2023-05-07 18:24:51 +02:00
Alexey Milovidov
1ae8a5be3b Update a test 2023-05-07 18:24:38 +02:00
Alexey Milovidov
9eba74c1e1
Update test_vertical_merges_from_compact_parts.py 2023-05-07 17:45:45 +03:00
Alexey Milovidov
27e1357ee6
Update test_in_memory_parts_still_read.py 2023-05-07 17:42:18 +03:00
robot-clickhouse
fd82979961 Automatic style fix 2023-05-07 02:00:24 +00:00
Alexey Milovidov
d8f5667ba6 Follow-up for #49576 2023-05-07 03:59:35 +02:00
Alexey Milovidov
6e46a4e0ea
Update test_in_memory_parts_still_read.py 2023-05-07 04:56:09 +03:00
Alexey Milovidov
3b6edbacab Update tests 2023-05-07 03:45:17 +02:00
Alexey Milovidov
de3e66385c Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 02:40:25 +02:00
Alexey Milovidov
e8228cb0d2
Merge pull request #49530 from ClickHouse/optimize-query-log 
Optimize the system.query_log and system.query_thread_log tables by applying LowCardinality when appropriate
 2023-05-07 03:36:30 +03:00
Alexey Milovidov
07027be872
Update test_in_memory_parts_still_read.py 2023-05-07 02:09:37 +03:00
Alexey Milovidov
8f1123dfb8
Update test_in_memory_parts_still_read.py 2023-05-06 18:23:54 +03:00
Alexey Milovidov
bffc441b84
Merge pull request #49576 from ClickHouse/remove-test_merge_tree_s3_restore 
Remove `test_merge_tree_s3_restore`
 2023-05-06 18:13:47 +03:00
Alexey Milovidov
fe00e668f1
Merge pull request #49579 from ClickHouse/remove-obsolete-test 
Remove obsolete test about deprecated feature
 2023-05-06 18:11:05 +03:00
Alexey Milovidov
846f2d57af Fix error found by AST Fuzzer 2023-05-06 00:55:56 +02:00
Alexey Milovidov
be2834da58 Remove obsolete test about deprecated feature 2023-05-06 00:02:45 +02:00
Alexey Milovidov
75a2589a42
Merge branch 'master' into deprecate-in-memory-parts 2023-05-06 00:49:59 +03:00
Alexey Milovidov
e4d122323f Add a new test 2023-05-05 23:43:22 +02:00
Alexey Milovidov
290bf0ae58 Remove a test for in-memory parts 2023-05-05 23:29:48 +02:00
Alexey Milovidov
8a548170f8 Remove obsolete test 2023-05-05 23:25:47 +02:00
Alexey Milovidov
9436aef893 Remove test_merge_tree_s3_restore 2023-05-05 22:44:07 +02:00
Alexey Milovidov
79ad150454
Merge pull request #49323 from ClickHouse/low-cardinality-fix-progress 
Fix progress bar for LowCardinality fields with shared dictionaries
 2023-05-05 23:34:27 +03:00
Smita Kulkarni
b0c408faa4 Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-05 17:51:33 +02:00
Alexander Tokmakov
dd1bbf7c78 fix another issue with dependencies 2023-05-05 16:27:12 +02:00
Nikolay Degterinsky
9934eae315
Merge pull request #48983 from evillique/mongodb-array-type 
Add `Array` data type to MongoDB
 2023-05-05 16:02:07 +02:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes 
Fix some grammar mistakes in documentation, code and tests
 2023-05-05 15:45:58 +02:00
Alexander Tokmakov
6cf3e5b77a fix race on loading dictionaries 2023-05-05 15:25:18 +02:00
wangxiaobo
f704c0dfec
Implement SYSTEM DROP REPLICA from auxillary ZooKeeper clusters (#48932) 
* multiple zookeeper drop replica bug fix.

* add an integration test.

* format code.

* set stay_alive=True for test.

* style check bug fix.

* add check for is_active

* format code

* remove table_settings and has_metadata_out param.
 2023-05-05 14:11:11 +03:00
Kseniia Sumarokova
7c203dbcd2
Merge pull request #49481 from snikch/master 
Fix postgres database setting
 2023-05-05 12:53:51 +02:00
Alexey Milovidov
f77d087404 Merge branch 'master' into low-cardinality-fix-progress 2023-05-05 06:43:37 +02:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Alexey Milovidov
6b809a1829 Remove a test 2023-05-05 06:43:21 +02:00
Alexey Milovidov
14f5e785d6 Fix test 2023-05-05 06:42:40 +02:00
Alexey Milovidov
ab1a1ea5b7
Merge pull request #49490 from ClickHouse/fix-s3cluster-with-headers 
Correctly handle s3Cluster arguments
 2023-05-05 05:31:23 +03:00
Ivan Takarlikov
339fb0c2c1
Merge branch 'master' into it-grammar-fixes 2023-05-04 15:57:09 -03:00
Sema Checherinda
93c1209ea5 fix black style 2023-05-04 19:40:41 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Konstantin Bogdanov
c93a131019
Add an integration test for shutdown_wait_unfinished_queries (#49469) 2023-05-04 17:21:08 +02:00
Dmitry Novik
befcdbcc6d
Merge pull request #47630 from ClickHouse/revert-47476-revert_46622 
Fix user MemoryTracker counter in async inserts
 2023-05-04 16:57:41 +02:00
Alexander Gololobov
f77cc89464
Merge pull request #49470 from ClickHouse/remove_no_delay_flag 
Replace `NO DELAY` with `SYNC` in tests
 2023-05-04 11:57:01 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage 
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
 2023-05-04 11:47:43 +02:00
alesapin
89caf40840
Merge pull request #46528 from myrrc/feature/show-secrets-option 
Show secrets in `SHOW` and `SELECT` queries
 2023-05-04 11:21:30 +02:00
Antonio Andelic
8769ac2187 Correctly append arguments 2023-05-04 08:30:45 +00:00
Nikolay Degterinsky
ed9a9ecd57 Fixes 2023-05-04 02:45:25 +00:00
Mal Curtis
5727585d95 s/use_tables_cache/use_table_cache 2023-05-03 23:40:12 +00:00
Alexey Milovidov
261907c143 Merge branch 'master' into deprecate-in-memory-parts 2023-05-04 01:07:38 +02:00
wangxiaobo
2924837c7e
Fix Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric (#48954) 
* Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric bug fix.

* add integration test.

* add integration test.

* Update test.py

* format code

* format code
 2023-05-03 22:41:20 +03:00
Alexander Tokmakov
83b12ec5ca replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
Dmitry Novik
2a664521c2 Make sure async insert happends 2023-05-03 17:12:21 +00:00
Anton Popov
c9705d6bf1
Merging #49066 (Better error handling during loading of parts) (#49430) 
* catch filesystem error when loading parts

* better exception handling during part loading

---------

Co-authored-by: cangyin <excangyin@gmail.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-03 19:10:06 +02:00
Sema Checherinda
3ba490e4d6 test when merge canceled with s3 2023-05-03 10:39:03 +02:00
Sean Haynes
1d51bc90f0 Add a test to check max_rows_to_read_leaf behaviour 
In ClickHouse v22.3, querying a distributed table through a view
results in a max_rows_to_read_leaf limit reached exception being
raised on the root executor despite the row limit for each leaf node
not being reached.

This is fixed in ClickHouse v23.3, but Adding this integration test
to catch any issues in the future
 2023-05-03 08:47:37 +01:00
Dmitry Novik
93e8ecf4ff Update test 2023-05-03 01:33:26 +02:00
Alexey Milovidov
f449df85b6 Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
Nikita Taranov
f43e916d42 impl 2023-05-02 22:07:30 +00:00
Dmitry Novik
bab112a1bc
Merge branch 'master' into revert-47476-revert_46622 2023-05-02 20:54:25 +02:00
pufit
2964ca5c84 Specify grants for users in users.xml 2023-05-01 20:24:02 -04:00
Sema Checherinda
ff648b7b36 mute the bug, will open new pr with fix 2023-05-01 21:53:05 +02:00
Sema Checherinda
e3647571f2 explicit drop table for tests 2023-05-01 20:45:20 +02:00
Sema Checherinda
02b7c2fe90 clearing s3 between tests in a robust way 2023-05-01 20:45:10 +02:00
Nikolay Degterinsky
65e743735a Merge remote-tracking branch 'upstream/master' into mongodb-array-type 2023-05-01 16:33:01 +00:00
robot-clickhouse
96e4afd89c Automatic style fix 2023-05-01 16:10:08 +00:00
Dmitry Novik
fd5dd103b3 Use non-default user in test 2023-05-01 18:02:08 +02:00
alesapin
5b24a84fc0 Apply black check 2023-05-01 14:02:07 +02:00
alesapin
17effd4f6d Fix black 2023-05-01 14:01:42 +02:00
alesapin
21f58df9f7 Finally fix flaky test 2023-05-01 13:58:10 +02:00
robot-clickhouse
ab97dbcf1e Automatic style fix 2023-04-30 17:27:15 +00:00
alesapin
b22a54d6cc fix 2023-04-30 19:10:12 +02:00
alesapin
6281606fcf More debug info 2023-04-30 19:08:04 +02:00
alesapin
c6f91afad7 Add more debug to test (it's not flaky on my setup) 2023-04-30 19:07:15 +02:00
alesapin
a1e9236b53 Fix tests which depend on detached files count 2023-04-30 19:06:36 +02:00
Kseniia Sumarokova
7d867d7632
Merge pull request #49225 from MikhailBurdukov/mongo_dict_tls 
Connection options for MongoDB dictionaries
 2023-04-29 11:37:45 +02:00
pufit
9d6169df00 Merge remote-tracking branch 'origin/46229-repl-clickhouse-keeper' into 46229-repl-clickhouse-keeper 
# Conflicts:
#	tests/integration/test_keeper_client/test.py
 2023-04-28 14:11:45 -04:00
pufit
30bc74c859 Fix tests 2023-04-28 14:09:24 -04:00
Mike Kot
2d20658885
Merge branch 'master' into feature/show-secrets-option 2023-04-28 20:19:35 +03:00
Mike Kot
f1d0ed367d separate name for format setting 2023-04-28 13:39:38 +00:00
Mike Kot
7bffa89e96 add all 3 settings 2023-04-28 13:22:36 +00:00
kssenii
298ed454ce Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-28 13:26:55 +02:00
robot-clickhouse
711d8d4442 Automatic style fix 2023-04-28 03:19:21 +00:00
pufit
39ae0c1c4e Fix tests 2023-04-27 22:51:52 -04:00
Mike Kot
b24de29c70 reverting mr changes 2023-04-27 20:37:12 +00:00
Mike Kot
357cde95e9 Merge branch 'master' into feature/show-secrets-option 2023-04-27 20:19:40 +00:00
Alexey Milovidov
96826cfca6
Merge pull request #49161 from ClickHouse/nickitat-patch-11 
Align connect timeout with aws sdk default
 2023-04-27 18:33:47 +03:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage 2023-04-27 14:54:04 +02:00
Alexey Milovidov
aac037f51c
Merge pull request #46765 from zk-kiger/improve_cluster_table_funcion_skip_unavailable_shards 
add skip_unavailable_shards setting for table function cluster
 2023-04-27 14:54:18 +03:00
Nikolay Degterinsky
ea55222131
Merge pull request #44674 from evillique/add_default_password_type 
Add default password type
 2023-04-27 13:25:58 +02:00
MikhailBurdukov
b229a28e94
Merge branch 'master' into mongo_dict_tls 2023-04-26 23:39:27 +03:00
MikhailBurdukov
ca68cd85d4 Fix style 2023-04-26 20:10:10 +00:00
MikhailBurdukov
389c0af922 Fix style 2023-04-26 19:36:34 +00:00
MikhailBurdukov
d76430fe90 Added options handling for mongoo dict 2023-04-26 19:19:10 +00:00
Nikita Taranov
3f09e0be4e fix tests 2023-04-26 13:24:42 +00:00
Vitaly Baranov
681442f86c Fix test_encrypted_disk_replication 2023-04-26 15:22:33 +02:00
Alexey Milovidov
23132fbdbc
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-26 13:54:39 +03:00
Nikolay Degterinsky
a8d124ac0f
Merge branch 'master' into add_default_password_type 2023-04-26 12:53:23 +02:00
Alexey Milovidov
e2bedf170b
Merge pull request #49107 from ClickHouse/Avogar-patch-2 
Fix flaky integration test test_async_query_sending
 2023-04-26 13:48:08 +03:00
Kseniia Sumarokova
b92234ed90
Merge branch 'master' into fix-postgres-setting 2023-04-25 23:55:13 +02:00
Alexey Milovidov
1a42148262
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-25 00:44:58 +03:00
Nikolay Degterinsky
2fe3a69ba1 Merge remote-tracking branch 'upstream/master' into add_default_password_type 2023-04-24 18:51:32 +00:00
pufit
1985fb785e
Merge pull request #48262 from ClickHouse/42497-inherit-grant 
GRANT CURRENT GRANTS implementation
 2023-04-24 11:11:10 -04:00
Kruglov Pavel
50dd836586
Fix flaky integration test test_async_query_sending 2023-04-24 16:37:54 +02:00
kssenii
277393fd8d Fix 2023-04-24 14:45:41 +02:00
alesapin
516a0c9784
Merge pull request #48862 from ClickHouse/fix-zero-copy-replication-drop-detached-parts 
Fix unexpected part name error when trying to drop a ignored detached part with zero copy replication
 2023-04-24 12:57:25 +02:00
Alexey Milovidov
3ae7bf754b Merge branch 'master' into compress-marks-primary-key-by-default 2023-04-23 22:46:13 +02:00
Alexey Milovidov
67de39c2d9
Merge pull request #48727 from ClickHouse/parallel-processing-from-storages 
Parallelize query processing right after reading FROM ...
 2023-04-23 23:10:32 +03:00
Alexey Milovidov
31000978f4
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-23 16:18:48 +03:00
kssenii
d8023806a9 Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-23 12:39:34 +02:00
Nikolay Degterinsky
b599d0bd01 Better 2023-04-21 22:03:56 +00:00
Alexey Milovidov
ded4b17d2c
Merge pull request #48989 from evillique/fix-ssl 
Add fallback to password auth after failed SSL auth
 2023-04-21 21:42:59 +03:00
Dmitry Novik
cbc4ba6737 Add sleep 2023-04-21 16:50:41 +00:00
Dmitry Novik
e23105b322 Merge remote-tracking branch 'origin/master' into revert-47476-revert_46622 2023-04-21 16:40:04 +00:00
Nikolay Degterinsky
fb3c0f05df Add test 2023-04-21 14:22:14 +00:00
alesapin
ac40eab79d Remove outdated test 2023-04-21 15:24:29 +02:00
avogar
c949f0ebf5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-04-21 14:13:33 +02:00
kssenii
e58c16318f Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-21 12:49:40 +02:00
kssenii
88f412ad23 Fix upgrade check, fix integration test 2023-04-21 12:44:08 +02:00
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect 
Improve async reading from socket
 2023-04-21 10:38:50 +02:00
Alexey Milovidov
98ae9be734
Revert "Added tests for ClickHouse apps help and fixed help issues" 2023-04-21 01:54:34 +03:00
Kruglov Pavel
fb139e9a87
Fix style 2023-04-20 19:58:01 +02:00
avogar
fd8e510819 Add tests 2023-04-20 17:35:34 +00:00
Nikolay Degterinsky
ae100defa2 Add Array data type to MongoDB 2023-04-20 15:51:10 +00:00
Vladimir C
99ac321f5d
Merge pull request #48664 from ClickHouse/vdimir/http_tmp_buffer_fs_cache 2023-04-20 14:15:30 +02:00
Vladimir C
ad516d2349
Merge pull request #48795 from ClickHouse/vdimir/fix-cluster-discovery-47176 2023-04-20 11:56:07 +02:00
Kseniia Sumarokova
5a8efd3261
Update cluster.py 2023-04-19 17:35:57 +02:00
vdimir
33ee94f08f Add CREATE TABLE tbl ON CLUSTER to test_cluster_discovery 2023-04-19 16:44:54 +02:00
vdimir
d6416a1321 Store clusters from ClusterDiscovery in separate map 2023-04-19 16:44:54 +02:00
vdimir
c7bdd24bdb Test wait_end_of_query in test_temporary_data_in_cache 2023-04-19 16:44:21 +02:00
Kseniia Sumarokova
6843874e8a
Merge pull request #48903 from ClickHouse/vdimir/fix_test_storage_delta 
Fix order by in test_storage_delta
 2023-04-19 15:43:57 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
Igor Nikonov
2455334009 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-18 21:42:51 +00:00
Igor Nikonov
b236db82c9
Merge pull request #48863 from ClickHouse/fix_test_store_cleanup_disk_s3 
Fix: do not run test_store_cleanup_disk_s3 in parallel
 2023-04-18 22:44:03 +02:00
Ilya Yatsishin
ebb1b990f2
Merge pull request #45819 from qoega/clickhouse-help 2023-04-18 21:46:36 +02:00
vdimir
e34dcabeca
Fix order by in test_storage_delta 2023-04-18 14:25:21 +00:00
Sema Checherinda
d5fd0c4664
Merge pull request #48843 from ClickHouse/fix-test-concurrent-alter-move-and-drop 
Try fix flacky test_concurrent_alter_move_and_drop
 2023-04-18 16:21:17 +02:00
robot-clickhouse-ci-1
0e4dd315bd
Merge pull request #48856 from hanfei1991/hanfei/suppress-45435 
suppress assert of progress for test_system_replicated_fetches
 2023-04-18 14:15:38 +02:00
robot-clickhouse
c53f2b763f Automatic style fix 2023-04-17 16:17:02 +00:00
Igor Nikonov
1deaf788f4 Fix: do not run test_store_cleanup_disk_s3 in parallel 2023-04-17 16:00:34 +00:00
Michael Lex
51c9ae05fb Fix unexpected part name error when trying to drop a ignored detache partition with zero copy replication 
Before this fix, the integration test failed with this error

E           Code: 233. DB::Exception: Received from 172.22.0.9:9000. DB::Exception: Unexpected part name: ignored_all_0_0_0 for format version: 1. Stack trace:
E
E           0. /home/ubuntu/clickhouse/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x19bc7d02 in /usr/bin/clickhouse
E           1. /home/ubuntu/clickhouse/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x19bc7ccd in /usr/bin/clickhouse
E           2. /home/ubuntu/clickhouse/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x3194fae0 in /usr/bin/clickhouse
E           3. /home/ubuntu/clickhouse/src/Common/Exception.cpp:89: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x2268ae6e in /usr/bin/clickhouse
E           4. /home/ubuntu/clickhouse/src/Common/Exception.h:54: DB::Exception::Exception(String&&, int, bool) @ 0x19bbb00a in /usr/bin/clickhouse
E           5. /home/ubuntu/clickhouse/src/Common/Exception.h:81: DB::Exception::Exception<String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&>::type>, String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&) @ 0x2c4f318c in /usr/bin/clickhouse
E           6. /home/ubuntu/clickhouse/src/Storages/MergeTree/MergeTreePartInfo.cpp:23: DB::MergeTreePartInfo::fromPartName(String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>) @ 0x2c4f0867 in /usr/bin/clickhouse
E           7. /home/ubuntu/clickhouse/src/Storages/StorageReplicatedMergeTree.cpp:8305: DB::(anonymous namespace)::getParentLockedBlobs(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, String const&, String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>, Poco::Logger*) @ 0x2bca90f7 in /usr/bin/clickhouse
 2023-04-17 15:57:41 +00:00
Dmitry Novik
6f501f983e
Update test.py 2023-04-17 17:47:03 +02:00
Han Fei
ae67375769 suppress test_system_replicated_fetches 2023-04-17 16:58:36 +02:00
serxa
4370abf3c4 Try fix flacky test_concurrent_alter_move_and_drop 2023-04-17 10:33:59 +00:00
Kseniia Sumarokova
8bc0a3a899
Merge pull request #48759 from kssenii/fix-mysql-named-collection 
Fix some settings of mysql dictionary with named collection
 2023-04-17 11:18:04 +02:00
Alexey Milovidov
82fe9d4dbe
Merge pull request #48789 from vitlibar/fix-flaky-test-backup-all 
Fix flaky test test_backup_all
 2023-04-17 06:24:58 +03:00
Kseniia Sumarokova
000a63d61c
Merge pull request #48803 from vitlibar/allow-integration-tests-without-spark 
Allow running integration tests without spark
 2023-04-16 11:54:21 +02:00
Igor Nikonov
cdd9aef6f7 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-15 12:35:32 +00:00
Kseniia Sumarokova
8a548b7901
Merge branch 'master' into fix-flaky-test_upgrade_while_mutation 2023-04-15 13:19:14 +02:00
Kseniia Sumarokova
9e7d8000a3
Update cluster.py 2023-04-15 13:00:38 +02:00
Vitaly Baranov
80d6b82ac9 Allow starting integration tests without spark. 2023-04-15 11:29:03 +02:00
robot-clickhouse
6c03b2ef0c Automatic style fix 2023-04-14 20:38:11 +00:00
Igor Nikonov
60dbb7b406 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-14 20:11:51 +00:00
Igor Nikonov
9e92c26d53 Fix test_storage_mysql/test.py::test_settings_connection_wait_timeout 2023-04-14 20:10:57 +00:00
Smita Kulkarni
74c6ca558b Removed line from test_disallow_concurrrency for CI checks 2023-04-14 18:03:46 +02:00
Vitaly Baranov
39705ee205 Fix flaky test test_backup_all[True]. 2023-04-14 18:00:52 +02:00
Dmitry Novik
cf5d9a175a Revert "Merge pull request #48760 from ClickHouse/revert-46089-background-memory-tracker" 
This reverts commit a61ed33223, reversing
changes made to 5f01b8a2b5.
 2023-04-14 16:34:19 +02:00
Igor Nikonov
4dfad9ed9d Try to fix flaky intergration test 
test_storage_mysql/test.py:test_settings_connection_wait_timeout
 2023-04-14 14:33:33 +00:00
Vitaly Baranov
8989f3a243
Merge pull request #48741 from vitlibar/fix-zero-copy-replication-on-encrypted-disks 
Fix zero-copy-replication on encrypted disks.
 2023-04-14 16:18:04 +02:00
Kseniia Sumarokova
fd85f0b108
Update tests/integration/test_version_update_after_mutation/test.py 
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-04-14 16:11:37 +02:00
kssenii
5bc9a98aab Fxi 2023-04-14 15:35:39 +02:00
Kseniia Sumarokova
6a0d9a37ce
Merge branch 'master' into fix-mysql-named-collection 2023-04-14 12:03:51 +02:00
Kseniia Sumarokova
54518bf928
Merge branch 'master' into better-tests-for-data-lakes 2023-04-13 23:45:12 +02:00
Igor Nikonov
fa6346008a Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-13 20:55:18 +00:00
robot-clickhouse
39df2bde85 Automatic style fix 2023-04-13 20:52:16 +00:00
Igor Nikonov
eacbd2bf1e Fix test_storage_mysql/test_settings_connection_wait_timeout 2023-04-13 20:26:23 +00:00
Alexander Tokmakov
af1bf08663
Revert "Add MemoryTracker for the background tasks" 2023-04-13 21:05:02 +03:00
kssenii
ad48e1d010 Fox 2023-04-13 19:36:25 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
kssenii
b9811573be Better 2023-04-13 15:10:49 +02:00