Commit Graph

6505 Commits

Author SHA1 Message Date
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882)
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 13:11:10 +02:00
Sema Checherinda
0b4ea3e2e1 remove reminder comments 2023-05-30 12:26:20 +02:00
Sema Checherinda
fe3939287b add test, fix .gin_sid files 2023-05-30 12:26:20 +02:00
alesapin
6b7e2a0041
Merge pull request #49961 from CheSema/mem-consumption-s3-write
Introduce a limitation of async calls inside s3 write buffer, make a test that memory is bounded even when s3 is slow
2023-05-29 13:29:01 +02:00
Han Fei
806ef08e5f
Merge pull request #50306 from helifu/master1
Fix a typo
2023-05-29 10:34:38 +02:00
helifu
1821933995 Fix a typo 2023-05-29 15:12:16 +08:00
helifu
e9ffc383da Add input parameter 'base_config_dir' 2023-05-28 12:59:34 +08:00
helifu
7c3fa3658d fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
6a64fa6c6c Node2 cannot be started due to a conflict with config.xml merge 2023-05-28 12:59:34 +08:00
helifu
1d1d84497e Fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
e98cd5d44c Fix failed test cases
test_system_logs/test_system_logs.py::test_system_logs_order_by_expr PASSED   [ 33%]
test_system_logs/test_system_logs.py::test_system_logs_engine_expr PASSED     [ 66%]
test_system_logs/test_system_logs.py::test_system_logs_settings_expr PASSED   [100%]
2023-05-28 12:59:34 +08:00
helifu
b2d7a48095 fix a style checking issue 2023-05-28 12:59:34 +08:00
helifu
780e9df08d fix the config file name 2023-05-28 12:59:34 +08:00
helifu
01158e783a Add test case for 'engine','settings' configuration 2023-05-28 12:59:34 +08:00
helifu
4013ec982f Add test case for 'order_by' configuration 2023-05-28 12:59:34 +08:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Sema Checherinda
7031796d3f fixing tests 2023-05-26 18:59:21 +02:00
Sema Checherinda
206efee9b7 add test with merge tree table 2023-05-26 18:59:21 +02:00
Sema Checherinda
4249bda449 s3_max_inflight_parts_for_one_file with tests 2023-05-26 18:59:11 +02:00
Kseniia Sumarokova
2e17503d36
Merge pull request #50187 from kssenii/fix-pg-source
Fix PostgreSQLSource reading all unread the data in onFinish
2023-05-24 22:51:48 +02:00
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Kruglov Pavel
9545100c9e
Merge pull request #45427 from attack204/urlCluster
Add urlCluster table function and refactor all *Cluster table functions
2023-05-24 13:32:56 +02:00
SmitaRKulkarni
f39c81d13e
Merge pull request #49982 from ClickHouse/Fix_flaky_test_ssl_cert_authentication
Fix flaky test_ssl_cert_authentication to use urllib3
2023-05-23 13:57:22 +02:00
Antonio Andelic
3e6314675c
Merge pull request #49930 from AVMusorin/write-buffer-from-s3
Fix metrics `WriteBufferFromS3Bytes`, `WriteBufferFromS3Microseconds` and `WriteBufferFromS3RequestsErrors`
2023-05-23 12:26:05 +02:00
avogar
88e4c93abc Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-22 19:19:57 +00:00
Nikolay Degterinsky
7bed59e1d2
Merge pull request #50000 from evillique/add-schema-inference
Add schema inference to more table engines
2023-05-22 17:24:30 +02:00
Kruglov Pavel
b5cad024e0
Merge branch 'master' into urlCluster 2023-05-22 14:59:34 +02:00
Alexander Tokmakov
c89f92e1f6
Merge pull request #50052 from amosbird/fix_49913
Fix reporting broken projection parts
2023-05-22 14:20:06 +03:00
robot-clickhouse
a0b384bc48 Automatic style fix 2023-05-22 08:30:04 +00:00
Smita Kulkarni
855f0abcf9 Removed unneeded try-except 2023-05-22 10:20:45 +02:00
Antonio Andelic
3a46fe1803
Merge branch 'master' into write-buffer-from-s3 2023-05-22 09:28:14 +02:00
Antonio Andelic
93cd47fd5f
Merge pull request #50026 from ClickHouse/fix-deadlock-attach-thread
Avoid deadlock when starting table in attach thread of `ReplicatedMergeTree`
2023-05-22 09:22:33 +02:00
Amos Bird
8a40a48a49
Fix python format 2023-05-22 00:44:17 +08:00
Amos Bird
0a3d986e42
Fix reporting projection broken part 2023-05-21 20:58:58 +08:00
Antonio Andelic
4af8187464 Activate restarting thread in both cases 2023-05-19 15:06:02 +00:00
Antonio Andelic
7f60af11cb
Merge branch 'master' into write-buffer-from-s3 2023-05-19 15:17:05 +02:00
robot-clickhouse
f947d1cc0a Automatic style fix 2023-05-19 13:00:26 +00:00
Antonio Andelic
3107070e76 Avoid deadlock when starting table in attach thread 2023-05-19 12:48:19 +00:00
Sergei Trifonov
5db5f6e44b
Merge branch 'master' into fix-throttlers 2023-05-19 14:08:36 +02:00
alesapin
6676285f02
Merge pull request #49921 from azat/tests/fix-test_distributed_load_balancing
Fix flakiness of test_distributed_load_balancing test
2023-05-19 13:00:38 +02:00
alesapin
632ab8a3d1
Merge pull request #49996 from ClickHouse/az
Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails
2023-05-19 12:58:47 +02:00
alesapin
e5b001abda
Merge branch 'master' into fix_some_tests4 2023-05-19 12:34:03 +02:00
Alexey Milovidov
c1b96fd2f5
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-19 12:37:55 +03:00
Azat Khuzhin
dc353faf44 Simplify obtaining query shard in test_distributed_load_balancing
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-19 06:07:58 +02:00
Azat Khuzhin
e37e8f83bb Fix flakiness of test_distributed_load_balancing
I saw the following in the logs for the failed test:

    2023.05.16 07:12:12.894051 [ 262 ] {74575ac0-b296-4fdc-bc8e-3476a305e6ea} <Warning> ConnectionPoolWithFailover: Connection failed at try №1, reason: Timeout exceeded while reading from socket (socket (172.16.3.2:9000), receive timeout 2000 ms)

And I think that the culprit is the
test_distributed_replica_max_ignored_errors for which it is normal,
however not for others, and this should not affect other tests.

So fix this by calling SYSTEM RELOAD CONFIG, which should reset error
count.

CI: https://s3.amazonaws.com/clickhouse-test-reports/49380/5abc1a1c68ee204c9024493be1d19835cf5630f7/integration_tests__release__[3_4].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-19 06:07:58 +02:00
Michael Kolupaev
e84f0895e7 Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
Nikolay Degterinsky
b8be714830 Add schema inference to more table engines 2023-05-19 00:44:27 +00:00
Michael Kolupaev
8dc59c1efe Fix test_insert_same_partition_and_merge failing if one Azure request attempt fails 2023-05-18 21:40:24 +00:00
robot-clickhouse
378beb20e8 Automatic style fix 2023-05-18 07:46:02 +00:00
SmitaRKulkarni
b7c9964710
Merge branch 'master' into Fix_flaky_test_ssl_cert_authentication 2023-05-18 09:27:32 +02:00