Commit Graph

7837 Commits

Author SHA1 Message Date
Arthur Passos
5e158f8a7d fix black 2023-10-04 10:57:38 -03:00
Arthur Passos
c904cd42e4 add back import os 2023-10-04 10:27:28 -03:00
Arthur Passos
fec4c392af opsy 2023-10-03 14:22:25 -03:00
Arthur Passos
3412dc89c6 rename setting 2023-10-03 13:53:38 -03:00
Arthur Passos
032a74ec3a make sure instance env variables override global ones 2023-10-03 10:33:55 -03:00
Arthur Passos
9695bf5db9 Revert "rename setting"
This reverts commit 0b97cd49e8.
2023-10-02 18:26:31 -03:00
Arthur Passos
0b97cd49e8 rename setting 2023-10-02 18:21:20 -03:00
Arthur Passos
3813e59b49 minor 2023-10-02 18:19:41 -03:00
Arthur Passos
e74e7ae19a more docs 2023-10-02 16:09:35 -03:00
Arthur Passos
23074c2c03 add comment 2023-10-02 16:04:02 -03:00
Arthur Passos
5eda3dfc39 add exclusive_environment_variables option to inte gtests 2023-10-02 15:59:15 -03:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch
Remove Meilisearch
2023-10-01 01:57:04 +03:00
Alexey Milovidov
5ef68f0b36 Fix integration test 2023-09-30 23:03:35 +02:00
Julian Maicher
7db4023928 style: Apply black formatter 2023-09-30 07:04:05 +02:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
180562adfb
Merge pull request #55132 from ClickHouse/fix_deadlock_backups
Fix deadlock in backups
2023-09-30 07:20:19 +03:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Alexey Milovidov
d8b5713023 Remove the removal of broken detached parts 2023-09-30 01:47:44 +02:00
alesapin
54c48df486 Fix test 2023-09-29 14:03:58 +02:00
Nikolai Kochetov
8468e90a01
Merge pull request #55105 from ClickHouse/split-compatibility-tests
Clean data dir and always start an old server version in aggregate functions compatibility test.
2023-09-29 13:47:14 +02:00
Alexey Milovidov
8f9a227de1
Merge pull request #54931 from yariks5s/s3_style_url
s3-style URL fix
2023-09-29 07:12:01 +03:00
Nikolay Degterinsky
6539d52b9e
Merge pull request #50372 from helifu/master3
Support dynamic adjustment of log level in Keeper
2023-09-28 23:47:49 +02:00
Sema Checherinda
f73eef9ed8
Merge pull request #54697 from CheSema/s3_retry_cancelation_point
add cancelation point to s3 retries
2023-09-28 19:01:09 +02:00
robot-clickhouse
87e434304c Automatic style fix 2023-09-28 15:47:24 +00:00
Nikolai Kochetov
1326d9935f Clean data dir and always start an old server version in aggregate functions compatibility test. 2023-09-28 15:28:26 +00:00
yariks5s
ad94e08b0b made using macroses 2023-09-28 15:17:15 +00:00
Igor Nikonov
6132382044
Merge pull request #54987 from ClickHouse/fix-test-parallel-replicas-over-distributed
Fix test parallel replicas over distributed
2023-09-28 14:20:57 +02:00
Vitaly Baranov
22cdc012d1 Add test cases. 2023-09-28 13:02:07 +02:00
Sema Checherinda
013a44db94 style fix 2023-09-28 00:15:14 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
yariks5s
d94e989391 black check 2023-09-27 20:27:48 +00:00
yariks5s
adf1af63a5 added tests, moved domains to config 2023-09-27 18:53:05 +00:00
robot-clickhouse-ci-1
7a825c1417
Merge pull request #54427 from Avogar/json-object-as-tuple-inference
Add new features to schema inference for JSON formats
2023-09-27 20:12:45 +02:00
kssenii
c579f5b321 Fix style check 2023-09-27 20:10:05 +02:00
kssenii
e0ff76a7f9 Fix 2023-09-27 18:44:53 +02:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
2023-09-26 23:09:34 +03:00
Alexey Milovidov
29d3b34dfc
Merge pull request #54090 from ClickHouse/remove-current-status
Remove CurrentStatusInfo
2023-09-26 21:38:07 +03:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109)
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2023-09-26 17:50:19 +02:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists
Implement `createIfNotExists` in Keeper natively
2023-09-26 16:04:51 +02:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
János Benjamin Antal
6d254aa557 Remove tests 2023-09-26 09:02:12 +00:00
avogar
6dcaa387b1 Fix style 2023-09-25 22:15:41 +00:00
avogar
cabb3ddaae Fix tests 2023-09-25 21:45:11 +00:00
Kruglov Pavel
92de61ca5b Use less attempts 2023-09-25 21:04:12 +02:00
avogar
4fb12f8703 Add retries to rests test_async_query_sending/test_async_connect 2023-09-25 21:04:12 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
Igor Nikonov
5a62f4cb99 Merge remote-tracking branch 'origin/master' into fix-test-parallel-replicas-over-distributed 2023-09-25 12:22:35 +00:00
Igor Nikonov
9a788c3cac Fix: sync replicas to get consisten result 2023-09-25 12:21:12 +00:00
kssenii
e4256eb268 Better 2023-09-25 13:44:45 +02:00
kssenii
47050c2605 Merge remote-tracking branch 'upstream/master' into s3-queue-fixes 2023-09-25 13:42:52 +02:00
alesapin
75b2f90923
Merge pull request #54772 from Avogar/less-flaky-async-tests
Add retries to rests test_async_query_sending/test_async_connect
2023-09-25 12:05:11 +02:00
Alexey Milovidov
580f3c1a01 Merge branch 'master' into remove-current-status 2023-09-24 20:56:17 +02:00
Alexey Milovidov
664ac27cf2
Merge pull request #54507 from ClickHouse/flush-logs-for-system-backup-logs-test
Flush logs for system.backup_log test.
2023-09-23 22:33:21 +03:00
Alexander Tokmakov
21ffbd88de
Merge pull request #54859 from ClickHouse/fix_zero_copy_locks
Fix zero copy locks with hardlinks
2023-09-22 18:27:03 +02:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Vitaly Baranov
3a2ca1f69c
Merge pull request #51261 from evillique/users-valid-until
Add VALID UNTIL clause for users
2023-09-22 12:38:30 +02:00
Antonio Andelic
316f42def6
Merge pull request #54745 from ClickHouse/keeper-reduce-batch-size
Revert default batch size for Keeper
2023-09-21 17:44:33 +02:00
Pavel Novitskiy
853e3f0aa7
Add drop table IF EMPTY (#48915) 2023-09-21 09:20:18 -04:00
Antonio Andelic
13815a96bf
Fix test 2023-09-21 09:07:40 +02:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
Nikolai Kochetov
2dc2b2050e
Update test.py 2023-09-20 17:16:50 +02:00
Antonio Andelic
b65b1ee97b Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-20 13:56:36 +00:00
Alexey Milovidov
d31a6f253e
Merge pull request #54816 from azat/tests/fix-test_backup_restore_on_cluster
Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness
2023-09-20 13:30:19 +03:00
alesapin
2ff36b6e0c
Merge pull request #54768 from ClickHouse/better_exception_in_check_data_part
Better exception message in checkDataPart
2023-09-20 12:04:46 +02:00
Azat Khuzhin
56dca144cc Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 07:09:51 +02:00
alesapin
accbe24e08 Fix test 2023-09-19 18:42:46 +02:00
Kruglov Pavel
a02b6d03d7
Use less attempts 2023-09-19 13:32:49 +02:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
avogar
838668e9df Add retries to rests test_async_query_sending/test_async_connect 2023-09-18 19:35:08 +00:00
robot-clickhouse
ca64e26994 Automatic style fix 2023-09-18 11:28:36 +00:00
Antonio Andelic
69333912d5 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-18 10:57:11 +00:00
Igor Nikonov
fae229e3ea Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-17 21:03:56 +00:00
robot-ch-test-poll1
a2ed5c2cae
Merge pull request #54174 from ClickHouse/vdimir/fix_hostname_const
Fix hostname and co result constness in new analyzer
2023-09-16 19:37:08 +02:00
robot-clickhouse
66c2ac9364 Automatic style fix 2023-09-16 00:32:32 +00:00
János Benjamin Antal
d975ee7608 Fix argument parsing bug 2023-09-16 00:07:54 +00:00
János Benjamin Antal
16e2f7f0b9 Add optional version argument to rm 2023-09-16 00:03:46 +00:00
kssenii
6846fe3c58 Fxi 2023-09-15 14:21:08 +02:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter
Bugfix/local multiquery parameter
2023-09-15 11:46:08 +02:00
vdimir
1aa18e0eb6
Analyzer: Remove constants from header in StorageDistributed 2023-09-14 16:44:18 +00:00
kssenii
342755d35e Better 2023-09-14 18:41:31 +02:00
kssenii
afcb0b2b9a Merge remote-tracking branch 'upstream/master' into s3-queue-fixes 2023-09-14 17:16:29 +02:00
Kseniia Sumarokova
eeb2c5b223
Merge pull request #53220 from valbok/double-to-single
MaterializedMySQL: Introduce Character Set Introducers
2023-09-14 13:18:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql
Implement the MySQL binary protocol implementation for initial support of Tableau Online
2023-09-14 12:27:11 +02:00
Antonio Andelic
6306180333
Merge pull request #53049 from ClickHouse/keeper-batch-flushes
Try batching multiple flush requests in Keeper
2023-09-14 11:39:33 +02:00
Val Doroshchuk
6cfbaf9f86 MaterializedMySQL: Introduce Character Set Introducers
If some string literals are used in DDL, they might have `Character Set Introducers`
https://dev.mysql.com/doc/refman/8.0/en/charset-introducer.html
f.e. _utf8mb4'1' which is not parsable by current ParserStringLiteral.

Since we use utf8 by default, suggesting to automatically convert the string literals to utf8
before executing the query and avoid any charset introducers there.
Conversion from utf8 to utf8 is not needed and skipped.

Also it might convert double quotes to single quotes if any
which might solve issues with COMMENT and empty string literals "" in DEFAULT expressions.

SELECT _latin1"abc"; -- might be also valid for MySQL
... DEFAULT "",
... COMMENT "abc"

Currently no DEFAULT expressions are supported, not parsable at all,
but using this MR it allows to parse the expressions together with double quotes as string literals.
2023-09-14 08:24:25 +02:00
bakam412
c5c3833a80 fix tests 2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d Fix LowCardinality/Nullable columns issues 2023-09-13 23:40:31 +02:00
slvrtrn
c0961d9378 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-13 19:33:11 +02:00
Nikolay Degterinsky
0998b0bbc7 Fixes 2023-09-13 03:14:02 +00:00
Nikolay Degterinsky
268c45d900 Merge remote-tracking branch 'upstream/master' into users-valid-until 2023-09-12 23:44:22 +00:00
pufit
85b23e9403 Increase default timeout in tests for keeper-client 2023-09-12 14:06:57 -04:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
pufit
a54a7b726d
Merge pull request #54201 from ClickHouse/pufit/keeper-client-reconfig
Implementing `reconfig`, `sync`, `exists` commands for keeper-client
2023-09-12 10:58:02 -04:00
Nikolai Kochetov
894024a830
Update test.py 2023-09-12 13:54:26 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Alexey Milovidov
e9daff6c2f
Merge pull request #54506 from azat/system.detached_parts-modification_time
Add modification_time into system.detached_parts
2023-09-12 04:53:59 +03:00
Alexey Milovidov
ee8db35d66
Merge pull request #51449 from ClickHouse/cbrace
Fix data race in copyFromIStreamWithProgressCallback
2023-09-12 04:51:13 +03:00
Sema Checherinda
0ea0799118
Merge pull request #54430 from CheSema/remove-recursive-with-projection
reproduce and fix the bug in removeSharedRecursive
2023-09-12 00:18:55 +02:00
Michael Kolupaev
df71dcd94d Fix data race in copyFromIStreamWithProgressCallback 2023-09-11 21:04:37 +00:00
pufit
4f5d132019 Fix timeout keeper-client 2023-09-11 14:46:40 -04:00
Azat Khuzhin
8cd6153c83 Add modification_time into system.detached_parts
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-11 20:29:55 +02:00
Nikolai Kochetov
d86d92fa2d Flush logs for system.backup_log test. 2023-09-11 12:58:04 +00:00
Antonio Andelic
1494eb3a86 Fix version parsing 2023-09-11 12:34:16 +00:00
Igor Nikonov
f3f3eddd52 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-11 12:13:45 +00:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
Mikhail f. Shiryaev
61f0683f1c
Merge pull request #54043 from ClickHouse/revert-53929-revert-53713-ADQM-1107
undefined
2023-09-11 11:34:18 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
2023-09-11 06:18:47 +02:00
Igor Nikonov
3a78ba6de4 Fix, enable tests, make cluster_for_parallel_replicas empty by default 2023-09-09 21:36:39 +00:00
Mikhail f. Shiryaev
c7e058fa6e
Disable broken tests 2023-09-09 23:21:16 +02:00
Mikhail f. Shiryaev
b17dc582a5
Disable test_disk_over_web_server for analyzer 2023-09-09 23:21:15 +02:00
Mikhail f. Shiryaev
5f0d94d523
Disable broken tests to have the bug fixed 2023-09-09 23:21:14 +02:00
Mikhail f. Shiryaev
b610faf685
Revert "Revert "Fixed wrong python test name pattern"" 2023-09-09 23:21:14 +02:00
Igor Nikonov
9464433683 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-09 19:48:50 +00:00
Robert Schulze
4d2223defe
Merge pull request #54119 from mkmkme/mkmkme/aklomp-base64
Replace Turbo-Base64 with aklomp/base64
2023-09-09 16:24:26 +02:00
Sema Checherinda
1298dba0c6 fix the bug, add useful logs 2023-09-09 15:54:28 +02:00
Alexey Milovidov
2e2e226e1d
Merge pull request #54367 from Avogar/fix-flaky-azure-schema-cache-test
Fix flaky test test_storage_azure_blob_storage/test.py::test_schema_iference_cache
2023-09-08 23:48:44 +03:00
robot-ch-test-poll4
839f69c940
Merge pull request #53765 from vitlibar/sync-uuids-of-tables-on-replicas
Sync UUIDs of tables on replicas after RESTORE
2023-09-08 17:30:32 +02:00
kssenii
220a67eca7 Better 2023-09-08 16:38:05 +02:00
Antonio Andelic
5207997bd4 Merge branch 'master' into keeper-batch-flushes 2023-09-08 13:05:47 +00:00
Sema Checherinda
44e432deab style fix 2023-09-08 00:21:21 +02:00
Sema Checherinda
411a97ff36 reproduce a bug in removeSharedRecursive 2023-09-07 21:15:30 +00:00
Robert Schulze
46e1d05a89
Fix another test 2023-09-07 19:43:01 +00:00
kssenii
7338b560a8 S3Queue fixes 2023-09-07 19:17:21 +02:00
Kruglov Pavel
8c2b45aab3
Fix style 2023-09-07 18:42:04 +02:00
Kruglov Pavel
7abc9c896d
Fix style 2023-09-07 18:06:46 +02:00
Nikolay Degterinsky
483184cbdb Add cluster groups to Replicated database engine 2023-09-07 16:02:11 +00:00
serxa
a94ae9a7ab review fixes 2023-09-07 14:02:58 +00:00
Igor Nikonov
ce8e72e464
Merge pull request #54377 from ClickHouse/pr-distributed-tests-disable-plr
Disable prefer_localhost_replica in test for parallel replicas
2023-09-07 11:59:42 +02:00
Igor Nikonov
2c85c28113 Cleanup 2023-09-07 07:15:42 +00:00
robot-clickhouse
cc78926919 Automatic style fix 2023-09-07 00:44:54 +00:00
pufit
ef2350cfc7 Implementing exists, sync commands. Better tests 2023-09-06 20:36:39 -04:00
Alexey Milovidov
539394b463
Merge pull request #54371 from Avogar/try-fix-async-query-sending-test
Enable hedged requests integration tests with tsan, use max_distributed_connections=1 to fix possible flakiness
2023-09-07 01:57:24 +03:00
robot-clickhouse
6404768aa4 Automatic style fix 2023-09-06 22:45:17 +00:00
Igor Nikonov
724e2ee4f7 Disable prefer_localhost_replica in tests 2023-09-06 22:27:41 +00:00
robot-clickhouse
cd7c57f5d4 Automatic style fix 2023-09-06 19:00:05 +00:00
Igor Nikonov
f938c38eb9 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-06 18:47:43 +00:00
serxa
664efaf3fa add test 2023-09-06 18:35:40 +00:00
SmitaRKulkarni
f0146c0ff0
Increase retries for test_merge_tree_azure_blob_storage (#54069)
* Increase max_single_download_retries & max_single_read_retries for test_merge_tree_azure_blob_storage

* Updated logs to log exception leading to detaching part

* Updated to catch RequestFailedException azure exception as its the base exception

* Updated isRetryableExcepion to take std::exception_ptr as input

* Fixed style check fails

* Fix build issue & moved NetException & TimeoutException to retryable exceptions

* Fixed style check with catch
2023-09-06 19:57:59 +02:00
Kruglov Pavel
c3fb0ef5d4
Fix style 2023-09-06 19:42:14 +02:00
avogar
e44580fa47 Enable hedged requests integration tests with tsan, use max_distributed_connections=1 to fix possible flakiness 2023-09-06 17:15:23 +00:00
avogar
76acc77e66 Fix flaky test test_storage_azure_blob_storage/test.py::test_schema_inference_cache 2023-09-06 16:39:45 +00:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
robot-clickhouse
87a59e7084 Automatic style fix 2023-09-05 23:12:35 +00:00
Igor Nikonov
3fe2e1084b test_read_equally_from_each_replica + prefer_localhost_replica=1 2023-09-05 22:25:34 +00:00
Joe Lynch
91f637b24a
fix python test 2023-09-05 21:03:13 +02:00