Igor Nikonov
a8e4627663
Fix: can't guarantee query distribution with enabled hedged requests
2024-02-20 12:09:54 +00:00
Igor Nikonov
d950f2c570
Merge remote-tracking branch 'origin/master' into test-insert-over-http-query-log
2024-02-20 11:32:33 +00:00
Robert Schulze
5474f36e75
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities
2024-02-20 10:09:57 +00:00
Robert Schulze
c475f3c0bd
Fix test_remote_blobs_naming
2024-02-20 10:05:54 +00:00
MikhailBurdukov
c2d641c658
Merge branch 'master' into backoff_for_failed_mutations
2024-02-20 11:48:59 +03:00
MikhailBurdukov
7cdfedaedd
Enable setting by default
2024-02-20 08:39:11 +00:00
unashi
80fe3f78d9
[fix] black the python script
2024-02-20 11:12:09 +08:00
Igor Nikonov
bb5a6dd8d3
Fix: custom key failover test flakyness
...
slowdown_count used only by hedge connections
but it's stored inside connection pool and was used for pool shuffling
always. So, query execution which used hedged connections could affect
connection load balancing for queries w/o hedged connections by updating
slowdown_count
2024-02-19 20:44:55 +00:00
robot-clickhouse
0b2c3a7f0f
Automatic style fix
2024-02-19 20:01:58 +00:00
kssenii
89006361c5
Fix test
2024-02-19 20:52:36 +01:00
Alexey Milovidov
425531067d
Merge pull request #60109 from azat/tests/integration-query-retries
...
Do not retry queries if container is down in integration tests
2024-02-19 19:23:39 +01:00
Antonio Andelic
175a1db787
Support specifying users for s3 settings
2024-02-19 16:43:27 +01:00
robot-clickhouse
cc223a1c3e
Automatic style fix
2024-02-19 14:33:53 +00:00
Igor Nikonov
e77afa9dc5
Rename test
2024-02-19 14:20:39 +00:00
Igor Nikonov
9e4e44fc71
Tests: query log records for insert over http
2024-02-19 14:18:52 +00:00
unashi
f62ccc75ec
[merge] solve
2024-02-19 19:28:16 +08:00
Igor Nikonov
f775e1a7c6
Merge pull request #59910 from ClickHouse/query-log-on-insert-exception-over-http
...
Fix: absence of closing record in query_log for failed insert over http
2024-02-19 12:27:44 +01:00
Azat Khuzhin
0496d0f45f
Do not retry queries if container is down in integration tests
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-19 11:27:41 +01:00
MikhailBurdukov
c3ab9071fc
Merge branch 'master' into backoff_for_failed_mutations
2024-02-18 17:48:11 +03:00
MikhailBurdukov
94fa87ddc6
Style
2024-02-18 14:46:48 +00:00
MikhailBurdukov
b227e5dd3f
Review changes
2024-02-18 13:37:12 +00:00
unashi
1549725edd
[feature]: allow to attach parts from a different disk
2024-02-18 19:26:12 +08:00
Alexander Tokmakov
03ff171922
Merge branch 'master' into modify-engine
2024-02-16 17:22:24 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
...
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Dmitry Novik
cacd2e6463
Merge pull request #59921 from ClickHouse/analyzer-fix-test_distributed_backward_compatability
...
Remove `test_distributed_backward_compatability`
2024-02-16 13:58:45 +01:00
Dmitry Novik
757a5b627b
Merge pull request #60019 from ClickHouse/analyzer-fix-test_sql_user_defined_functions_on_cluster
...
Analyzer: Fix test_sql_user_defined_functions_on_cluster
2024-02-16 13:57:55 +01:00
Igor Nikonov
118263d8e8
Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http
2024-02-16 12:40:10 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
...
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Igor Nikonov
7b1fbec4e5
Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http
2024-02-15 21:11:38 +00:00
Dmitry Novik
7c73af9f13
Remove test completely
2024-02-15 17:49:35 +01:00
Dmitry Novik
199ae321a0
Merge branch 'master' into analyzer-fix-test_sql_user_defined_functions_on_cluster
2024-02-15 17:45:33 +01:00
Dmitry Novik
cc59e06fea
Merge pull request #59975 from ClickHouse/analyzer-fix-test_settings_profile
...
Analyzer: Fix test_settings_profile
2024-02-15 17:44:43 +01:00
Max Kainov
5a3a93bea5
CI: refactor bugfix validate job
...
#no_merge_commit
2024-02-15 16:28:27 +00:00
Konstantin Bogdanov
dbb6804a70
Merge pull request #59976 from ClickHouse/add-cloud-placement
...
Add `PlacementInfo`
2024-02-15 19:16:56 +03:00
Igor Nikonov
1464830791
Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http
2024-02-15 12:56:32 +00:00
robot-clickhouse
ad626233a1
Automatic style fix
2024-02-15 10:43:16 +00:00
Dmitry Novik
31128ecaa7
Analyzer: Fix test_sql_user_defined_functions_on_cluster
2024-02-15 10:29:27 +00:00
Dmitry Novik
ddc429ccbc
Revert incorrect changes
2024-02-15 10:14:58 +01:00
Alexey Milovidov
10eb948ed6
Merge branch 'master' into analyzer-fix-test_wrong_db_or_table_name
2024-02-15 07:56:56 +01:00
robot-clickhouse
acba747275
Automatic style fix
2024-02-15 02:12:44 +00:00
Alexey Milovidov
27a1755751
Merge pull request #59951 from ClickHouse/analyzer-fix-test_mutations_with_merge_tree
...
Analyzer: Fix test_mutations_with_merge_tree
2024-02-15 03:11:10 +01:00
Alexey Milovidov
b31c802f4a
Merge branch 'master' into analyzer-fix-test_settings_profile
2024-02-15 03:02:30 +01:00
Alexey Milovidov
9219617959
Apply review comments
2024-02-15 03:01:34 +01:00
Raúl Marín
4fb76a6e25
Merge pull request #59969 from ClickHouse/no-aerospike
...
We don't have external dictionaries from Aerospike
2024-02-14 15:54:46 +01:00
robot-clickhouse
5f570b574e
Automatic style fix
2024-02-14 14:35:59 +00:00
kssenii
8fe9ede207
Add a test
2024-02-14 15:25:43 +01:00
Dmitry Novik
9acd68efc0
Merge branch 'master' into analyzer-fix-test_wrong_db_or_table_name
2024-02-14 13:29:45 +01:00
Dmitry Novik
824ee3efc2
Merge branch 'master' into analyzer-fix-test_mutations_with_merge_tree
2024-02-14 10:53:37 +01:00
Konstantin Bogdanov
f678bdc546
Update tests
2024-02-14 10:51:42 +01:00
Dmitry Novik
a7c7a5a671
Analyzer: Fix test_settings_profile
2024-02-14 09:50:55 +00:00
Dmitry Novik
a7c2d3146c
Merge pull request #59948 from ClickHouse/analyzer-fix-test_user_defined_object_persistence
...
Analyzer: Fix test_user_defined_object_persistence
2024-02-14 10:20:27 +01:00
Konstantin Bogdanov
3769846d4a
Lint
2024-02-14 10:20:05 +01:00
Konstantin Bogdanov
c71835ebec
Add an integration test
2024-02-14 10:19:55 +01:00
Dmitry Novik
b3e5d34204
Change used version
2024-02-14 10:16:13 +01:00
Alexey Milovidov
1fbc52fa40
Remove Aerospike
2024-02-14 05:52:39 +01:00
robot-clickhouse
bc456820a0
Automatic style fix
2024-02-13 22:19:27 +00:00
Igor Nikonov
e9dcc751ac
Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http
2024-02-13 22:08:44 +00:00
Igor Nikonov
a27639a7f9
Fix: call first exception callback on exception
...
it'll update query_log
2024-02-13 22:06:00 +00:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection
2024-02-13 19:08:33 +01:00
Dmitry Novik
30ef68d78f
Analyzer: Fix test_mutations_with_merge_tree
2024-02-13 18:59:23 +01:00
Dmitry Novik
262e8af909
Analyzer: Fix test_user_defined_object_persistence
2024-02-13 17:37:20 +01:00
Dmitry Novik
45d359cb93
Use version with execution names
2024-02-13 16:33:54 +01:00
Kseniia Sumarokova
daf1ca0625
Merge pull request #59370 from valbok/attach-db-tests
...
MaterializedMySQL: Fix gtid_after_attach_test to retry on detach
2024-02-13 13:27:29 +01:00
Dmitry Novik
21770b9d17
Bump server version
2024-02-13 10:39:45 +01:00
Dmitry Novik
d5fd7402f8
Merge remote-tracking branch 'origin/master' into analyzer-fix-test_wrong_db_or_table_name
2024-02-13 08:52:42 +00:00
robot-clickhouse
f5880d7201
Automatic style fix
2024-02-12 20:55:20 +00:00
Igor Nikonov
eb44faf867
Test to reproduce absence of closing record in query_log
2024-02-12 20:41:46 +00:00
kssenii
d008ee725f
Add a test
2024-02-12 20:23:21 +01:00
Dmitry Novik
727e0bbf6a
Merge pull request #59750 from ClickHouse/fix-analyzer-integration-server-version
...
Analyzer: Fix test_replicating_constants/test.py::test_different_versions
2024-02-12 14:40:16 +01:00
Dmitry Novik
584d197e52
Merge pull request #59801 from ClickHouse/analyzer-fix-test_access_for_functions
...
Analyzer: fix test_access_for_functions/test.py::test_access_rights_for_function
2024-02-12 14:37:48 +01:00
Nikolai Kochetov
862c6cd79c
Merge pull request #57430 from ClickHouse/non-ready-set-ttl
...
Non ready set in TTL WHERE.
2024-02-09 16:31:26 +01:00
Vitaly Baranov
09e727d48b
Merge pull request #56988 from ClickHouse/Azure_backup
...
Backup & Restore support for AzureBlobStorage
2024-02-09 14:45:35 +01:00
Dmitry Novik
6aad9b1f13
Analyzer: Fix test_wrong_db_or_table_name/test.py::test_wrong_table_name
2024-02-09 14:05:01 +01:00
Dmitry Novik
361dd64374
Fix expected error message
2024-02-09 13:41:49 +01:00
Dmitry Novik
fc34507a94
Bump version
2024-02-09 12:48:07 +01:00
kssenii
e55b60e05c
Fix
2024-02-08 17:43:16 +01:00
Nikolai Kochetov
97d1eb1091
Fixing test.
2024-02-08 14:31:24 +00:00
Dmitry Novik
fa0acaf39b
Fix image name
2024-02-08 15:18:17 +01:00
Dmitry Novik
3167bfe423
Bump server version
2024-02-08 11:35:23 +01:00
Alexander Tokmakov
510f90edf8
Merge pull request #59688 from ClickHouse/revert_39507_again
...
Temporarily remove a feature that doesn't work
2024-02-08 02:27:55 +01:00
Smita Kulkarni
e594608c42
Merge branch 'master' into Azure_backup
2024-02-07 13:48:46 +01:00
Alexander Tokmakov
77e4b0c8d9
Revert "Merge pull request #59122 from arthurpassos/bring_back_attach_partition_pr"
...
This reverts commit ac90637170
, reversing
changes made to fe2b5cde05
.
2024-02-07 02:52:43 +01:00
vdimir
9438118745
fix test_select_access_rights/test_main.py::test_select_join
2024-02-06 16:15:04 +00:00
Val Doroshchuk
ba94cd2ef7
MaterializedMySQL: Fix gtid_after_attach_test to retry on detach
2024-02-06 14:39:26 +01:00
Konstantin Bogdanov
f663f13a35
Merge pull request #59277 from ClickHouse/create-tables-in-threadpool
...
Concurrent tables creation in `recoverLostReplica`
2024-02-05 16:04:46 +03:00
MikhailBurdukov
97ee8c0901
remove old config
2024-02-04 11:25:47 +00:00
MikhailBurdukov
b90a5b94a8
Move setting to mergetree
2024-02-04 11:24:26 +00:00
robot-clickhouse
ce6df0fb13
Automatic style fix
2024-02-04 10:37:05 +00:00
Smita Kulkarni
b0994c5fa7
Addressed comments, added test for named collection
2024-02-04 11:28:20 +01:00
Julia Kartseva
f41f4e4bd0
Merge pull request #58486 from jkartseva/adjustable-async-timeouts
...
Adjustable asynchronous insert timeouts
2024-02-02 08:53:58 -08:00
Konstantin Bogdanov
6df4c64500
Use in integration test
2024-02-02 13:20:32 +01:00
Julia Kartseva
689c368b76
Adaptive async timeouts: consider queue flush history
...
In addition to the time since the most recent insert,
consider the elapsed time between the two recent queue
flushes when decreasing the timeout or processing an
entry synchronously.
2024-02-01 22:45:10 +00:00
Julia Kartseva
17d2455448
Integration tests for adaptive async insert timeout
...
Add initial tests.
2024-02-01 22:45:09 +00:00
Kseniia Sumarokova
e029021696
Merge pull request #59446 from ClickHouse/s3-queue-allow-to-add-start-point
...
Allow to define a starting point for s3queue ordered mode at creation
2024-02-01 16:46:24 +01:00
robot-clickhouse
fe829cac48
Automatic style fix
2024-02-01 11:43:55 +00:00
kssenii
3a16427e00
Fix test
2024-02-01 12:35:01 +01:00
kssenii
f7a5f09a0f
Add one more test
2024-01-31 22:59:25 +01:00
Ilya Yatsishin
6a80a20997
Merge pull request #59432 from vitlibar/fix-test-test_stop_other_host_during_backup
...
Fix test test_stop_other_host_during_backup
2024-02-01 00:57:21 +04:00
kssenii
361b2f107b
Allow to define a starting point for s3queue ordered mode
2024-01-31 21:28:18 +01:00
Vitaly Baranov
a193e01c8f
Merge pull request #54737 from arenadata/ADQM-1150
...
Added maximum sequential login failures to the quota.
2024-01-31 16:06:17 +01:00
Vitaly Baranov
79c068571d
Fix test test_stop_other_host_during_backup.
2024-01-31 12:58:22 +01:00
Kseniia Sumarokova
b20567a055
Merge pull request #59167 from ClickHouse/s3-queue-parallelize-ordered-mode
...
S3Queue: allow parallel & disrtibuted processing for ordered mode
2024-01-31 11:20:41 +01:00
Kseniia Sumarokova
caaafbcedb
Merge pull request #56864 from ClickHouse/broken-projections-better-handling
...
Do not consider data part as broken if projection is broken
2024-01-31 11:17:15 +01:00
kssenii
145f6a31cb
Fix
2024-01-30 16:29:40 +01:00
MikhailBurdukov
778efb8953
Merge branch 'master' into backoff_for_failed_mutations
2024-01-30 16:08:52 +03:00
MikhailBurdukov
5e845172da
Enable per query setting
2024-01-30 12:42:03 +00:00
Kruglov Pavel
3105960fd8
Merge pull request #59352 from Avogar/fix-bad-attached-rabbitmq
...
Fix lazy initialization in RabbitMQ
2024-01-30 12:52:07 +01:00
Kruglov Pavel
bab6e6fe34
Fix tests
2024-01-30 11:37:32 +01:00
Kseniia Sumarokova
e16aaa8d81
Merge branch 'master' into broken-projections-better-handling
2024-01-30 10:54:22 +01:00
Kruglov Pavel
ff1cdf6bee
Restart CI
2024-01-30 00:42:51 +01:00
Alexey Gerasimchuck
559de083a3
Implemented failed login attempt counting using quota
2024-01-29 23:20:38 +00:00
avogar
3a5ba56c36
Fix lazy initialization in RabbitMQ, fix possible deadlock on insert into unitialized queue engine
2024-01-29 20:09:09 +00:00
robot-clickhouse
50439cc1d5
Automatic style fix
2024-01-29 19:14:22 +00:00
kssenii
36dc076bbf
Update test
2024-01-29 20:04:38 +01:00
kssenii
df7d3b8a40
Allocate current shard number from keeper
2024-01-29 19:36:16 +01:00
Arthur Passos
15d04d0a78
Merge branch 'master' into bring_back_attach_partition_pr
2024-01-29 15:16:49 -03:00
avogar
377937d415
Merge branch 'master' of github.com:ClickHouse/ClickHouse into auto-format-detection
2024-01-29 15:45:18 +00:00
kssenii
ef252d8376
Validate settings with keeper, add a test
2024-01-29 12:36:00 +01:00
kssenii
5c5ec7465b
Update test
2024-01-29 12:28:29 +01:00
Smita Kulkarni
3183026521
Merge branch 'master' into Azure_backup
2024-01-29 11:08:13 +01:00
Kseniia Sumarokova
a29ab8f29c
Merge pull request #59170 from azat/disks/s3-plain-improvements
...
Small improvements for tables on write-once (s3_plain)/read-only (web) disks
2024-01-29 10:44:37 +01:00
Azat Khuzhin
4248ae509a
Support specifying settings for Distributed engine in config (like for MergeTree)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-27 18:06:16 +01:00
Kseniia Sumarokova
2c6243f365
Update test.py
2024-01-26 19:52:53 +01:00
vdimir
6795d0207f
Update test_reload_after_fail_in_cache_dictionary for analyzer
2024-01-26 16:37:54 +00:00
Azat Khuzhin
7cc7fb892c
tests/test_disk_over_web_server: update expected assertion for static storage
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:36 +01:00
Azat Khuzhin
66a40bda0a
Revert "Prohibit DROP from static storages"
...
It is actually OK to DROP at least from read-only disk, as for the
write-once it should be OK as well, since CREATE is prohibited anyway,
so there should be no leftovers
CI: https://s3.amazonaws.com/clickhouse-test-reports/59170/c82050d1925439f0ede2b32acb5b1b8df4acae5d/stress_test__asan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/59170/c82050d1925439f0ede2b32acb5b1b8df4acae5d/integration_tests__asan__[3_4].html
This reverts commit 082e62712c5e2f4c48d1abc6141ccfd1249d26b4.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
Azat Khuzhin
1ee723d50d
Prohibit DROP from static storages
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
kssenii
5cd757dd9a
Merge remote-tracking branch 'origin/master' into s3-queue-parallelize-ordered-mode
2024-01-26 16:33:22 +01:00
Kseniia Sumarokova
99653fc778
Merge branch 'master' into broken-projections-better-handling
2024-01-26 16:27:23 +01:00
Kruglov Pavel
946c4e0495
Merge branch 'master' into auto-format-detection
2024-01-26 15:51:35 +01:00
Arthur Passos
ce6877cbb6
Merge branch 'ClickHouse:master' into bring_back_attach_partition_pr
2024-01-26 10:57:11 -03:00
kssenii
7515fa99f4
I hope now
2024-01-26 13:15:15 +01:00
Kruglov Pavel
13c8624871
Fix style
2024-01-26 02:03:12 +01:00
Kruglov Pavel
918614970b
Fix style
2024-01-26 02:02:03 +01:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection
2024-01-25 22:11:07 +01:00
robot-clickhouse
0c82926b95
Automatic style fix
2024-01-25 18:21:38 +00:00
kssenii
08b6ec439e
Try fxi
2024-01-25 19:11:55 +01:00
serxa
a40da92761
Merge branch 'master' into fix-async-loader-shutdown-deadlock
2024-01-25 11:31:05 +00:00
Kseniia Sumarokova
951c874aa9
Merge pull request #59080 from ClickHouse/data-lakes-survive-restart
...
Allow server to start with broken data lake table and fix itself lazily
2024-01-25 11:50:16 +01:00
avogar
11f1ea50d7
Fix tests
2024-01-24 17:55:31 +00:00
Nikita Taranov
067af44cbd
Merge pull request #59077 from ClickHouse/nickitat-patch-17
...
Fix `test_parallel_replicas_invisible_parts`
2024-01-24 17:19:36 +01:00
Kseniia Sumarokova
50a0494df7
Update test.py
2024-01-24 16:53:10 +01:00
kssenii
7f8f379d7f
Parallel & disrtibuted processing for ordered mode
2024-01-24 16:32:15 +01:00
Kruglov Pavel
89bafbcda6
Merge pull request #59133 from Avogar/allow-to-ignore-schema-evolution-in-iceberg
...
Allow to ignore schema evolution in Iceberg table engine under a setting
2024-01-24 13:19:09 +01:00
robot-clickhouse
41e6dd7a9d
Automatic style fix
2024-01-24 12:15:19 +00:00
serxa
0badcffdc1
test: table metadata load failure should shutdowns the server properly
2024-01-24 12:01:32 +00:00
Kseniia Sumarokova
4b40b14bba
Update test.py
2024-01-24 11:23:13 +01:00
Smita Kulkarni
4d92eba316
Merge branch 'master' into Azure_backup
2024-01-24 11:13:57 +01:00
Yarik Briukhovetskyi
f0be1ac2c4
Merge pull request #58936 from wheatdog/level-int-to-word
...
Display word-descriptive log level while enabling structured log formatting in json
2024-01-24 00:18:25 +01:00
avogar
617cc514b7
Try to detect file format automatically during schema inference if it's unknown
2024-01-23 18:59:39 +00:00
avogar
be3b5dc45f
Allow to ignore schema evolution in Iceberg table engine under a setting
2024-01-23 17:45:41 +00:00
Arthur Passos
799a94081b
Revert "Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition""
...
This reverts commit a1c83e2f51
.
2024-01-23 11:40:42 -03:00
Tim Liou
7981d182bc
Merge branch 'master' into level-int-to-word
2024-01-23 22:29:07 +08:00
Robert Schulze
a1c83e2f51
Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition"
2024-01-23 15:26:04 +01:00
kssenii
a4082f5b97
Add a test
2024-01-23 13:28:25 +01:00
Robert Schulze
9752079983
Cosmetics
2024-01-23 10:58:09 +00:00
Robert Schulze
e23e7e6b73
Merge pull request #53710 from rschu1ze/system-reload-asynchronous-metrics
...
Add statement `SYSTEM RELOAD ASYNCHRONOUS METRICS`
2024-01-23 11:56:25 +01:00
kssenii
b76630c955
Merge remote-tracking branch 'origin/master' into broken-projections-better-handling
2024-01-23 11:34:58 +01:00
Robert Schulze
8fc918b272
Fix style, pt. III
2024-01-23 06:23:34 +00:00
Robert Schulze
e72b44a0bf
Fix style, pt. II
2024-01-23 05:58:24 +00:00
Nikita Taranov
09e24ed6c5
Merge pull request #58068 from zhongyuankai/limit_materialized_view_size
...
A limit on the number of materialized views attached to a table.
2024-01-22 22:50:56 +01:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition ( #39507 )
...
* temp commit
* temp commit
* draft impl for feedback
* fix weird style changes
* fix weird style changes
* fix weird style changes
* fix weird style changes
* fix weird style changes
* aa
* aa
* Add integ tests and remove partition key restriction
* fix small incosistency in partition id
* style fix
* style fix
* style fix
* use existing DataPartStorageBuilder instead of new one
* Refactor part clone to make it more readable and maintainable
* Add MergeTreeDataPartCloner docs
* define ErrorCodes::BAD_ARGUMENTS
* Rebase
* camel case methods
* address some comments
* yet another rebase?
* Move from integ tests to stateless tests
* address more comments
* add finalize on min_max_idx files
* Add sync option to DistinctPartitionExpCloner
* just a temp test
* revert temp change
* Use echoOn to distinguish test queries
* remove comment
* fix build issue during rebase
* atempt to fix build after rebase
* finally fix build
* clear minmaxidx hyperrectangle before loading it
* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns
* get it to the state it was previously
* add missing include
* getting functional?
* refactoring and renaming
* some more refactoring
* extern bad arguments
* try to fix style
* improvements and docs
* remove duplicate includes
* fix crash
* make tests more stable by ordering
* rebase once again..
* fix
* make ci happy?
* fix rebase issues
* docs
* rebase, but prolly needs to be improved
* refactor out from nasty inheritance to static methods
* fix style
* work around optional
* refactor & integrate some changes
* update column_type
* add tests by dencrane
* set utc
* fix ref file
* fix tests
* use MergeTree instead of SummingMergeTree
* mark MergeTreeDataPart::getBlock as const
* address a few comments
* compute module function name size at compile time
* simplify branching in getPartitionAstFieldsCount
* remove column_indexes argument
* merge getBlock with buildBlock
* add some const specifiers
* small adjustments
* remove no longer needed isNull check
* use std::min and max to update global min max idx
* add some assertions
* forward declare some symbols
* fix grammar
* forward decl
* try to fix build..
* remove IFunction forward decl
* Revert "use std::min and max to update global min max idx"
This reverts commit b2fe79dda7
.
* Revert "remove no longer needed isNull check"
This reverts commit 129db2610f
.
* Revert "Revert "remove no longer needed isNull check""
This reverts commit 9416087dd8
.
* Revert "Revert "use std::min and max to update global min max idx""
This reverts commit 20246d4416
.
* remove some comments
* partial use of MonotonicityCheckMatcher
* ranges
* remove KeyDescriptionMonotonicityChecker
* remove duplication of applyfunction
* move functions to anonymous namespace
* move functions to cpp
* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned
* updte reference file
* Support for partition by a, b, c to partition by a, b
* refactoring part 1
* refactoring part 2, use hyperrectangle, still not complete
* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns
* Support attaching to table with partition expression of multiple expressions
* add tests
* rename method
* remove some code duplication
* draft impl for replicatedmergetree, need to dive deeper
* ship ref file
* fix impl for replicatedmergetree..
* forbid attach empty partition replicatedmergetree
* Add replicated merge tree integration tests
* add test missing files
* fix black
* do not check for monotonicity of empty partition
* add empty tests & fix replicated
* remove no longer needed buildBlockWithMinMaxINdexes
* remove column logic in buildHyperrectangle
* simplify implementation by using existing methods
* further simplify implementation
* move all MergeTreeDataPartClone private methods to .cpp file
* decrease decomposition
* use different namespaces
* reduce code duplication
* fix style
* address a few comments
* add chassert to assert arguments size on MonotonicityCheckVisitor
* remove deleteMinMaxFiles method
* remove useless checks from sanitycheck
* add tests for attach partition (not id)
* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery
* remove empty block comment
* small fixes
* fix formatting
* add missing include
* remove duplicate iuncludes
* trigger ci
* reduce some code duplication
* use updated partition id on replicatedmergetree
* fix build
* fix build
* small refactor
* do not use insert increment on fetch part
* remove duplicate includes
* add one more integ test
* black
* black
* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp
* add one more integ test
* add order by clause
* fix black
---------
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
robot-clickhouse
48f0580512
Automatic style fix
2024-01-22 17:39:44 +00:00
Robert Schulze
d739a7230a
Fix style
2024-01-22 17:37:16 +00:00
kssenii
1aa8e62bb7
Fix
2024-01-22 18:26:44 +01:00
Robert Schulze
90a0ea36b3
Add statement 'SYSTEM RELOAD ASYNCHRONOUS METRICS'
2024-01-22 17:14:58 +00:00
Nikita Taranov
704e5ac883
Fix test_parallel_replicas_invisible_parts
2024-01-22 17:52:13 +01:00
kssenii
15e3a5b396
Try fix flaky test
2024-01-22 14:57:10 +01:00
Kseniia Sumarokova
aec76d6653
Merge pull request #58877 from ClickHouse/multiple-read-file-log-storage-in-mv
...
Multiple read file log storage in mv
2024-01-22 12:02:41 +01:00
Vitaly Baranov
01aafda27b
Merge pull request #58804 from vitlibar/allow-kill-query-for-backups
...
Allow KILL QUERY for backups
2024-01-20 23:48:18 +01:00
Igor Nikonov
4be068c73b
Merge pull request #58993 from ClickHouse/revert-58992-revert_flaky
...
Revive: Parallel replicas custom key: skip unavailable replicas
2024-01-20 19:44:56 +01:00
Kseniia Sumarokova
e5c3b67f37
Update test.py
2024-01-20 16:10:09 +01:00
Kseniia Sumarokova
caf9d8df6d
Update test.py
2024-01-20 14:59:13 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk
...
Fix for custom cached disk creation
2024-01-20 14:47:36 +01:00
Alexey Milovidov
587295aca1
Merge pull request #58981 from azat/prom-handler
...
Fix timeout for prometheus exporter for HTTP/1.1 (due to keep-alive)
2024-01-20 09:42:05 +01:00
Igor Nikonov
3d8be9d588
Comment for disabled assert
2024-01-19 14:54:20 +00:00
robot-clickhouse
522cce991a
Automatic style fix
2024-01-19 14:37:53 +00:00
Igor Nikonov
a4d0260fa7
Update tests
...
+ setting max_replica_delay_for_distributed_queries to avoid replica lag
affecting load balancing
+ disable flaky assert for asan/tsan builds (will investigated
separately)
2024-01-19 14:23:15 +00:00
zhongyuankai
cbb51659f6
Merge branch 'master' into limit_materialized_view_size
2024-01-19 22:00:12 +08:00
Igor Nikonov
17c7fdfed9
Disable check which is flaky atm
2024-01-19 12:58:21 +00:00
Igor Nikonov
131f71b50a
Revert "Revert flaky"
2024-01-19 13:51:30 +01:00
Raúl Marín
477489a05d
Revert "Merge pull request #57235 from ClickHouse/pr-custom-key-failover"
...
This reverts commit 8ba9b4a7ef
, reversing
changes made to 0f39245cb8
.
2024-01-19 12:46:05 +00:00
Raúl Marín
44b621fb48
Revert "Merge pull request #58909 from ClickHouse/fix-test-custom-key-failover"
...
This reverts commit deeb09ff37
, reversing
changes made to a4cab68a06
.
2024-01-19 12:44:55 +00:00
robot-clickhouse
7c66141e08
Automatic style fix
2024-01-19 11:11:13 +00:00
kssenii
a196d04a1c
Update test
2024-01-19 12:04:16 +01:00
Azat Khuzhin
38ad4ef493
Fix timeout for prometheus exporter for HTTP/1.1 (due to keep-alive)
...
Before:
$ time curl -s --http1.1 127.1:9363/metrics > /dev/null
real 0m10.018s # default keep_alive_timeout is 10 seconds
user 0m0.005s
sys 0m0.001s
After
$ time curl -s --http1.1 127.1:9363/metrics > /dev/null
real 0m0.008s
user 0m0.006s
sys 0m0.000s
And if you will look at the test_prometheus_endpoint, you will see that
it takes > 30 seconds (it obtains metrics 3 times), after this patch it
should be finished more or less instantly.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-19 13:29:17 +03:00
kssenii
48e489682b
Merge remote-tracking branch 'origin/master' into broken-projections-better-handling
2024-01-19 10:49:27 +01:00
Kseniia Sumarokova
25be226c05
Merge pull request #58951 from ClickHouse/fix-materialized-pg-test
...
Fix flaky test_postgresql_replica_database_engine_2/test.py::test_dependent_loading
2024-01-19 10:27:18 +01:00
Nikita Taranov
9d36fe4a48
Merge pull request #58923 from nickitat/add_test
...
Add regression test for parallel replicas (follow up #58722 , #58844 )
2024-01-18 21:54:18 +01:00
Kseniia Sumarokova
7f92bf6f0b
Merge pull request #58921 from ClickHouse/add-a-test-for-azure
...
Fix and test for azure #58697
2024-01-18 21:41:54 +01:00
kssenii
10a47ef185
Fix
2024-01-18 16:56:17 +01:00
MikhailBurdukov
be58c1fe44
Fix style
2024-01-18 15:43:43 +00:00
MikhailBurdukov
f6fb20d6cf
Backoff policy for failed mutation.
2024-01-18 15:43:43 +00:00
Tim Liou
483bbaf14d
Run black locally to format the code
2024-01-18 23:42:10 +08:00
Tim Liou
61826cf21a
Validate log level values
2024-01-18 21:40:23 +08:00
Vitaly Baranov
4c6d3e7efa
Add server settings "shutdown_wait_backups_and_restores" (default=true)
...
to set whether shutdown should wait for running backups to finish or just cancel them.
2024-01-18 13:27:14 +01:00
Kseniia Sumarokova
7092948d53
Update test.py
2024-01-18 11:02:13 +01:00
Smita Kulkarni
e71977b724
Merge branch 'master' into Azure_backup
2024-01-18 08:29:01 +01:00
Igor Nikonov
fa664a3656
Merge remote-tracking branch 'origin/master' into fix-test-custom-key-failover
2024-01-17 19:36:04 +00:00
Igor Nikonov
265bfa0af8
Using current database in cluster
2024-01-17 19:35:35 +00:00
Igor Nikonov
3b8ce04392
Add test for load balancing
2024-01-17 18:57:08 +00:00
Nikita Taranov
06a3a81b24
fix
2024-01-17 19:42:23 +01:00
Nikita Taranov
4fddf60f05
impl
2024-01-17 19:41:12 +01:00
kssenii
ef48b90bca
Fix and test
2024-01-17 18:44:09 +01:00
Alexey Milovidov
1161dbbd54
Merge pull request #57993 from mkmkme/mkmkme/reload-config-again
...
Update `query_masking_rules` when reloading the config, attempt 2
2024-01-17 17:09:36 +01:00
robot-clickhouse
c2ccfba8ef
Automatic style fix
2024-01-17 15:02:37 +00:00
kssenii
dc5d09fc55
Fix tests
2024-01-17 15:52:07 +01:00
kssenii
1e9de73bf5
Fix style check
2024-01-17 15:40:46 +01:00
kssenii
4d9c173008
Merge remote-tracking branch 'origin/broken-projections-better-handling' into broken-projections-better-handling
2024-01-17 15:40:27 +01:00
kssenii
dea8b10ae9
Fix test
2024-01-17 15:39:57 +01:00
Igor Nikonov
9e17877da5
Fix: use cluster()
instead of defining distributed table
2024-01-17 14:11:09 +00:00
Kruglov Pavel
6d064512e1
Merge pull request #58614 from Blargian/58363_disable_ansi_pretty_automatically
...
58363 Automatically disable ANSI escape sequences in Pretty formats if the output is not a terminal
2024-01-17 13:45:41 +01:00
Кирилл Гарбар
dfbc2b142c
GetTableDataPath and new docs
2024-01-17 12:50:09 +03:00
kssenii
1f384dd8a8
Fix
2024-01-17 10:32:56 +01:00
Mikhail Koviazin
6e6197019c
Reintroduce commit 3067ca6
...
Update `query_masking_rules` when reloading the config
This reverts commit 7e55eab1c3
.
2024-01-17 08:10:49 +02:00
Alexander Tokmakov
38b85e6409
Merge pull request #58649 from azat/tests/test_replicated_database
...
Fix test_replicated_database::test_startup_without_zk flakiness
2024-01-16 21:08:33 +01:00
robot-clickhouse
216769f43e
Automatic style fix
2024-01-16 18:55:23 +00:00
kssenii
7bc6a858c7
Rewrite bash test to integration test
2024-01-16 19:44:55 +01:00
Blargian
1b81efc337
fix failing 02421 stateless and (hopefully) fix failing integration tests
2024-01-16 19:48:23 +02:00
robot-clickhouse
7262e93a27
Automatic style fix
2024-01-16 16:26:28 +00:00
János Benjamin Antal
5a178ce1ef
Add proper cleanup to kafka test
2024-01-16 16:03:44 +00:00
Vitaly Baranov
085833aaae
Use special statuses BACKUP_CANCELLED and RESTORE_CANCELLED in system.backups
2024-01-16 15:07:24 +01:00
Vitaly Baranov
185f6cc37c
Add tests for cancelling backup/restore queries.
2024-01-16 15:07:20 +01:00
kssenii
8decf5039a
Fix for custom cached disk
2024-01-16 14:41:12 +01:00
vdimir
54a79c1f3d
Merge pull request #58123 from ClickHouse/vdimir/cluster_discovery_password
...
ClusterDiscovery supports setting username and password
2024-01-16 11:05:54 +01:00
zhongyuankai
cca2fa6976
fix test
2024-01-16 15:39:33 +08:00
Alexander Tokmakov
8bdd6542ce
Merge pull request #58647 from ClickHouse/tavplubix-patch-10
...
Update test_replicated_database/test.py
2024-01-16 00:32:08 +01:00
János Benjamin Antal
3e1d7bf685
Merge pull request #58477 from ClickHouse/multiple-read-kafka-storage-in-mv
...
Delay reading from StorageKafka to allow multiple reads in materialized views
2024-01-15 12:31:59 +01:00
vdimir
1f0a29cf10
Fix test_cluster_discovery/test_password.py
2024-01-15 11:31:22 +00:00
vdimir
53e2a97d33
Add missing configs to test_cluster_discovery
2024-01-15 11:22:54 +00:00
vdimir
8dc1756532
Support <secret> in cluster discovery
2024-01-15 11:22:53 +00:00
vdimir
6ab507e722
Add test case for cluster discovery with wrong password
2024-01-15 11:22:52 +00:00
vdimir
012713fc31
ClusterDiscovery supports setting username and password
2024-01-15 11:22:48 +00:00
zhongyuankai
826b29ef4d
Max materialized views size for table
2024-01-15 10:02:57 +08:00
Kseniia Sumarokova
77f4cd8dd3
Merge pull request #58721 from ClickHouse/support-point-datatype-for-mysql
...
Support Point data type for MySQL
2024-01-12 17:02:01 +01:00
kssenii
8b1d2805ae
Add one more test case to the test
2024-01-12 10:41:04 +01:00
Dmitry Novik
e3aed6ba4e
Fix integration test
2024-01-12 09:40:15 +01:00
kssenii
fada92173b
Support Point data type for MySQL
2024-01-11 19:19:08 +01:00
Yakov Olkhovskiy
84809b36c3
Merge pull request #58475 from ClickHouse/revert-58450-revert-56064-feature-server-iface-metrics
...
Second attempt: Use CH Buffer for HTTP out stream, add metrics for interfaces
2024-01-11 12:06:59 -05:00
Igor Nikonov
8ba9b4a7ef
Merge pull request #57235 from ClickHouse/pr-custom-key-failover
...
Parallel replicas custom key: skip unavailable replicas
2024-01-11 12:22:32 +01:00
Konstantin Bogdanov
7f4ccebea4
Merge pull request #58550 from danipozo/hide-credentials-in-base-backup-name
...
Hide credentials in system.backup_log base_backup_name column
2024-01-11 03:42:17 +03:00
Igor Nikonov
8d4a395afa
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2024-01-10 20:28:04 +00:00
Igor Nikonov
e9fc869254
Fix test flakiness with hedge connections enabled
2024-01-10 15:59:48 +00:00
Yakov Olkhovskiy
2e124b19b8
Merge branch 'master' into revert-58450-revert-56064-feature-server-iface-metrics
2024-01-10 09:05:18 -05:00
Azat Khuzhin
2cf74aea5c
Fix test_replicated_database::test_startup_without_zk flakiness
...
CI founds [1]
E assert 'ZooKeeper' in "Received exception from server (version 24.1.1):\nCode: 999. DB::Exception: Received from 172.16.1.6:9000. Coordination::Exception. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/databases/startup. Stack trace:\n\n0. ? @ 0x000000000c734f1b in /usr/bin/clickhouse\n1. ? @ 0x000000000fbef3f4 in /usr/bin/clickhouse\n2. ? @ 0x000000000fbeebc8 in /usr/bin/clickhouse\n3. ? @ 0x0000000012ded0f9 in /usr/bin/clickhouse\n4. ? @ 0x0000000012deaa71 in /usr/bin/clickhouse\n5. ? @ 0x00000000107e51e8 in /usr/bin/clickhouse\n6. ? @ 0x00000000107eb87a in /usr/bin/clickhouse\n7. ? @ 0x0000000011213ec3 in /usr/bin/clickhouse\n8. ? @ 0x00000000111e9acf in /usr/bin/clickhouse\n9. ? @ 0x000000001120e85e in /usr/bin/clickhouse\n10. ? @ 0x000000001174f0a2 in /usr/bin/clickhouse\n11. ? @ 0x0000000011748c9a in /usr/bin/clickhouse\n12. ? @ 0x00000000126fb5a9 in /usr/bin/clickhouse\n13. ? @ 0x00000000127130f9 in /usr/bin/clickhouse\n14. ? @ 0x000000001517bf12 in /usr/bin/clickhouse\n15. ? @ 0x000000001517cd11 in /usr/bin/clickhouse\n16. ? @ 0x00000000152740c7 in /usr/bin/clickhouse\n17. ? @ 0x00000000152726bc in /usr/bin/clickhouse\n18. ? @ 0x00007f7f36485ac3\n19. ? @ 0x00007f7f36517660\n. (KEEPER_EXCEPTION)\n(query: CREATE DATABASE startup ENGINE = Replicated('/clickhouse/databases/startup', 'shard1', 'replica1');)\n"
[1]: https://s3.amazonaws.com/clickhouse-test-reports/58610/441a3fbb9b1c088f528841727f013b829f63fc8a/integration_tests__release__[3_4]/integration_run_test_replicated_database_test_py_0.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-10 14:44:29 +03:00
Alexander Tokmakov
b954667ae9
Update test.py
2024-01-10 11:07:13 +01:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
...
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Kseniia Sumarokova
1b517105db
Merge pull request #57323 from valbok/mysql-binlog-client
...
MaterializedMySQL: Introduce MySQL Binlog Client
2024-01-10 09:08:13 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main
2024-01-09 20:36:02 +00:00
Sema Checherinda
7c7e72c4b7
Merge pull request #58573 from ClickHouse/chesema-s3-client-creation
...
fix and test that S3Clients are reused
2024-01-09 13:28:20 +01:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2
...
generate object storage key by template
2024-01-09 13:26:56 +01:00
Кирилл Гарбар
85163994dc
Merge remote-tracking branch 'ClickHouse/master'
2024-01-09 04:51:51 +03:00
Кирилл Гарбар
bebb2c9dca
Common test functions, check flags are removed
2024-01-09 04:22:40 +03:00
Igor Nikonov
7fd851b4e9
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2024-01-08 20:43:20 +00:00
Dani Pozo
d8f4b5fd13
Fix black formatting
2024-01-08 12:47:58 +01:00
Dani Pozo
b42eaf6c62
Add test for hiding credentials in system.backups table
2024-01-08 12:20:32 +01:00
Кирилл Гарбар
c7b14d190e
Remove flags directory
2024-01-08 07:09:38 +03:00
robot-clickhouse
29173a602e
Automatic style fix
2024-01-08 02:39:19 +00:00
Yakov Olkhovskiy
45ac4d2b67
Merge remote-tracking branch 'origin/master' into revert-58450-revert-56064-feature-server-iface-metrics
2024-01-07 15:23:46 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main
2024-01-07 14:11:22 +00:00
Sema Checherinda
d5f86f671d
fix and test that S3Clients reused
2024-01-07 02:19:06 +01:00
robot-clickhouse
4a473c37ec
Automatic style fix
2024-01-06 15:55:20 +00:00
Alexey Milovidov
2751b351cb
Fix test
2024-01-06 16:44:38 +01:00
Yakov Olkhovskiy
9ca4be5d91
Merge remote-tracking branch 'origin/master' into revert-58450-revert-56064-feature-server-iface-metrics
2024-01-06 00:24:31 +00:00
robot-clickhouse
630ee67262
Automatic style fix
2024-01-05 23:02:58 +00:00
Yakov Olkhovskiy
0964bf3638
add clickhouse-library-bridge logging for test_catboost_evaluate
2024-01-05 22:51:17 +00:00
Nikolay Degterinsky
56aa835954
Merge pull request #58444 from bharatnc/ncb/support-hints-for-db-engines
...
support hints for database engines
2024-01-05 17:12:44 +01:00
Sergei Trifonov
8d6b012223
Merge pull request #57877 from azat/merges-mutations-throttling
...
Add ability to throttle merges/mutations
2024-01-05 17:08:50 +01:00
Sema Checherinda
2861cc70ba
fix style
2024-01-05 13:42:30 +00:00
Sema Checherinda
8ab4aa3423
enable randomization setting
2024-01-05 13:42:30 +00:00
Sema Checherinda
53f36f8b21
object storage key template
2024-01-05 13:42:30 +00:00
Alexander Tokmakov
d2752f4b66
Merge pull request #57603 from evillique/allow-not-resolving-hostnames
...
Allow avoiding resolving hostnames in DDLWorker
2024-01-04 15:46:28 +01:00
Alexander Tokmakov
972756486a
Merge pull request #58350 from ClickHouse/rdb_dont_wait_inactive
...
An option to avoid waiting for inactive Replicated database replicas
2024-01-04 14:50:11 +01:00
Alexander Tokmakov
10e3ae9e68
Merge branch 'master' into allow-not-resolving-hostnames
2024-01-04 13:22:15 +01:00
robot-clickhouse
224a58ddc5
Automatic style fix
2024-01-04 10:30:44 +00:00
János Benjamin Antal
1a1fa07128
Add missing asserts
2024-01-04 10:18:04 +00:00
János Benjamin Antal
2517d23e27
Add tests
2024-01-04 10:14:41 +00:00
Nikita Taranov
66d2db5283
New parallel replicas coordinator implementation ( #57968 )
2024-01-04 00:27:04 +01:00
Bharat Nallan Chakravarthy
d63765fb19
Merge upstream/master into ncb/support-hints-for-db-engines
2024-01-03 08:44:11 -08:00
Alexander Tokmakov
b1688b1953
Merge branch 'master' into rdb_dont_wait_inactive
2024-01-03 17:03:01 +01:00
Val Doroshchuk
5c221d123d
MaterializedMySQL: Introduce MySQL Binlog Client
...
One binlog connection for many databases.
Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.
1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.
@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
2024-01-03 15:26:09 +01:00
Kruglov Pavel
570d1c013b
Merge pull request #57053 from Avogar/better-parsing-exceptions
...
Better exception messages in input formats
2024-01-03 14:47:51 +01:00
Bharat Nallan Chakravarthy
2da0a30626
add a test
2024-01-02 13:52:52 -08:00
Smita Kulkarni
4122de9721
Updated tests and added settings
2024-01-02 20:19:01 +01:00
Nikolay Degterinsky
debbeb505d
Merge pull request #58409 from ClickHouse/evillique-patch-1
...
Fix test_user_valid_until
2024-01-02 17:06:11 +01:00
avogar
5f6a806d1c
Fix style
2024-01-02 15:43:44 +00:00
avogar
0844528ec1
Fix tests
2024-01-02 15:22:42 +00:00
Kruglov Pavel
e69bda7f08
Merge pull request #57438 from Avogar/fix-resetting-buffers
...
Fix working with read buffers in StreamingFormatExecutor
2024-01-02 15:34:35 +01:00
Nikolay Degterinsky
004730fe87
Fix test_user_valid_until
2024-01-02 14:50:28 +01:00
Alexey Milovidov
78523639e0
Remove function
2023-12-30 14:52:54 +01:00
avogar
f20917048e
Fix kafka tests
2023-12-29 17:02:46 +00:00
Alexander Tokmakov
bfc10bd234
an option to avoid waiting for inactive Replicated db replicas
2023-12-29 15:19:16 +01:00
Igor Nikonov
208a9193f6
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-28 21:28:36 +00:00
Kruglov Pavel
9389ea8745
Fix style
2023-12-28 18:47:57 +00:00
Kruglov Pavel
69f6147499
Fix style
2023-12-28 18:47:57 +00:00
avogar
c6085b3eb9
Fix working with read buffers in StreamingFormatExecutor
2023-12-28 18:47:57 +00:00
Michael Kolupaev
609b2c216c
Fix some of the CI
2023-12-28 17:56:05 +00:00
koloshmet
49367186e3
fix fix fix
2023-12-28 17:56:04 +00:00
Kseniia Sumarokova
8e8fd84cb7
Merge pull request #58293 from ClickHouse/fix-s3-queue-test
...
Fix test_storage_s3_queue/test.py::test_drop_table
2023-12-28 17:18:11 +01:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)"
2023-12-28 13:12:20 +01:00
kssenii
529a1d67cb
Fix
2023-12-28 12:48:56 +01:00
Smita Kulkarni
bf60a06a11
Merge branch 'master' into Azure_backup
2023-12-28 11:51:49 +01:00
Alexey Milovidov
40a5dbdeba
Merge branch 'master' into mv
2023-12-28 03:16:27 +01:00
Кирилл Гарбар
764791809b
Test for unusual zk path
2023-12-28 03:33:56 +03:00
Alexey Milovidov
30f6d03b37
Merge pull request #57977 from bianpengyuan/add-s3-read-only-setting
...
Add a setting to specify s3 disk is read only.
2023-12-28 01:24:50 +01:00
Кирилл Гарбар
697b4d5fa1
No need to expand uuid macro
2023-12-28 02:35:13 +03:00
Alexey Milovidov
5406c79c89
Merge pull request #58264 from ClickHouse/fs-cache-better-multi-cache-configuration
...
Make fs caches with the same path use the same cache objects
2023-12-28 00:10:15 +01:00
Кирилл Гарбар
6f79f98719
Throw on ordinary db engine
2023-12-28 00:54:10 +03:00
Michael Kolupaev
673743e2ac
Fix some of the CI
2023-12-27 20:24:55 +00:00
koloshmet
808cb0fa05
fix fix fix
2023-12-27 20:24:54 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size
...
add asynchronous metrics for total primary key size in memory and allocated
2023-12-27 20:24:20 +01:00
Pengyuan Bian
26b553c3b6
format.
2023-12-27 18:27:36 +00:00
kssenii
041c5d4219
Make caches with the same path use the same cache objects
2023-12-27 18:37:43 +01:00
Pengyuan Bian
3dcc1f5448
update.
2023-12-27 07:54:18 +00:00
Igor Nikonov
bee15325fc
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-26 21:56:46 +00:00
Pengyuan Bian
2765acfe45
wip test.
2023-12-26 07:50:46 +00:00
Azat Khuzhin
837f4ea676
Add ability to throttle merges/mutations
...
Main motivation was to has an ability to throttle background tasks, to
avoid affecting queries.
To new server settings had been added for this:
- max_mutations_bandwidth_for_server
- max_merges_bandwidth_for_server
Note, that they limit only reading, since usually you will not write
more data then you read, but sometimes it is possible in case of ALTER
UPDATE.
But for now, to keep things simple, I decided to limit this with only
2 settings instead of 4.
Note, that if the write throttling will be needed, then they can use the
same settings, and just create new throttler for write.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 22:31:49 +01:00
Azat Khuzhin
6ed9b53d1f
Refactor test_throttling slightly for upcoming tests
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 22:29:43 +01:00
Alexey Milovidov
817d0c6553
Merge pull request #58202 from vitlibar/explicit-finalize-in-zip-archive-writer
...
Explicit finalize in ZipArchiveWriter
2023-12-24 03:30:21 +01:00
Vitaly Baranov
e1a136b791
Explicit finalize() function in ZipArchiveWriter.
...
Simplify too complicated code in ZipArchiveWriter.
2023-12-24 00:33:59 +01:00
Smita Kulkarni
3e22f29b45
Fixed parameters
2023-12-23 11:40:58 +01:00
jinjunzh
aaf98f0ed7
refine setting with enable_zstd_qat_codec
2023-12-22 14:24:15 -05:00
Bharat Nallan Chakravarthy
d2f0fe28dc
fix test query
2023-12-22 08:48:14 -08:00
Raúl Marín
24f952b2b8
Merge pull request #57986 from Algunenano/zk_retries_quorum
...
Support keeper failures in quorum check
2023-12-22 11:10:04 +01:00
Bharat Nallan Chakravarthy
62b28d365c
Merge with upstream/master
2023-12-21 17:04:25 -08:00
Bharat Nallan Chakravarthy
929bc01281
better test with retries
2023-12-21 11:20:16 -08:00
Raúl Marín
6d9da8edd5
Merge remote-tracking branch 'blessed/master' into zk_retries_quorum
2023-12-21 17:03:29 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images
2023-12-21 16:09:56 +01:00
Igor Nikonov
db87ea0b86
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-20 20:48:51 +00:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token
...
Feature/s3 session token
2023-12-20 17:22:09 +01:00
jsc0218
0a9475abc7
Merge pull request #57874 from joelynch/joelynch/host-psql
...
bugfix: addresses_expr ignored for psql named collections
2023-12-19 15:24:23 -05:00
Кирилл Гарбар
64073f09b6
Support converting tables with explicit engine arguments
2023-12-19 20:57:25 +03:00
Bharat Nallan Chakravarthy
6273c5920a
fix tests
2023-12-19 08:26:54 -08:00
Raúl Marín
b458c77340
Fix integration test
2023-12-19 14:36:03 +01:00
Shani Elharrar
5f38e1d944
S3 Session Tokens: Added tests
2023-12-19 10:50:19 +02:00
robot-clickhouse
2be806618e
Automatic style fix
2023-12-18 22:07:00 +00:00
Nikita Mikhaylov
6360b76792
Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint
2023-12-18 21:49:31 +00:00
Nikita Mikhaylov
ddf5da225d
Fix integration test
2023-12-18 21:39:59 +00:00
pufit
36d1905881
Merge pull request #57752 from chizhonkova/refactor_sql_udf_loader
...
Refactoring for UserDefinedSQLObjectsLoader
2023-12-18 16:08:46 -05:00
Bharat Nallan Chakravarthy
73f71cc9fc
add a test
2023-12-18 12:39:43 -08:00
Raúl Marín
c4f2511596
Merge pull request #57895 from Algunenano/fix_azure
...
Fix test_unset_skip_unavailable_shards
2023-12-18 12:01:57 +01:00
Кирилл Гарбар
f2a1ab522e
Merge remote-tracking branch 'ClickHouse/master'
2023-12-18 13:45:28 +03:00
joelynch
403d9c809d
fix test for postgresql addresses_expr
2023-12-18 10:41:12 +01:00
Igor Nikonov
ec1539728d
Fix load balancing for hedged connections
2023-12-16 21:17:01 +00:00
Кирилл Гарбар
1ca059594f
Format tests
2023-12-16 13:48:25 +03:00
Igor Nikonov
a735820400
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-15 21:14:43 +00:00
Igor Nikonov
da2dc30056
Fix test: use different log_comment for each test instance
2023-12-15 21:02:55 +00:00
Alexey Milovidov
7e55eab1c3
Revert "Merge pull request #56573 from mkmkme/mkmkme/reload-config"
...
This reverts commit 3067ca64df
, reversing
changes made to 1e46460910
.
2023-12-15 19:28:25 +01:00
Sema Checherinda
0dfe530a7f
Merge pull request #56744 from MikhailBurdukov/native_copy_for_s3_disks
...
Enabled s3 `copyObject` for copy between s3 disks.
2023-12-15 16:05:16 +01:00
Nikita Mikhaylov
1780671443
ClickHouse Cloud promotion ( #57638 )
...
Co-authored-by: Alexander Sapin <alesapin@gmail.com>
2023-12-15 15:23:23 +01:00
Yarik Briukhovetskyi
325374c68b
Merge pull request #57342 from bharatnc/ncb/better-hint-if-table-doesnt-exist
...
provide a better hint if a table doesn't exist
2023-12-15 12:35:13 +01:00
Raúl Marín
1e8397f437
Fix test_unset_skip_unavailable_shards
2023-12-15 12:18:40 +01:00
Кирилл Гарбар
8d1dfebb4f
Refactor tests
2023-12-14 23:01:50 +03:00
Bharat Nallan Chakravarthy
daef2febf3
Merge with 'upstream/master'
2023-12-14 11:19:44 -08:00
robot-clickhouse
217570a165
Automatic style fix
2023-12-14 18:49:32 +00:00
Igor Nikonov
1370a8c6c4
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-14 18:29:38 +00:00
Igor Nikonov
f8dc6e127e
Update tests
2023-12-14 18:28:25 +00:00
joelynch
b4bef78e63
bugfix: addresses_expr ignored for psql named collections
2023-12-14 17:17:14 +01:00
robot-clickhouse
b05c73b3ae
Automatic style fix
2023-12-14 13:19:46 +00:00
kssenii
a4a264c785
Fix
2023-12-14 14:04:17 +01:00
Igor Nikonov
42d0afef1f
Merge pull request #57749 from ClickHouse/pr-perf-improve-hope
...
Parallel replicas: announcement response handling improvement
2023-12-14 11:48:51 +01:00
Konstantin Bogdanov
808b4a0213
Merge pull request #57628 from azat/config-nodes-override
...
Allow nodes in config with from_env/from_zk and non empty element with replace=1
2023-12-14 13:20:46 +03:00
jsc0218
78773157b6
Merge pull request #57436 from ryanmjacobs/fix_issue_43186_pg_quote_array_ndims
...
Fix several issues regarding PostgreSQL `array_ndims` usage.
2023-12-13 13:41:43 -05:00
Nikita Mikhaylov
8372c70958
Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint
2023-12-13 18:29:56 +00:00
alesapin
230e1fe6c7
Merge pull request #57809 from ClickHouse/fix-flaky-test_parallel_replicas_over_distributed
...
Fix flaky test_parallel_replicas_over_distributed
2023-12-13 17:11:41 +01:00
Alexey Milovidov
54698cd2de
Merge pull request #55876 from ClickHouse/keeper-http-readiness-endpoint
...
Keeper HTTP readiness endpoint
2023-12-13 17:07:57 +01:00
Igor Nikonov
72f1c415f1
Merge remote-tracking branch 'origin/master' into pr-custom-key-failover
2023-12-13 15:03:05 +00:00
Igor Nikonov
c165be76ab
Parallel replicas: friendly settings ( #57542 )
2023-12-13 14:42:06 +01:00
Igor Nikonov
2a0a5f755c
Comment to about possible query results
2023-12-13 12:29:57 +00:00
robot-clickhouse
7d9e9fd42e
Automatic style fix
2023-12-13 11:38:41 +00:00
Igor Nikonov
7762beaf6c
Fix: w/o replicas sync query result can vary
2023-12-13 11:23:53 +00:00
Kseniia Sumarokova
b1325450e9
Merge pull request #57754 from ClickHouse/fix-loading-dependent-table-materialized-postgresql
...
Table engine MaterializedPostgreSQL fix dependency loading
2023-12-13 12:17:01 +01:00
Igor Nikonov
5abeadf20f
Fix: stop merges, otherwise test can be flaky
2023-12-13 08:54:44 +00:00
robot-clickhouse
ea86b33d3b
Automatic style fix
2023-12-12 21:59:08 +00:00
Igor Nikonov
3333a7f219
Test cleanup
2023-12-12 21:39:08 +00:00
Igor Nikonov
616d054dee
Merge remote-tracking branch 'origin/master' into pr-perf-improve-hope
2023-12-12 21:27:31 +00:00
Igor Nikonov
7f4a028196
Test and fix
2023-12-12 21:26:58 +00:00
Alexander Tokmakov
3482224f83
Merge branch 'master' into keeper-http-readiness-endpoint
2023-12-12 21:19:57 +01:00
Кирилл Гарбар
a6549c106a
Tests for engine convertation
2023-12-12 21:45:00 +03:00
robot-clickhouse
f2336ff025
Automatic style fix
2023-12-12 14:43:44 +00:00
kssenii
e77cb18d18
Better test
2023-12-12 15:30:17 +01:00
Natalya Chizhonkova
3d51192bad
Refactoring for UserDefinedSQLObjectsLoader
2023-12-12 17:03:49 +03:00
Kruglov Pavel
8a447bf57c
Merge pull request #55892 from Avogar/schema-inference-union
...
Add 'union' mode for schema inference
2023-12-12 15:02:06 +01:00
Kruglov Pavel
b33f124555
Merge pull request #57538 from MikhailBurdukov/ignore_on_cluster_for_grants
...
Ignore ON CLUSTER clause in grant/revoke queries for management of replicated access entities.
2023-12-12 14:59:58 +01:00
Konstantin Bogdanov
511cfb393d
Remove time.sleep
from test
2023-12-12 12:29:00 +01:00
robot-clickhouse
b49452fb45
Automatic style fix
2023-12-12 10:44:55 +00:00
Konstantin Bogdanov
8fe2cd1a7e
Update tests
2023-12-12 11:35:17 +01:00
Igor Nikonov
fd92cb4c32
Merge pull request #57757 from ClickHouse/fix-flaky-test_parallel_replicas_distributed
...
Fix flaky test_parallel_replicas_distributed_read_from_all
2023-12-12 10:43:19 +01:00
Konstantin Bogdanov
1f9c7336a9
Fix test helper naming
2023-12-12 09:32:16 +01:00
robot-clickhouse
e95041a3af
Automatic style fix
2023-12-11 21:40:23 +00:00
Igor Nikonov
da43d49ffc
Fix: sync is failed with stopped merges
2023-12-11 21:30:25 +00:00
alesapin
cbae29d26a
Merge pull request #57699 from hanfei1991/hanfei/keeper_soft_limit_ratio
...
support keeper memory soft limit ratio
2023-12-11 21:43:24 +01:00
Igor Nikonov
c007025ee3
Fix flaky test_parallel_replicas_distributed_read_from_all
2023-12-11 20:05:26 +00:00
Ryan Jacobs
40da568ef9
Merge branch 'master' into fix_issue_43186_pg_quote_array_ndims
2023-12-11 11:17:38 -08:00
kssenii
05e56f76ed
Merge remote-tracking branch 'origin/master' into fix-loading-dependent-table-materialized-postgresql
2023-12-11 20:17:26 +01:00
Kseniia Sumarokova
907d0a79eb
Merge pull request #57568 from ClickHouse/fix-materialized-pg-issue-with-generated-columns
...
MaterializedPostgreSQL: Support "generated columns" and default values
2023-12-11 19:57:41 +01:00
Kruglov Pavel
3b1ffbd77c
Merge branch 'master' into schema-inference-union
2023-12-11 18:59:15 +01:00
kssenii
48ce040621
Fix
2023-12-11 17:30:23 +01:00
kssenii
a06179da00
Merge remote-tracking branch 'origin/master' into fix-materialized-pg-issue-with-generated-columns
2023-12-11 11:15:00 +01:00
robot-clickhouse
3adb83e406
Automatic style fix
2023-12-11 10:19:49 +01:00