Commit Graph

9044 Commits

Author SHA1 Message Date
Pradeep Chhetri
774fcdfff6
wip 2024-03-05 15:59:07 +01:00
Pradeep Chhetri
17f1e44241
Fix linter issues in ci-runner.py 2024-03-05 15:59:06 +01:00
Alexander Tokmakov
72a4533c4e Merge branch 'master' into ddl_none_only_active 2024-03-05 13:42:00 +01:00
vdimir
6f3e9b6de2
Merge branch 'master' into vdimir/analyzer/comute_alias_columns 2024-03-05 13:08:58 +01:00
Kseniia Sumarokova
3f90c933f3
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-05 11:22:56 +08:00
Kseniia Sumarokova
dbbe6b9f69
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-05 11:13:32 +08:00
robot-clickhouse
8be4a115ac Automatic style fix 2024-03-04 19:22:18 +00:00
Alexander Tokmakov
bf91fe8bae fix 2024-03-04 20:06:46 +01:00
Brokenice0415
cc1c3f2da3 add a keeper setting leadership_expiry 2024-03-05 00:54:25 +08:00
Igor Nikonov
48745c95cc
Merge pull request #60485 from ClickHouse/fix-test-custom-key-load-balancing
Fix: test_parallel_replicas_custom_key_load_balancing
2024-03-04 17:31:53 +01:00
Kseniia Sumarokova
925fd00fd1
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-04 16:04:46 +08:00
Azat Khuzhin
7dfe45e8d5 Do not retry queries if container is down in integration tests (resubmit)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 20:38:34 +01:00
Alexey Milovidov
7bfdc3d6db
Merge pull request #60699 from azat/tests/fix-test_grant_and_revoke
Fix test_grant_and_revoke/test.py::test_grant_all_on_table (after syncing with cloud)
2024-03-03 20:24:24 +03:00
Alexey Milovidov
37e6892f52
Merge pull request #60426 from Avogar/fix_test_reload_clusters_config
Improve test test_reload_clusters_config
2024-03-03 19:07:01 +03:00
Azat Khuzhin
79a93f501a Fix test_grant_and_revoke/test.py::test_grant_all_on_table (after syncing with cloud)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 13:33:01 +01:00
jsc0218
2b54c11d63
Merge branch 'ClickHouse:master' into TableEngineGrant_version2 2024-03-02 20:42:04 -05:00
vdimir
47aa33408b
Resubmit "Analyzer: compute ALIAS columns right after reading"
This reverts commit 8141e1c3d1, reversing
changes made to fb099bbd62.
2024-03-01 14:53:02 +00:00
Antonio Andelic
8607e74966
Merge pull request #60537 from ClickHouse/keeper-snapshot-detached
Keeper improvement: abort during startup if an invalid snapshot is detected
2024-03-01 13:36:09 +01:00
SmitaRKulkarni
89fff6852a
Merge pull request #60251 from ClickHouse/Fix_endpoint_for_azureblobstorage
Azure Blob Storage : Fix issues endpoint and prefix
2024-03-01 10:23:49 +01:00
Antonio Andelic
5104029f62
Merge pull request #59535 from josh-hildred/tar_support
Add support for reading and writing backups as tar archives
2024-03-01 10:01:59 +01:00
Antonio Andelic
038ac83c43 Fix test 2024-03-01 09:39:56 +01:00
Kseniia Sumarokova
5ac53c9578
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-01 11:05:47 +08:00
robot-clickhouse
41deadda35 Automatic style fix 2024-02-29 18:37:00 +00:00
Dmitry Novik
55053dae44 Some progress 2024-02-29 19:18:06 +01:00
Smita Kulkarni
bb7453a339 Merge branch 'master' into Fix_endpoint_for_azureblobstorage 2024-02-29 15:05:17 +01:00
Alexander Tokmakov
2dedfd6cf9
Revert "Analyzer: compute ALIAS columns right after reading" 2024-02-29 14:22:07 +01:00
Joshua Hildred
ca9a6f809f add support for .tar.zst and tar.xz 2024-02-29 05:20:53 -08:00
Joshua Hildred
8bc968bb58 Fix tar integration test 2024-02-29 05:20:52 -08:00
Joshua Hildred
92b446a552 Add support for tar archive compression 2024-02-29 05:20:52 -08:00
Joshua Hildred
ef7a66b542 Update error messages and error handling 2024-02-29 05:20:51 -08:00
Joshua Hildred
d0776e5d2a Fixes tidy issue and error formating for test 2024-02-29 05:20:51 -08:00
Joshua Hildred
dc74cebe4e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
c53021f55e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
eb4ec0e871 Add support for reading and writing backups as a
tar archive using libarchive.
2024-02-29 05:20:51 -08:00
Antonio Andelic
1fd54fb9e4 Merge branch 'master' into keeper-snapshot-detached 2024-02-29 13:38:13 +01:00
Antonio Andelic
75837152cb better test 2024-02-29 12:48:08 +01:00
Smita Kulkarni
a168a84624 Merge branch 'master' into Fix_endpoint_for_azureblobstorage 2024-02-29 10:55:31 +01:00
vdimir
5dd81f38fb
Merge pull request #59595 from ClickHouse/vdimir/analyzer/comute_alias_columns
Analyzer: compute ALIAS columns right after reading
2024-02-29 10:28:31 +01:00
Smita Kulkarni
5d68c9f046 Updated default value of endpoint_contains_account_name to true 2024-02-29 09:38:13 +01:00
Kseniia Sumarokova
3188c1ebda Update test.py 2024-02-29 12:48:05 +08:00
Kseniia Sumarokova
34a8b46a88
Merge branch 'master' into fix-usage-of-plain-metadata 2024-02-29 12:47:22 +08:00
jsc0218
96d4c9146b solve redundance with sources grant 2024-02-29 03:35:47 +00:00
Alexey Milovidov
e1e66dc2b8
Merge pull request #60095 from ClickHouse/fix-inconsistent-formatting
Fix inconsistent formatting of queries
2024-02-29 00:41:40 +03:00
Alexander Tokmakov
25c82a5949
Merge pull request #57798 from kirillgarbar/modify-engine
Convert MergeTree tables to replicated on server restart if flag is set
2024-02-28 21:55:15 +01:00
Alexey Milovidov
b116bcadd1
Merge pull request #60472 from ClickHouse/fix-bad-test-8
Make test slower
2024-02-28 19:20:14 +03:00
Alexey Milovidov
d0313381b8
Merge pull request #60471 from ClickHouse/fix-bad-test-7
Fix bad test: looks like an obvious race condition, but I didn't check in detail.
2024-02-28 19:18:16 +03:00
Alexey Milovidov
1950a75bd4 Merge branch 'master' into fix-inconsistent-formatting 2024-02-28 17:10:29 +01:00
jsc0218
b4b19ae2ad
Merge branch 'master' into TableEngineGrant_version2 2024-02-28 10:56:30 -05:00
Nikolai Kochetov
8dd08e9844
Merge pull request #59710 from GrigoryPervakov/master
Support sql created named collections in Kafka Storage for librdkafka settings
2024-02-28 16:38:56 +01:00
Raúl Marín
54ae88a859
Merge pull request #60407 from Algunenano/old_integration_tests
Remove old tags from integration tests
2024-02-28 13:23:44 +01:00
Igor Nikonov
dcafa2a3b3 Fix: test_parallel_replicas_custom_key_load_balancing 2024-02-28 10:56:28 +00:00
robot-clickhouse
8145cd15b1 Automatic style fix 2024-02-28 10:34:40 +00:00
Smita Kulkarni
a46d7c9191 Updated docs and addressed comments 2024-02-28 11:25:35 +01:00
Vitaly Baranov
926295f763
Merge pull request #60040 from vitlibar/use-multiple-threads-while-reading-metadata-for-restore
Use multiple threads while reading the metadata of tables to restore
2024-02-28 11:07:15 +01:00
Alexey Milovidov
71065cc462 Make test slower 2024-02-28 01:46:25 +01:00
Alexey Milovidov
4fde83aa8e Fix bad test 2024-02-28 01:16:02 +01:00
Alexey Milovidov
29e3485c2f Fix bad test 2024-02-28 01:15:14 +01:00
Alexey Milovidov
19adcbc69c Fix bad test 2024-02-28 01:12:34 +01:00
pufit
330a206470
Add definers for views (Attempt 2) (#60439) 2024-02-27 19:00:17 -05:00
Alexey Milovidov
cbdd36890d Fix test 2024-02-28 00:33:56 +01:00
Alexey Milovidov
5b9071a780 Merge branch 'fix-inconsistent-formatting' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:51 +01:00
Alexey Milovidov
8cf619bc03 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:44 +01:00
Pervakov Grigorii
d3b82ab7c1 Support sql created named collections in Kafka Storage for librdkafka settings 2024-02-27 18:36:36 +00:00
robot-clickhouse
733453f817 Automatic style fix 2024-02-27 17:01:09 +00:00
Alexey Milovidov
06d1fc6e58 Fix tests 2024-02-27 17:49:16 +01:00
Alexey Milovidov
5a972c2533 Merge branch 'fix-inconsistent-formatting' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-27 17:43:07 +01:00
Alexey Milovidov
fc80c796e5 Fix tests 2024-02-27 17:42:51 +01:00
kssenii
4243ac160f Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-02-27 23:28:48 +08:00
kssenii
ffd69e0e12 Move setting to merge-tree level 2024-02-27 23:22:04 +08:00
Robert Schulze
0f6bec7842
Merge pull request #59291 from azat/dist/config-settings
Support specifying settings for Distributed engine in config (like for MergeTree)
2024-02-27 16:10:51 +01:00
kssenii
7ac453ab4c Revert "Merge pull request #60436 from nickitat/revert_56864"
This reverts commit 8719a601fa, reversing
changes made to 657857f982.
2024-02-27 23:06:14 +08:00
Nikita Mikhaylov
8719a601fa
Merge pull request #60436 from nickitat/revert_56864
Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
2024-02-27 15:25:15 +01:00
Raúl Marín
e86c8dbf9e Remove old tests 2024-02-27 12:27:47 +01:00
kssenii
33788250b1 Update test.py 2024-02-27 18:07:19 +08:00
kssenii
a284e711da Merge remote-tracking branch 'origin/fix-usage-of-plain-metadata' into fix-usage-of-plain-metadata 2024-02-27 17:35:58 +08:00
kssenii
f53f43b78d Fixes for LocalObjectStorage and plain metadata 2024-02-27 17:33:47 +08:00
robot-clickhouse
fb0465acfa Automatic style fix 2024-02-27 00:01:34 +00:00
Alexey Milovidov
9d75ab2023 Fix integration tests 2024-02-27 00:54:20 +01:00
Nikita Taranov
854f1b064b Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
This reverts commit caaafbcedb, reversing
changes made to d45b248f96.
2024-02-27 00:13:28 +01:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
Kruglov Pavel
a11440a5e5
Fix style 2024-02-26 18:27:53 +01:00
avogar
88d55e88f3 Improve test test_reload_clusters_config 2024-02-26 16:46:41 +00:00
vdimir
5a9026f39b
Analyzer: compute ALIAS columns right after reading 2024-02-26 16:15:05 +00:00
Raúl Marín
e9dd4de143 Oh no! Style 2024-02-26 16:54:42 +01:00
Raúl Marín
7e56a8048e Adapt test 2024-02-26 16:29:47 +01:00
Raúl Marín
4b64145ea8 Missing includes 2024-02-26 16:00:40 +01:00
Raúl Marín
98e68ccfb8 Remove old tags from integration tests 2024-02-26 13:45:20 +01:00
Robert Schulze
1e40b63cb1
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 11:15:51 +00:00
robot-clickhouse
69b5bd02a9 Automatic style fix 2024-02-26 09:37:17 +00:00
kssenii
277e8d9655 Fix usage plain metadata type with new configuration option 2024-02-26 17:27:45 +08:00
Robert Schulze
5c967c44de
Merge pull request #60248 from ClickHouse/revert-59450-order-by-all-ambiguities
Revert "Replace `ORDER BY ALL` by `ORDER BY *`"
2024-02-26 10:23:41 +01:00
kssenii
18741f122e Move a setting to server setting 2024-02-26 12:45:24 +08:00
Vitaly Baranov
b1e2b8d345 Fix test "test_cancel_backup". 2024-02-23 20:27:19 +01:00
Alexey Milovidov
da2ae34c1d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:55:03 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Nikolai Kochetov
83841c23d3
Merge pull request #60230 from ClickHouse/fix-analyzer-secrets
Fix analyzer - hide arguments for secret functions
2024-02-23 15:26:49 +01:00
Alexey Milovidov
9e32d0f5b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:05:46 +01:00
Raúl Marín
464b5e0e15
Revert "Add definers for views (#54901)"
This reverts commit 57306706b3.
2024-02-23 12:44:31 +01:00
robot-clickhouse
5f39784093 Automatic style fix 2024-02-23 10:24:00 +00:00
Smita Kulkarni
86694596b3 Fix flaky test 2024-02-23 11:12:42 +01:00
Alexey Milovidov
06d10fa14b
Merge pull request #60269 from ClickHouse/fix-test-backup-s3
Fix integration `test_backup_restore_s3`
2024-02-22 23:59:10 +01:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
pufit
57306706b3
Add definers for views (#54901) 2024-02-22 17:47:50 +01:00
kssenii
f1e95fb78b Add a way to force read-through cache for merges 2024-02-22 15:40:00 +01:00
Kseniia Sumarokova
fb7924cdb1
Merge pull request #60233 from ClickHouse/hide-sensitive-info-in-s3-queue
Hide sensitive info for s3queue
2024-02-22 11:37:15 +01:00
robot-clickhouse
595ac95a5b Automatic style fix 2024-02-22 10:15:46 +00:00
Robert Schulze
d2cb434be9
Merge remote-tracking branch 'ClickHouse/master' into revert-59450-order-by-all-ambiguities 2024-02-22 10:12:14 +00:00
Smita Kulkarni
0eefab131d Updated pos check 2024-02-22 11:05:33 +01:00
Alexey Milovidov
330043af30 Fix integration test_backup_restore_s3 2024-02-22 10:58:05 +01:00
Alexey Milovidov
6c9e7073c7 Fix varieties and curiosities 2024-02-22 10:06:38 +01:00
Alexey Milovidov
d40a7e65aa Merge with master 2024-02-21 20:38:22 +01:00
Alexander Tokmakov
c5ab1893d7 Merge branch 'master' into modify-engine 2024-02-21 20:37:58 +01:00
Alexey Milovidov
2d9fbaa859 Merge with master 2024-02-21 20:37:48 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
robot-clickhouse
3b11218e74 Automatic style fix 2024-02-21 19:21:14 +00:00
Smita Kulkarni
29b7bf64d4 Fix issues with endpoint and prefix 2024-02-21 20:04:12 +01:00
Alexey Milovidov
79416cf1d7 Merge branch 'fix-inconsistent-formatting' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-21 19:53:11 +01:00
Alexey Milovidov
2436cfb8af Fix integration tests 2024-02-21 19:52:54 +01:00
robot-clickhouse
51519d4f5b Automatic style fix 2024-02-21 18:45:02 +00:00
Alexey Milovidov
7ad8644349 Fix integration tests 2024-02-21 19:36:07 +01:00
Alexey Milovidov
6f571c6ae9 Fix integration tests 2024-02-21 19:32:06 +01:00
Alexey Milovidov
d4c66728f8 Fix integration tests 2024-02-21 19:28:49 +01:00
Alexey Milovidov
d377ee7e1b Update integration tests 2024-02-21 19:23:52 +01:00
Robert Schulze
52afa46e23
Revert "Replace ORDER BY ALL by ORDER BY *" 2024-02-21 19:05:20 +01:00
Antonio Andelic
c309e643ea
Merge pull request #60210 from ClickHouse/fix-backup-user-specific-auth
Fix `test_backup_restore_s3/test.py::test_user_specific_auth`
2024-02-21 17:19:41 +01:00
robot-clickhouse
7e94a163bc Automatic style fix 2024-02-21 16:16:34 +00:00
Yakov Olkhovskiy
9c4967e788 prevent test from unrelated fails 2024-02-21 16:03:57 +00:00
kssenii
c05c3944d1 Hide sensitive info for s3queue 2024-02-21 16:49:53 +01:00
Igor Nikonov
0ead912127
Merge pull request #60158 from ClickHouse/fix-slowdown-count-side-effect
Fix: custom key failover test flakiness
2024-02-21 12:55:46 +01:00
Igor Nikonov
58b9d937e8
Merge pull request #60143 from ClickHouse/test-insert-over-http-query-log
Tests: query log for inserts over http
2024-02-21 12:54:12 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Antonio Andelic
199da94176
Revert "Do not retry queries if container is down in integration tests" 2024-02-21 11:13:41 +01:00
Antonio Andelic
8d6088c2e6 Fix test 2024-02-21 09:48:34 +01:00
jsc0218
fa6bf25800 add test 2024-02-21 03:51:38 +00:00
unashi
1731a5a8af [improve]change the integration test test_multiple_disks::test_move_across_policies_not_work to test_move_across_policies_work_for_attach_not_work_for_move 2024-02-21 10:55:32 +08:00
Robert Schulze
914b19aade
Merge pull request #59450 from rschu1ze/order-by-all-ambiguities
Replace `ORDER BY ALL` by `ORDER BY *`
2024-02-20 18:16:22 +01:00
Kseniia Sumarokova
f7de95cec3
Merge pull request #59775 from ClickHouse/rabbitmq-fix-possible-channel-ack-timeout
rabbitmq: fix possible channel error state
2024-02-20 16:08:33 +01:00
Antonio Andelic
34e8e673e9
Merge pull request #60144 from ClickHouse/per-user-s3-settings
Support specifying users for S3 settings
2024-02-20 13:20:07 +01:00
Igor Nikonov
a8e4627663 Fix: can't guarantee query distribution with enabled hedged requests 2024-02-20 12:09:54 +00:00
Igor Nikonov
d950f2c570 Merge remote-tracking branch 'origin/master' into test-insert-over-http-query-log 2024-02-20 11:32:33 +00:00
Robert Schulze
5474f36e75
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-20 10:09:57 +00:00
Robert Schulze
c475f3c0bd
Fix test_remote_blobs_naming 2024-02-20 10:05:54 +00:00
MikhailBurdukov
c2d641c658
Merge branch 'master' into backoff_for_failed_mutations 2024-02-20 11:48:59 +03:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
unashi
80fe3f78d9 [fix] black the python script 2024-02-20 11:12:09 +08:00
Igor Nikonov
bb5a6dd8d3 Fix: custom key failover test flakyness
slowdown_count used only by hedge connections
but it's stored inside connection pool and was used for pool shuffling
always. So, query execution which used hedged connections could affect
connection load balancing for queries w/o hedged connections by updating
slowdown_count
2024-02-19 20:44:55 +00:00
robot-clickhouse
0b2c3a7f0f Automatic style fix 2024-02-19 20:01:58 +00:00
kssenii
89006361c5 Fix test 2024-02-19 20:52:36 +01:00
Alexey Milovidov
425531067d
Merge pull request #60109 from azat/tests/integration-query-retries
Do not retry queries if container is down in integration tests
2024-02-19 19:23:39 +01:00
Antonio Andelic
175a1db787 Support specifying users for s3 settings 2024-02-19 16:43:27 +01:00
robot-clickhouse
cc223a1c3e Automatic style fix 2024-02-19 14:33:53 +00:00
Igor Nikonov
e77afa9dc5 Rename test 2024-02-19 14:20:39 +00:00
Igor Nikonov
9e4e44fc71 Tests: query log records for insert over http 2024-02-19 14:18:52 +00:00
unashi
f62ccc75ec [merge] solve 2024-02-19 19:28:16 +08:00
Igor Nikonov
f775e1a7c6
Merge pull request #59910 from ClickHouse/query-log-on-insert-exception-over-http
Fix: absence of closing record in query_log for failed insert over http
2024-02-19 12:27:44 +01:00
Azat Khuzhin
0496d0f45f Do not retry queries if container is down in integration tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-19 11:27:41 +01:00
MikhailBurdukov
c3ab9071fc
Merge branch 'master' into backoff_for_failed_mutations 2024-02-18 17:48:11 +03:00
MikhailBurdukov
94fa87ddc6 Style 2024-02-18 14:46:48 +00:00
MikhailBurdukov
b227e5dd3f Review changes 2024-02-18 13:37:12 +00:00
unashi
1549725edd [feature]: allow to attach parts from a different disk 2024-02-18 19:26:12 +08:00
Alexander Tokmakov
03ff171922 Merge branch 'master' into modify-engine 2024-02-16 17:22:24 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Dmitry Novik
cacd2e6463
Merge pull request #59921 from ClickHouse/analyzer-fix-test_distributed_backward_compatability
Remove `test_distributed_backward_compatability`
2024-02-16 13:58:45 +01:00
Dmitry Novik
757a5b627b
Merge pull request #60019 from ClickHouse/analyzer-fix-test_sql_user_defined_functions_on_cluster
Analyzer: Fix test_sql_user_defined_functions_on_cluster
2024-02-16 13:57:55 +01:00
Igor Nikonov
118263d8e8 Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http 2024-02-16 12:40:10 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Igor Nikonov
7b1fbec4e5 Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http 2024-02-15 21:11:38 +00:00
Dmitry Novik
7c73af9f13
Remove test completely 2024-02-15 17:49:35 +01:00
Dmitry Novik
199ae321a0
Merge branch 'master' into analyzer-fix-test_sql_user_defined_functions_on_cluster 2024-02-15 17:45:33 +01:00
Dmitry Novik
cc59e06fea
Merge pull request #59975 from ClickHouse/analyzer-fix-test_settings_profile
Analyzer: Fix test_settings_profile
2024-02-15 17:44:43 +01:00
Max Kainov
5a3a93bea5 CI: refactor bugfix validate job
#no_merge_commit
2024-02-15 16:28:27 +00:00
Konstantin Bogdanov
dbb6804a70
Merge pull request #59976 from ClickHouse/add-cloud-placement
Add `PlacementInfo`
2024-02-15 19:16:56 +03:00
Igor Nikonov
1464830791 Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http 2024-02-15 12:56:32 +00:00
robot-clickhouse
ad626233a1 Automatic style fix 2024-02-15 10:43:16 +00:00
Dmitry Novik
31128ecaa7 Analyzer: Fix test_sql_user_defined_functions_on_cluster 2024-02-15 10:29:27 +00:00
Dmitry Novik
ddc429ccbc
Revert incorrect changes 2024-02-15 10:14:58 +01:00
Alexey Milovidov
10eb948ed6
Merge branch 'master' into analyzer-fix-test_wrong_db_or_table_name 2024-02-15 07:56:56 +01:00
robot-clickhouse
acba747275 Automatic style fix 2024-02-15 02:12:44 +00:00
Alexey Milovidov
27a1755751
Merge pull request #59951 from ClickHouse/analyzer-fix-test_mutations_with_merge_tree
Analyzer: Fix test_mutations_with_merge_tree
2024-02-15 03:11:10 +01:00
Alexey Milovidov
b31c802f4a
Merge branch 'master' into analyzer-fix-test_settings_profile 2024-02-15 03:02:30 +01:00
Alexey Milovidov
9219617959
Apply review comments 2024-02-15 03:01:34 +01:00
Raúl Marín
4fb76a6e25
Merge pull request #59969 from ClickHouse/no-aerospike
We don't have external dictionaries from Aerospike
2024-02-14 15:54:46 +01:00
robot-clickhouse
5f570b574e Automatic style fix 2024-02-14 14:35:59 +00:00
kssenii
8fe9ede207 Add a test 2024-02-14 15:25:43 +01:00
Dmitry Novik
9acd68efc0
Merge branch 'master' into analyzer-fix-test_wrong_db_or_table_name 2024-02-14 13:29:45 +01:00
Dmitry Novik
824ee3efc2
Merge branch 'master' into analyzer-fix-test_mutations_with_merge_tree 2024-02-14 10:53:37 +01:00
Konstantin Bogdanov
f678bdc546
Update tests 2024-02-14 10:51:42 +01:00
Dmitry Novik
a7c7a5a671 Analyzer: Fix test_settings_profile 2024-02-14 09:50:55 +00:00
Dmitry Novik
a7c2d3146c
Merge pull request #59948 from ClickHouse/analyzer-fix-test_user_defined_object_persistence
Analyzer: Fix test_user_defined_object_persistence
2024-02-14 10:20:27 +01:00
Konstantin Bogdanov
3769846d4a
Lint 2024-02-14 10:20:05 +01:00
Konstantin Bogdanov
c71835ebec
Add an integration test 2024-02-14 10:19:55 +01:00
Dmitry Novik
b3e5d34204
Change used version 2024-02-14 10:16:13 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
robot-clickhouse
bc456820a0 Automatic style fix 2024-02-13 22:19:27 +00:00
Igor Nikonov
e9dcc751ac Merge remote-tracking branch 'origin/master' into query-log-on-insert-exception-over-http 2024-02-13 22:08:44 +00:00
Igor Nikonov
a27639a7f9 Fix: call first exception callback on exception
it'll update query_log
2024-02-13 22:06:00 +00:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection 2024-02-13 19:08:33 +01:00
Dmitry Novik
30ef68d78f Analyzer: Fix test_mutations_with_merge_tree 2024-02-13 18:59:23 +01:00
Dmitry Novik
262e8af909 Analyzer: Fix test_user_defined_object_persistence 2024-02-13 17:37:20 +01:00
Dmitry Novik
45d359cb93
Use version with execution names 2024-02-13 16:33:54 +01:00
Kseniia Sumarokova
daf1ca0625
Merge pull request #59370 from valbok/attach-db-tests
MaterializedMySQL: Fix gtid_after_attach_test to retry on detach
2024-02-13 13:27:29 +01:00
Dmitry Novik
21770b9d17
Bump server version 2024-02-13 10:39:45 +01:00
Dmitry Novik
d5fd7402f8 Merge remote-tracking branch 'origin/master' into analyzer-fix-test_wrong_db_or_table_name 2024-02-13 08:52:42 +00:00
robot-clickhouse
f5880d7201 Automatic style fix 2024-02-12 20:55:20 +00:00
Igor Nikonov
eb44faf867 Test to reproduce absence of closing record in query_log 2024-02-12 20:41:46 +00:00
kssenii
d008ee725f Add a test 2024-02-12 20:23:21 +01:00
Dmitry Novik
727e0bbf6a
Merge pull request #59750 from ClickHouse/fix-analyzer-integration-server-version
Analyzer: Fix test_replicating_constants/test.py::test_different_versions
2024-02-12 14:40:16 +01:00
Dmitry Novik
584d197e52
Merge pull request #59801 from ClickHouse/analyzer-fix-test_access_for_functions
Analyzer: fix test_access_for_functions/test.py::test_access_rights_for_function
2024-02-12 14:37:48 +01:00
Nikolai Kochetov
862c6cd79c
Merge pull request #57430 from ClickHouse/non-ready-set-ttl
Non ready set in TTL WHERE.
2024-02-09 16:31:26 +01:00
Vitaly Baranov
09e727d48b
Merge pull request #56988 from ClickHouse/Azure_backup
Backup & Restore support for AzureBlobStorage
2024-02-09 14:45:35 +01:00
Dmitry Novik
6aad9b1f13 Analyzer: Fix test_wrong_db_or_table_name/test.py::test_wrong_table_name 2024-02-09 14:05:01 +01:00
Dmitry Novik
361dd64374 Fix expected error message 2024-02-09 13:41:49 +01:00
Dmitry Novik
fc34507a94
Bump version 2024-02-09 12:48:07 +01:00
kssenii
e55b60e05c Fix 2024-02-08 17:43:16 +01:00
Nikolai Kochetov
97d1eb1091 Fixing test. 2024-02-08 14:31:24 +00:00
Dmitry Novik
fa0acaf39b
Fix image name 2024-02-08 15:18:17 +01:00
Dmitry Novik
3167bfe423
Bump server version 2024-02-08 11:35:23 +01:00
Alexander Tokmakov
510f90edf8
Merge pull request #59688 from ClickHouse/revert_39507_again
Temporarily remove a feature that doesn't work
2024-02-08 02:27:55 +01:00
Smita Kulkarni
e594608c42 Merge branch 'master' into Azure_backup 2024-02-07 13:48:46 +01:00
Alexander Tokmakov
77e4b0c8d9 Revert "Merge pull request #59122 from arthurpassos/bring_back_attach_partition_pr"
This reverts commit ac90637170, reversing
changes made to fe2b5cde05.
2024-02-07 02:52:43 +01:00
vdimir
9438118745
fix test_select_access_rights/test_main.py::test_select_join 2024-02-06 16:15:04 +00:00
Val Doroshchuk
ba94cd2ef7 MaterializedMySQL: Fix gtid_after_attach_test to retry on detach 2024-02-06 14:39:26 +01:00
Konstantin Bogdanov
f663f13a35
Merge pull request #59277 from ClickHouse/create-tables-in-threadpool
Concurrent tables creation in `recoverLostReplica`
2024-02-05 16:04:46 +03:00
MikhailBurdukov
97ee8c0901 remove old config 2024-02-04 11:25:47 +00:00
MikhailBurdukov
b90a5b94a8 Move setting to mergetree 2024-02-04 11:24:26 +00:00
robot-clickhouse
ce6df0fb13 Automatic style fix 2024-02-04 10:37:05 +00:00
Smita Kulkarni
b0994c5fa7 Addressed comments, added test for named collection 2024-02-04 11:28:20 +01:00
Julia Kartseva
f41f4e4bd0
Merge pull request #58486 from jkartseva/adjustable-async-timeouts
Adjustable asynchronous insert timeouts
2024-02-02 08:53:58 -08:00
Konstantin Bogdanov
6df4c64500
Use in integration test 2024-02-02 13:20:32 +01:00
Julia Kartseva
689c368b76 Adaptive async timeouts: consider queue flush history
In addition to the time since the most recent insert,
consider the elapsed time between the two recent queue
flushes when decreasing the timeout or processing an
entry synchronously.
2024-02-01 22:45:10 +00:00
Julia Kartseva
17d2455448 Integration tests for adaptive async insert timeout
Add initial tests.
2024-02-01 22:45:09 +00:00
Kseniia Sumarokova
e029021696
Merge pull request #59446 from ClickHouse/s3-queue-allow-to-add-start-point
Allow to define a starting point for s3queue ordered mode at creation
2024-02-01 16:46:24 +01:00
robot-clickhouse
fe829cac48 Automatic style fix 2024-02-01 11:43:55 +00:00
kssenii
3a16427e00 Fix test 2024-02-01 12:35:01 +01:00
kssenii
f7a5f09a0f Add one more test 2024-01-31 22:59:25 +01:00
Ilya Yatsishin
6a80a20997
Merge pull request #59432 from vitlibar/fix-test-test_stop_other_host_during_backup
Fix test test_stop_other_host_during_backup
2024-02-01 00:57:21 +04:00
kssenii
361b2f107b Allow to define a starting point for s3queue ordered mode 2024-01-31 21:28:18 +01:00
Vitaly Baranov
a193e01c8f
Merge pull request #54737 from arenadata/ADQM-1150
Added maximum sequential login failures to the quota.
2024-01-31 16:06:17 +01:00
Vitaly Baranov
79c068571d Fix test test_stop_other_host_during_backup. 2024-01-31 12:58:22 +01:00
Kseniia Sumarokova
b20567a055
Merge pull request #59167 from ClickHouse/s3-queue-parallelize-ordered-mode
S3Queue: allow parallel & disrtibuted processing for ordered mode
2024-01-31 11:20:41 +01:00
Kseniia Sumarokova
caaafbcedb
Merge pull request #56864 from ClickHouse/broken-projections-better-handling
Do not consider data part as broken if projection is broken
2024-01-31 11:17:15 +01:00
kssenii
145f6a31cb Fix 2024-01-30 16:29:40 +01:00
MikhailBurdukov
778efb8953
Merge branch 'master' into backoff_for_failed_mutations 2024-01-30 16:08:52 +03:00
MikhailBurdukov
5e845172da Enable per query setting 2024-01-30 12:42:03 +00:00
Kruglov Pavel
3105960fd8
Merge pull request #59352 from Avogar/fix-bad-attached-rabbitmq
Fix lazy initialization in RabbitMQ
2024-01-30 12:52:07 +01:00
Kruglov Pavel
bab6e6fe34
Fix tests 2024-01-30 11:37:32 +01:00
Kseniia Sumarokova
e16aaa8d81
Merge branch 'master' into broken-projections-better-handling 2024-01-30 10:54:22 +01:00
Kruglov Pavel
ff1cdf6bee
Restart CI 2024-01-30 00:42:51 +01:00
Alexey Gerasimchuck
559de083a3 Implemented failed login attempt counting using quota 2024-01-29 23:20:38 +00:00
avogar
3a5ba56c36 Fix lazy initialization in RabbitMQ, fix possible deadlock on insert into unitialized queue engine 2024-01-29 20:09:09 +00:00
robot-clickhouse
50439cc1d5 Automatic style fix 2024-01-29 19:14:22 +00:00
kssenii
36dc076bbf Update test 2024-01-29 20:04:38 +01:00
kssenii
df7d3b8a40 Allocate current shard number from keeper 2024-01-29 19:36:16 +01:00
Arthur Passos
15d04d0a78
Merge branch 'master' into bring_back_attach_partition_pr 2024-01-29 15:16:49 -03:00
avogar
377937d415 Merge branch 'master' of github.com:ClickHouse/ClickHouse into auto-format-detection 2024-01-29 15:45:18 +00:00
kssenii
ef252d8376 Validate settings with keeper, add a test 2024-01-29 12:36:00 +01:00
kssenii
5c5ec7465b Update test 2024-01-29 12:28:29 +01:00
Smita Kulkarni
3183026521 Merge branch 'master' into Azure_backup 2024-01-29 11:08:13 +01:00
Kseniia Sumarokova
a29ab8f29c
Merge pull request #59170 from azat/disks/s3-plain-improvements
Small improvements for tables on write-once (s3_plain)/read-only (web) disks
2024-01-29 10:44:37 +01:00
Azat Khuzhin
4248ae509a Support specifying settings for Distributed engine in config (like for MergeTree)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-27 18:06:16 +01:00
Kseniia Sumarokova
2c6243f365
Update test.py 2024-01-26 19:52:53 +01:00
vdimir
6795d0207f
Update test_reload_after_fail_in_cache_dictionary for analyzer 2024-01-26 16:37:54 +00:00
Azat Khuzhin
7cc7fb892c tests/test_disk_over_web_server: update expected assertion for static storage
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:36 +01:00
Azat Khuzhin
66a40bda0a Revert "Prohibit DROP from static storages"
It is actually OK to DROP at least from read-only disk, as for the
write-once it should be OK as well, since CREATE is prohibited anyway,
so there should be no leftovers

CI: https://s3.amazonaws.com/clickhouse-test-reports/59170/c82050d1925439f0ede2b32acb5b1b8df4acae5d/stress_test__asan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/59170/c82050d1925439f0ede2b32acb5b1b8df4acae5d/integration_tests__asan__[3_4].html

This reverts commit 082e62712c5e2f4c48d1abc6141ccfd1249d26b4.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
Azat Khuzhin
1ee723d50d Prohibit DROP from static storages
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
kssenii
5cd757dd9a Merge remote-tracking branch 'origin/master' into s3-queue-parallelize-ordered-mode 2024-01-26 16:33:22 +01:00
Kseniia Sumarokova
99653fc778
Merge branch 'master' into broken-projections-better-handling 2024-01-26 16:27:23 +01:00
Kruglov Pavel
946c4e0495
Merge branch 'master' into auto-format-detection 2024-01-26 15:51:35 +01:00
Arthur Passos
ce6877cbb6
Merge branch 'ClickHouse:master' into bring_back_attach_partition_pr 2024-01-26 10:57:11 -03:00
kssenii
7515fa99f4 I hope now 2024-01-26 13:15:15 +01:00
Kruglov Pavel
13c8624871
Fix style 2024-01-26 02:03:12 +01:00
Kruglov Pavel
918614970b
Fix style 2024-01-26 02:02:03 +01:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection 2024-01-25 22:11:07 +01:00
robot-clickhouse
0c82926b95 Automatic style fix 2024-01-25 18:21:38 +00:00
kssenii
08b6ec439e Try fxi 2024-01-25 19:11:55 +01:00
serxa
a40da92761 Merge branch 'master' into fix-async-loader-shutdown-deadlock 2024-01-25 11:31:05 +00:00
Kseniia Sumarokova
951c874aa9
Merge pull request #59080 from ClickHouse/data-lakes-survive-restart
Allow server to start with broken data lake table and fix itself lazily
2024-01-25 11:50:16 +01:00
avogar
11f1ea50d7 Fix tests 2024-01-24 17:55:31 +00:00
Nikita Taranov
067af44cbd
Merge pull request #59077 from ClickHouse/nickitat-patch-17
Fix `test_parallel_replicas_invisible_parts`
2024-01-24 17:19:36 +01:00
Kseniia Sumarokova
50a0494df7
Update test.py 2024-01-24 16:53:10 +01:00
kssenii
7f8f379d7f Parallel & disrtibuted processing for ordered mode 2024-01-24 16:32:15 +01:00
Kruglov Pavel
89bafbcda6
Merge pull request #59133 from Avogar/allow-to-ignore-schema-evolution-in-iceberg
Allow to ignore schema evolution in Iceberg table engine under a setting
2024-01-24 13:19:09 +01:00
robot-clickhouse
41e6dd7a9d Automatic style fix 2024-01-24 12:15:19 +00:00
serxa
0badcffdc1 test: table metadata load failure should shutdowns the server properly 2024-01-24 12:01:32 +00:00
Kseniia Sumarokova
4b40b14bba
Update test.py 2024-01-24 11:23:13 +01:00
Smita Kulkarni
4d92eba316 Merge branch 'master' into Azure_backup 2024-01-24 11:13:57 +01:00
Yarik Briukhovetskyi
f0be1ac2c4
Merge pull request #58936 from wheatdog/level-int-to-word
Display word-descriptive log level while enabling structured log formatting in json
2024-01-24 00:18:25 +01:00
avogar
617cc514b7 Try to detect file format automatically during schema inference if it's unknown 2024-01-23 18:59:39 +00:00
avogar
be3b5dc45f Allow to ignore schema evolution in Iceberg table engine under a setting 2024-01-23 17:45:41 +00:00
Arthur Passos
799a94081b Revert "Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition""
This reverts commit a1c83e2f51.
2024-01-23 11:40:42 -03:00
Tim Liou
7981d182bc Merge branch 'master' into level-int-to-word 2024-01-23 22:29:07 +08:00
Robert Schulze
a1c83e2f51
Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition" 2024-01-23 15:26:04 +01:00
kssenii
a4082f5b97 Add a test 2024-01-23 13:28:25 +01:00
Robert Schulze
9752079983
Cosmetics 2024-01-23 10:58:09 +00:00
Robert Schulze
e23e7e6b73
Merge pull request #53710 from rschu1ze/system-reload-asynchronous-metrics
Add statement `SYSTEM RELOAD ASYNCHRONOUS METRICS`
2024-01-23 11:56:25 +01:00
kssenii
b76630c955 Merge remote-tracking branch 'origin/master' into broken-projections-better-handling 2024-01-23 11:34:58 +01:00
Robert Schulze
8fc918b272
Fix style, pt. III 2024-01-23 06:23:34 +00:00
Robert Schulze
e72b44a0bf
Fix style, pt. II 2024-01-23 05:58:24 +00:00
Nikita Taranov
09e24ed6c5
Merge pull request #58068 from zhongyuankai/limit_materialized_view_size
A limit on the number of materialized views attached to a table.
2024-01-22 22:50:56 +01:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00