Commit Graph

8934 Commits

Author SHA1 Message Date
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
kssenii
c947484fe0 Fxi again 2024-03-12 19:36:10 +01:00
János Benjamin Antal
f63970769b Make test less flaky 2024-03-12 12:23:09 +00:00
robot-clickhouse
e9ef18c3ac Automatic style fix 2024-03-12 11:54:56 +00:00
János Benjamin Antal
aa9b5741e1 Improve tests 2024-03-12 11:43:08 +00:00
robot-clickhouse
4ce5245157 Automatic style fix 2024-03-12 11:03:39 +00:00
Kseniia Sumarokova
61543edc8b
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-12 11:53:00 +01:00
alesapin
ed22c4c86e
Merge pull request #61136 from azat/tests/fix-test_distributed_directory_monitor_split_batch_on_failure
Fix test_distributed_directory_monitor_split_batch_on_failure flakienss
2024-03-12 11:39:04 +01:00
Azat Khuzhin
4bd6d4456e Fix expectations for test_all_projection_files_are_dropped_when_part_is_dropped
Since after DROP PART mutations are not cleaned anymore.

Here an example:

                objects_at_the_end = list_objects(cluster)
    >           assert objects_at_the_end == objects_empty_table
    E           AssertionError: assert ['data/evt/iczupcswcatzvjikqwmovahturdht', 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'] == ['data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs']
    E             At index 0 diff: 'data/evt/iczupcswcatzvjikqwmovahturdht' != 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'
    E             Left contains one more item: 'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs'
    E             Full diff:
    E               [
    E             +  'data/evt/iczupcswcatzvjikqwmovahturdht',
    E                'data/oxq/dmkgqbdzeeiwmukogoxawfoxxnrqs',
    E               ]

    test_replicated_zero_copy_projection_mutation/test.py:155: AssertionError

And decoded paths:

    node1 :) select local_path from system.blob_storage_log where remote_path = 'data/evt/iczupcswcatzvjikqwmovahturdht'

    SELECT local_path
    FROM system.blob_storage_log
    WHERE remote_path = 'data/evt/iczupcswcatzvjikqwmovahturdht'

    Query id: 9ee5a9c0-c3b7-46ad-82bd-64c8bcbda78d

    ┌─local_path────────────────────────────────────────────────────────┐
    │ store/bce/bcea71c9-35cd-4368-9504-c563253b1964/tmp_mutation_1.txt │
    │ store/bce/bcea71c9-35cd-4368-9504-c563253b1964/mutation_1.txt     │
    └───────────────────────────────────────────────────────────────────┘

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
kssenii
5a71636411 Fxi 2024-03-11 19:44:52 +01:00
Nikita Mikhaylov
fcf8a3821d Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 19:12:49 +01:00
kssenii
38f41ee311 Fix integration test 2024-03-11 16:55:30 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Kseniia Sumarokova
19d8256fa8
Update test.py 2024-03-11 14:44:19 +01:00
Kseniia Sumarokova
90b27432a2
Update test.py 2024-03-11 12:18:58 +01:00
Kseniia Sumarokova
3832b0e126
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-11 11:30:03 +01:00
Kseniia Sumarokova
aacfefe0fe
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-11 10:37:53 +01:00
Azat Khuzhin
318fc7efcf Fix test_distributed_directory_monitor_split_batch_on_failure flakienss
The memory limit had been changed in #52439

CI: https://s3.amazonaws.com/clickhouse-test-reports/61132/04d885b570325b1e66bf0c7c13d4732b4d9340ec/integration_tests__tsan__[2_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-11 09:43:47 +01:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
HTTP connections pool
2024-03-10 14:06:59 +01:00
kssenii
e5e6625b0c Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-03-10 12:05:02 +01:00
Sema Checherinda
f7f1d86e66 fix tests test_attach_without_fetching test_replicated_merge_tree_wait_on_shutdown 2024-03-10 10:00:18 +01:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Alexey Milovidov
9ddec346a0 Miscellaneous 2024-03-10 09:02:34 +01:00
Alexander Tokmakov
92dea86bc4 Merge branch 'master' into fix_rdb_active 2024-03-08 22:26:01 +01:00
Alexander Tokmakov
854abd64d8
Merge pull request #60340 from ClickHouse/ddl_none_only_active
Add none_only_active DDL output mode
2024-03-08 22:20:40 +01:00
robot-clickhouse
babe000036 Automatic style fix 2024-03-08 16:43:10 +00:00
Alexander Tokmakov
e2317477f7 fix removing is_active node after re-creation 2024-03-08 17:30:29 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
kssenii
bcd7133075 Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-03-07 17:22:11 +08:00
JackyWoo
9e7894d8cb
Reduce the number of read rows from system.numbers (#60546)
* Fix read more data for system.numbers

* Fix tests
2024-03-07 09:38:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
robot-clickhouse
c7f5b1631c Automatic style fix 2024-03-07 08:30:34 +00:00
kssenii
f77b596374 Fix test 2024-03-07 16:17:27 +08:00
Kseniia Sumarokova
8fc3581446
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-07 14:29:57 +08:00
vdimir
56b6810122
Merge pull request #60641 from ClickHouse/vdimir/analyzer/comute_alias_columns
Resubmit "Analyzer: compute ALIAS columns right after reading"
2024-03-06 16:52:16 +01:00
Dmitry Novik
016bbfe6f8 Merge remote-tracking branch 'origin/master' into analyzer-distr-json 2024-03-06 15:09:52 +01:00
Dmitry Novik
7065e650e1 Code cleanup 2024-03-06 14:34:03 +01:00
robot-clickhouse
be98c95f58 Automatic style fix 2024-03-06 09:12:26 +00:00
kssenii
6d4514c045 Fix test 2024-03-06 16:55:48 +08:00
unashi
b4dba828a4 [fix] 2024-03-06 16:19:07 +08:00
unashi
3dbb0a12fb [fix] style 2024-03-06 16:15:37 +08:00
Antonio Andelic
e0fa26ece3
Merge pull request #60806 from Brokenice0415/add-leadership-expiry-setting
Support `leadership_expiry_ms` in  Keeper's settings
2024-03-06 09:05:50 +01:00
Mikhail f. Shiryaev
859044221f
Fix tests/integration/runner linter issues 2024-03-05 16:02:44 +01:00
Mikhail f. Shiryaev
711da9505e
Fix liter issues in conftest.py 2024-03-05 16:02:42 +01:00
Mikhail f. Shiryaev
842ca051a9
Fix more linter issues in ci-runner.py 2024-03-05 16:02:42 +01:00
Pradeep Chhetri
774fcdfff6
wip 2024-03-05 15:59:07 +01:00
Pradeep Chhetri
17f1e44241
Fix linter issues in ci-runner.py 2024-03-05 15:59:06 +01:00
Alexander Tokmakov
72a4533c4e Merge branch 'master' into ddl_none_only_active 2024-03-05 13:42:00 +01:00
vdimir
6f3e9b6de2
Merge branch 'master' into vdimir/analyzer/comute_alias_columns 2024-03-05 13:08:58 +01:00
Kseniia Sumarokova
3f90c933f3
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-05 11:22:56 +08:00
Kseniia Sumarokova
dbbe6b9f69
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-05 11:13:32 +08:00
robot-clickhouse
8be4a115ac Automatic style fix 2024-03-04 19:22:18 +00:00
Alexander Tokmakov
bf91fe8bae fix 2024-03-04 20:06:46 +01:00
Brokenice0415
cc1c3f2da3 add a keeper setting leadership_expiry 2024-03-05 00:54:25 +08:00
Igor Nikonov
48745c95cc
Merge pull request #60485 from ClickHouse/fix-test-custom-key-load-balancing
Fix: test_parallel_replicas_custom_key_load_balancing
2024-03-04 17:31:53 +01:00
Kseniia Sumarokova
925fd00fd1
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-04 16:04:46 +08:00
Azat Khuzhin
7dfe45e8d5 Do not retry queries if container is down in integration tests (resubmit)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 20:38:34 +01:00
Alexey Milovidov
7bfdc3d6db
Merge pull request #60699 from azat/tests/fix-test_grant_and_revoke
Fix test_grant_and_revoke/test.py::test_grant_all_on_table (after syncing with cloud)
2024-03-03 20:24:24 +03:00
Alexey Milovidov
37e6892f52
Merge pull request #60426 from Avogar/fix_test_reload_clusters_config
Improve test test_reload_clusters_config
2024-03-03 19:07:01 +03:00
Azat Khuzhin
79a93f501a Fix test_grant_and_revoke/test.py::test_grant_all_on_table (after syncing with cloud)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 13:33:01 +01:00
vdimir
47aa33408b
Resubmit "Analyzer: compute ALIAS columns right after reading"
This reverts commit 8141e1c3d1, reversing
changes made to fb099bbd62.
2024-03-01 14:53:02 +00:00
Antonio Andelic
8607e74966
Merge pull request #60537 from ClickHouse/keeper-snapshot-detached
Keeper improvement: abort during startup if an invalid snapshot is detected
2024-03-01 13:36:09 +01:00
SmitaRKulkarni
89fff6852a
Merge pull request #60251 from ClickHouse/Fix_endpoint_for_azureblobstorage
Azure Blob Storage : Fix issues endpoint and prefix
2024-03-01 10:23:49 +01:00
Antonio Andelic
5104029f62
Merge pull request #59535 from josh-hildred/tar_support
Add support for reading and writing backups as tar archives
2024-03-01 10:01:59 +01:00
Antonio Andelic
038ac83c43 Fix test 2024-03-01 09:39:56 +01:00
Kseniia Sumarokova
5ac53c9578
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-01 11:05:47 +08:00
robot-clickhouse
41deadda35 Automatic style fix 2024-02-29 18:37:00 +00:00
Dmitry Novik
55053dae44 Some progress 2024-02-29 19:18:06 +01:00
Smita Kulkarni
bb7453a339 Merge branch 'master' into Fix_endpoint_for_azureblobstorage 2024-02-29 15:05:17 +01:00
Alexander Tokmakov
2dedfd6cf9
Revert "Analyzer: compute ALIAS columns right after reading" 2024-02-29 14:22:07 +01:00
Joshua Hildred
ca9a6f809f add support for .tar.zst and tar.xz 2024-02-29 05:20:53 -08:00
Joshua Hildred
8bc968bb58 Fix tar integration test 2024-02-29 05:20:52 -08:00
Joshua Hildred
92b446a552 Add support for tar archive compression 2024-02-29 05:20:52 -08:00
Joshua Hildred
ef7a66b542 Update error messages and error handling 2024-02-29 05:20:51 -08:00
Joshua Hildred
d0776e5d2a Fixes tidy issue and error formating for test 2024-02-29 05:20:51 -08:00
Joshua Hildred
dc74cebe4e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
c53021f55e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
eb4ec0e871 Add support for reading and writing backups as a
tar archive using libarchive.
2024-02-29 05:20:51 -08:00
Antonio Andelic
1fd54fb9e4 Merge branch 'master' into keeper-snapshot-detached 2024-02-29 13:38:13 +01:00
Antonio Andelic
75837152cb better test 2024-02-29 12:48:08 +01:00
Smita Kulkarni
a168a84624 Merge branch 'master' into Fix_endpoint_for_azureblobstorage 2024-02-29 10:55:31 +01:00
vdimir
5dd81f38fb
Merge pull request #59595 from ClickHouse/vdimir/analyzer/comute_alias_columns
Analyzer: compute ALIAS columns right after reading
2024-02-29 10:28:31 +01:00
Smita Kulkarni
5d68c9f046 Updated default value of endpoint_contains_account_name to true 2024-02-29 09:38:13 +01:00
Kseniia Sumarokova
3188c1ebda Update test.py 2024-02-29 12:48:05 +08:00
Kseniia Sumarokova
34a8b46a88
Merge branch 'master' into fix-usage-of-plain-metadata 2024-02-29 12:47:22 +08:00
Alexey Milovidov
e1e66dc2b8
Merge pull request #60095 from ClickHouse/fix-inconsistent-formatting
Fix inconsistent formatting of queries
2024-02-29 00:41:40 +03:00
Alexander Tokmakov
25c82a5949
Merge pull request #57798 from kirillgarbar/modify-engine
Convert MergeTree tables to replicated on server restart if flag is set
2024-02-28 21:55:15 +01:00
Alexey Milovidov
b116bcadd1
Merge pull request #60472 from ClickHouse/fix-bad-test-8
Make test slower
2024-02-28 19:20:14 +03:00
Alexey Milovidov
d0313381b8
Merge pull request #60471 from ClickHouse/fix-bad-test-7
Fix bad test: looks like an obvious race condition, but I didn't check in detail.
2024-02-28 19:18:16 +03:00
Alexey Milovidov
1950a75bd4 Merge branch 'master' into fix-inconsistent-formatting 2024-02-28 17:10:29 +01:00
Nikolai Kochetov
8dd08e9844
Merge pull request #59710 from GrigoryPervakov/master
Support sql created named collections in Kafka Storage for librdkafka settings
2024-02-28 16:38:56 +01:00
Raúl Marín
54ae88a859
Merge pull request #60407 from Algunenano/old_integration_tests
Remove old tags from integration tests
2024-02-28 13:23:44 +01:00
Igor Nikonov
dcafa2a3b3 Fix: test_parallel_replicas_custom_key_load_balancing 2024-02-28 10:56:28 +00:00
robot-clickhouse
8145cd15b1 Automatic style fix 2024-02-28 10:34:40 +00:00
Smita Kulkarni
a46d7c9191 Updated docs and addressed comments 2024-02-28 11:25:35 +01:00
Vitaly Baranov
926295f763
Merge pull request #60040 from vitlibar/use-multiple-threads-while-reading-metadata-for-restore
Use multiple threads while reading the metadata of tables to restore
2024-02-28 11:07:15 +01:00
Alexey Milovidov
71065cc462 Make test slower 2024-02-28 01:46:25 +01:00
Alexey Milovidov
4fde83aa8e Fix bad test 2024-02-28 01:16:02 +01:00
Alexey Milovidov
29e3485c2f Fix bad test 2024-02-28 01:15:14 +01:00
Alexey Milovidov
19adcbc69c Fix bad test 2024-02-28 01:12:34 +01:00
pufit
330a206470
Add definers for views (Attempt 2) (#60439) 2024-02-27 19:00:17 -05:00
Alexey Milovidov
cbdd36890d Fix test 2024-02-28 00:33:56 +01:00
Alexey Milovidov
5b9071a780 Merge branch 'fix-inconsistent-formatting' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:51 +01:00
Alexey Milovidov
8cf619bc03 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:44 +01:00
Pervakov Grigorii
d3b82ab7c1 Support sql created named collections in Kafka Storage for librdkafka settings 2024-02-27 18:36:36 +00:00
robot-clickhouse
733453f817 Automatic style fix 2024-02-27 17:01:09 +00:00
Alexey Milovidov
06d1fc6e58 Fix tests 2024-02-27 17:49:16 +01:00
Alexey Milovidov
5a972c2533 Merge branch 'fix-inconsistent-formatting' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-27 17:43:07 +01:00
Alexey Milovidov
fc80c796e5 Fix tests 2024-02-27 17:42:51 +01:00
kssenii
4243ac160f Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-02-27 23:28:48 +08:00
kssenii
ffd69e0e12 Move setting to merge-tree level 2024-02-27 23:22:04 +08:00
Robert Schulze
0f6bec7842
Merge pull request #59291 from azat/dist/config-settings
Support specifying settings for Distributed engine in config (like for MergeTree)
2024-02-27 16:10:51 +01:00
Nikita Mikhaylov
8719a601fa
Merge pull request #60436 from nickitat/revert_56864
Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
2024-02-27 15:25:15 +01:00
Raúl Marín
e86c8dbf9e Remove old tests 2024-02-27 12:27:47 +01:00
kssenii
33788250b1 Update test.py 2024-02-27 18:07:19 +08:00
kssenii
a284e711da Merge remote-tracking branch 'origin/fix-usage-of-plain-metadata' into fix-usage-of-plain-metadata 2024-02-27 17:35:58 +08:00
kssenii
f53f43b78d Fixes for LocalObjectStorage and plain metadata 2024-02-27 17:33:47 +08:00
robot-clickhouse
fb0465acfa Automatic style fix 2024-02-27 00:01:34 +00:00
Alexey Milovidov
9d75ab2023 Fix integration tests 2024-02-27 00:54:20 +01:00
Nikita Taranov
854f1b064b Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
This reverts commit caaafbcedb, reversing
changes made to d45b248f96.
2024-02-27 00:13:28 +01:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
Kruglov Pavel
a11440a5e5
Fix style 2024-02-26 18:27:53 +01:00
avogar
88d55e88f3 Improve test test_reload_clusters_config 2024-02-26 16:46:41 +00:00
vdimir
5a9026f39b
Analyzer: compute ALIAS columns right after reading 2024-02-26 16:15:05 +00:00
Raúl Marín
e9dd4de143 Oh no! Style 2024-02-26 16:54:42 +01:00
Raúl Marín
7e56a8048e Adapt test 2024-02-26 16:29:47 +01:00
Raúl Marín
4b64145ea8 Missing includes 2024-02-26 16:00:40 +01:00
Raúl Marín
98e68ccfb8 Remove old tags from integration tests 2024-02-26 13:45:20 +01:00
Robert Schulze
1e40b63cb1
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 11:15:51 +00:00
robot-clickhouse
69b5bd02a9 Automatic style fix 2024-02-26 09:37:17 +00:00
kssenii
277e8d9655 Fix usage plain metadata type with new configuration option 2024-02-26 17:27:45 +08:00
Robert Schulze
5c967c44de
Merge pull request #60248 from ClickHouse/revert-59450-order-by-all-ambiguities
Revert "Replace `ORDER BY ALL` by `ORDER BY *`"
2024-02-26 10:23:41 +01:00
kssenii
18741f122e Move a setting to server setting 2024-02-26 12:45:24 +08:00
Vitaly Baranov
b1e2b8d345 Fix test "test_cancel_backup". 2024-02-23 20:27:19 +01:00
Alexey Milovidov
da2ae34c1d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:55:03 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Nikolai Kochetov
83841c23d3
Merge pull request #60230 from ClickHouse/fix-analyzer-secrets
Fix analyzer - hide arguments for secret functions
2024-02-23 15:26:49 +01:00
Alexey Milovidov
9e32d0f5b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:05:46 +01:00
Raúl Marín
464b5e0e15
Revert "Add definers for views (#54901)"
This reverts commit 57306706b3.
2024-02-23 12:44:31 +01:00
robot-clickhouse
5f39784093 Automatic style fix 2024-02-23 10:24:00 +00:00
Smita Kulkarni
86694596b3 Fix flaky test 2024-02-23 11:12:42 +01:00
Alexey Milovidov
06d10fa14b
Merge pull request #60269 from ClickHouse/fix-test-backup-s3
Fix integration `test_backup_restore_s3`
2024-02-22 23:59:10 +01:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
pufit
57306706b3
Add definers for views (#54901) 2024-02-22 17:47:50 +01:00
kssenii
f1e95fb78b Add a way to force read-through cache for merges 2024-02-22 15:40:00 +01:00
Kseniia Sumarokova
fb7924cdb1
Merge pull request #60233 from ClickHouse/hide-sensitive-info-in-s3-queue
Hide sensitive info for s3queue
2024-02-22 11:37:15 +01:00
robot-clickhouse
595ac95a5b Automatic style fix 2024-02-22 10:15:46 +00:00
Robert Schulze
d2cb434be9
Merge remote-tracking branch 'ClickHouse/master' into revert-59450-order-by-all-ambiguities 2024-02-22 10:12:14 +00:00
Smita Kulkarni
0eefab131d Updated pos check 2024-02-22 11:05:33 +01:00
Alexey Milovidov
330043af30 Fix integration test_backup_restore_s3 2024-02-22 10:58:05 +01:00