Commit Graph

8221 Commits

Author SHA1 Message Date
vdimir
3b4f70a811
Minor changes in test_check_table 2023-11-23 16:24:11 +00:00
Vitaly Baranov
eabdc76e7c Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys 2023-11-23 15:36:11 +01:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true,
and use this setting only if "dictionaries_lazy_load" is false.
2023-11-23 14:45:42 +01:00
Aleksei Filatov
1a03f5f7f4 Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation 2023-11-23 16:43:33 +03:00
avogar
e3afb4182b Fix tests 2023-11-23 11:10:41 +00:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
jsc0218
aba2f0e4b2 Fix Style 2023-11-22 20:02:15 +00:00
jsc0218
a1bde09c9c move the test from stateless to integration 2023-11-22 19:13:13 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
193f8a5d23 Add test for azure 2023-11-22 18:12:50 +00:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
Kruglov Pavel
9fb1acc947
Merge pull request #56810 from Avogar/iceberg-metadata-files
Iceberg metadata files
2023-11-22 14:40:04 +01:00
Sema Checherinda
adf4ade00a
Update tests/integration/test_merge_tree_s3/test.py 2023-11-22 13:38:15 +01:00
Kseniia Sumarokova
e4f66b8469
Merge pull request #55158 from kssenii/fs-cache-improvement
fs cache improvement for big reads
2023-11-21 21:50:00 +01:00
Nikita Mikhaylov
087a0a6043
Merge pull request #57040 from ClickHouse/fix-rabbitmq-supress-tsan-in-test
Fix: suppress TSAN in RabbitMQ test
2023-11-21 17:52:36 +01:00
Sema Checherinda
63bd45fa5f
Update tests/integration/test_merge_tree_s3/test.py 2023-11-21 17:42:37 +01:00
vdimir
a139ae97eb
Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log
Add system table with blob storage operations log
2023-11-21 17:40:42 +01:00
Vitaly Baranov
4052ae8bfd
Merge pull request #57007 from vitlibar/fix-dropping-tables-in-test_create_or_drop_tables_during_backup
Fix dropping tables in test_create_or_drop_tables_during_backup
2023-11-21 17:16:16 +01:00
Sema Checherinda
2e1c142d6d black style 2023-11-21 14:03:49 +01:00
Igor Nikonov
08b2740d0f Fix: supress test with tsan 2023-11-21 11:26:14 +00:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Kseniia Sumarokova
f960036d76
Merge pull request #56874 from ClickHouse/kssenii-patch-8
Update test_storage_s3_queue/test.py
2023-11-21 11:13:00 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
Sema Checherinda
524edd8460 turn test off 2023-11-21 00:08:20 +01:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Sema Checherinda
485f1834d8
Merge pull request #56938 from CheSema/lz4-buffering
Lz4 compression: buffer block in a rare case
2023-11-20 20:33:30 +01:00
Kseniia Sumarokova
9454b203e1
Merge branch 'master' into kssenii-patch-8 2023-11-20 20:19:21 +01:00
Vitaly Baranov
897cd06bcf Fix dropping tables in test "test_create_or_drop_tables_during_backup". 2023-11-20 19:31:53 +01:00
Sema Checherinda
a7fc8d4b99 test_merge_tree_s3 counts errors, turn off s3_use_adaptive_timeouts 2023-11-20 15:04:14 +01:00
Kseniia Sumarokova
4c7daf5167
Fix 2023-11-20 14:55:23 +01:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
Alexey Milovidov
241cc2abf4 Merge branch 'master' into remove-useless-install 2023-11-20 01:12:08 +01:00
Bharat Nallan Chakravarthy
d08512d8c0 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-19 14:06:40 -08:00
Igor Nikonov
b9a28028e4
Merge branch 'master' into test-rabbitmq-with-secure-connection 2023-11-19 21:33:09 +01:00
Alexey Milovidov
9367dcc276
Merge pull request #56975 from rschu1ze/unflake-test_backward_compat
Add exclude for tryBase64Decode to backward compat test (follow-up to #56913)
2023-11-19 16:41:42 +01:00
Robert Schulze
a3c9f13ac9
Add exclude for tryBase64Decode to backward compat test (follow-up to #56913)
Fixes #56969
2023-11-19 15:33:58 +00:00
Antonio Andelic
ab234a87a8
Merge pull request #56960 from ClickHouse/fix-test_keeper_auth
Fix `test_keeper_auth`
2023-11-19 16:09:04 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Antonio Andelic
7c81d9b2b7 Fix test_keeper_auth 2023-11-18 19:38:33 +00:00
Antonio Andelic
274f2c71f2
Merge pull request #56460 from ClickHouse/keeper-map-backup-restore
Backup/Restore for KeeperMap tables
2023-11-18 19:27:36 +01:00
Antonio Andelic
9eaafff3d2
Merge pull request #56715 from incfly/keeper-az-fix
Fix keeper availability zone configuration.
2023-11-18 19:24:24 +01:00
Alexey Milovidov
74319b5cbd
Merge pull request #56082 from Algunenano/less_diff_images
See what happens if we use less different docker images in integration tests
2023-11-18 17:24:28 +01:00
Sema Checherinda
6d5a5f9fcd buffer result if out copacity is not enough 2023-11-17 17:31:00 +01:00
Raúl Marín
4d5becb4de Adapt test_storage_s3/test.py::test_predefined_connection_configuration 2023-11-17 15:01:54 +01:00
Raúl Marín
7074bdb3bb Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default 2023-11-17 14:53:02 +01:00
Kruglov Pavel
4e6f265e3e
Fix tests 2023-11-17 14:36:48 +01:00
Alexey Milovidov
5f9db3b248
Merge pull request #56794 from ClickHouse/early-exit-interserver-authentication-failure
Early disconnect if there is authentication failure with interserver secret
2023-11-17 13:36:09 +01:00
Antonio Andelic
803d9668e2 Merge branch 'master' into keeper-map-backup-restore 2023-11-17 10:11:59 +00:00
Antonio Andelic
f8794e72e7
Merge pull request #56858 from ClickHouse/better-test_keeper_broken_logs
Fix `test_keeper_broken_logs`
2023-11-17 10:36:05 +01:00
Antonio Andelic
8b30a54b48
Merge pull request #56835 from ClickHouse/better-test_keeper_reconfig_replace_leader
More stable `test_keeper_reconfig_replace_leader`
2023-11-17 10:35:26 +01:00
Aleksei Filatov
163b8a814e Fix clang-tidy issues and disable parallel execution of tests 2023-11-17 11:02:07 +03:00
Jianfei Hu
ef79bf6467 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az-fix 2023-11-16 21:58:02 +00:00
Bharat Nallan Chakravarthy
7434dd9e0a Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-16 11:17:45 -08:00
Kseniia Sumarokova
2a1467b8da
Update test_storage_s3_queue/test.py 2023-11-16 19:33:17 +01:00
Alexey Milovidov
2941f30678 Merge branch 'master' of github.com:ClickHouse/ClickHouse into early-exit-interserver-authentication-failure 2023-11-16 18:15:09 +01:00
Kseniia Sumarokova
a2ed756eec
Merge branch 'master' into fs-cache-improvement 2023-11-16 17:49:26 +01:00
robot-clickhouse
d03a1aab7b Automatic style fix 2023-11-16 16:39:57 +00:00
Igor Nikonov
34f8bf8da5 Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 16:27:25 +00:00
Igor Nikonov
49c58e7609 Disable RabbitMQ secure connection test in intergatiion test with TSAN 2023-11-16 16:24:09 +00:00
Konstantin Bogdanov
4cc2d6baa5
Merge pull request #56694 from ClickHouse/fix-configuration-merge-issue
Fix configuration merge for nodes with substitution attributes
2023-11-16 15:19:09 +01:00
Antonio Andelic
bb68321fc1 More stable test_keeper_reconfig_replace_leader 2023-11-16 13:31:39 +00:00
Antonio Andelic
bdf038191a better test_keeper_broken_logs 2023-11-16 13:08:48 +00:00
Igor Nikonov
b9d083e68d Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 13:05:10 +00:00
Igor Nikonov
4d16c096a1 Use ports from cluster 2023-11-16 13:03:20 +00:00
alesapin
437a911d7b
Merge pull request #56809 from ClickHouse/add_async_moves_execution
Implement asynchronous execute of `ALTER TABLE ... MOVE ... TO DISK|VOLUME`
2023-11-16 12:47:31 +01:00
Antonio Andelic
203f83c2c2 Merge branch 'master' into keeper-map-backup-restore 2023-11-16 11:31:11 +00:00
Sema Checherinda
7d37c0e070
Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-11-16 12:29:21 +01:00
Sema Checherinda
ebd42187ad
Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-11-16 12:29:15 +01:00
Vitaly Baranov
342e6c7546
Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup
Add config setting "wait_dictionaries_load_at_startup"
2023-11-16 11:51:29 +01:00
Aleksei Filatov
21a17f8334 Add cancellation hook for moving background operation 2023-11-16 13:37:51 +03:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
Robert Schulze
44bd0598a3
Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns
Fix incorrect nullable columns reporting in MySQL binary protocol
2023-11-16 01:12:46 +01:00
Alexey Milovidov
3067ca64df
Merge pull request #56573 from mkmkme/mkmkme/reload-config
Update `query_masking_rules` when reloading the config
2023-11-16 00:27:01 +01:00
Alexey Milovidov
09bec3c754 Fix integration test 2023-11-16 00:16:02 +01:00
Konstantin Bogdanov
67796b18bb
Add missing test config files 2023-11-15 19:36:23 +01:00
robot-clickhouse
af2f986215 Automatic style fix 2023-11-15 17:48:54 +00:00
avogar
808c3f36ed Remove prints from test 2023-11-15 17:47:10 +00:00
avogar
28522d56b7 Support Iceberg metadata files for metastore tables 2023-11-15 17:45:07 +00:00
Alexander Sapin
3e26161eaa Implement asynchronous excute of ALTER TABLE ... MOVE ... TO DISK|VOLUME 2023-11-15 18:33:59 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
Alexander Tokmakov
bf10989515
Fix unexpected parts handling (#56693)
* fix unexpected parts handling

* Automatic style fix

* fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-11-15 16:54:47 +01:00
slvrtrn
9e3ba55070 Fix incorrect nullable columns reporting in MySQL binary protocol 2023-11-15 16:53:38 +01:00
Mikhail Koviazin
08d0a160ae
test_reload_query_masking_rules: don't rely on num of events
Due to the fact that integration tests are run in parallel and there
might be no ClickHouse restart between several tests, relying on
`system.events` in the test is fragile as it can be affected by previous
tests. This commit removes any assumptions regarding `system.events`
from the test and tries to keep it robust.
2023-11-15 17:48:24 +02:00
Antonio Andelic
c3f7c8792a
Merge pull request #56763 from ClickHouse/disable-compress-logs-default
Disable compressed logs by default in Keeper
2023-11-15 16:17:14 +01:00
Antonio Andelic
d567e718eb Merge branch 'master' into keeper-map-backup-restore 2023-11-15 11:51:27 +00:00
Vitaly Baranov
308654195c Add config setting "wait_dictionaries_load_at_startup". 2023-11-15 11:48:50 +01:00
Antonio Andelic
5309dc05ef Fix test 2023-11-15 07:42:19 +00:00
Alexey Milovidov
37e48e76fe
Merge pull request #56768 from vitlibar/fix-flaky-test_replicated_merge_tree_encryption_codec
Fix flaky test_replicated_merge_tree_encryption_codec.
2023-11-15 07:46:06 +01:00
Vitaly Baranov
3d95ac5f2a Fix flaky test_replicated_merge_tree_encryption_codec. 2023-11-14 21:53:23 +01:00
robot-clickhouse
369aaef92f Automatic style fix 2023-11-14 20:26:32 +00:00
Igor Nikonov
cd909ffc48 Test RabbitMQ with secure connection 2023-11-14 20:13:09 +00:00
Jianfei Hu
9df2775f08 reduce timeout and setTimeout earlier.
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-11-14 17:58:16 +00:00
Sema Checherinda
b9cc1580e0
Merge pull request #56367 from canhld94/ch_table_reinit_new_disk
Adding new disk to storage configuration without restart
2023-11-14 15:54:22 +01:00
Antonio Andelic
2f9ac9b49c Address comments 2023-11-14 14:33:34 +00:00
robot-clickhouse
cc3dfafd7b
Automatic style fix 2023-11-14 13:07:45 +01:00
Konstantin Bogdanov
2fddc17642
Add test 2023-11-14 13:07:38 +01:00
Mikhail Koviazin
9e1357dd7e
Update query_masking_rules when reloading the config
Fixes #56449
2023-11-14 14:03:28 +02:00
Sema Checherinda
3075bd9745 track clickhouse high level retries 2023-11-14 11:34:12 +01:00
Sema Checherinda
bb0b6afe14 reduce cuncurrent request number to the minio in test_storage_s3 2023-11-14 11:34:12 +01:00
Sema Checherinda
1a7be21a66 adjust tests 2023-11-14 11:34:12 +01:00
Sema Checherinda
338c51745f fix style 2023-11-14 11:34:12 +01:00
Sema Checherinda
ab2594154e add tests 2023-11-14 11:34:12 +01:00
Jianfei Hu
554d907189 Fix the keeper_server availability zone configuration.
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-11-13 23:42:51 +00:00
Jianfei Hu
d3517140d9 Revert "Revert "Add /keeper/availability-zone node to allow server load balancing within AZ.""
This reverts commit e5aad4a6fd.
2023-11-13 19:03:27 +00:00
Bharat Nallan Chakravarthy
d90b8b6fba Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-13 08:43:37 -08:00
robot-clickhouse
a9725f22e1 Automatic style fix 2023-11-13 12:38:02 +00:00
Antonio Andelic
59480205d4 Merge branch 'master' into keeper-map-backup-restore 2023-11-13 12:21:26 +00:00
Antonio Andelic
e3c66f8a63 Merge branch 'master' into more-reliable-log-handling-keeper 2023-11-13 12:14:57 +00:00
Antonio Andelic
99d521becf More reliable log handling in Keeper 2023-11-13 12:09:13 +00:00
Alexey Milovidov
5099859ccd
Merge pull request #56656 from ClickHouse/delete-a-file-2
Delete a file (2)
2023-11-13 10:17:13 +01:00
Alexey Milovidov
3807dcc469 Delete a file (2) 2023-11-13 07:08:21 +01:00
Alexey Milovidov
f48527b53a Merge branch 'concurrency' of github.com:ClickHouse/ClickHouse into concurrency 2023-11-13 02:57:14 +01:00
Alexey Milovidov
7ac931c29d Merge branch 'master' into concurrency 2023-11-13 02:56:56 +01:00
Alexey Milovidov
812b8c2bc1 Fix test; delete strange file 2023-11-12 00:56:57 +01:00
Pradeep Chhetri
2ec76f2140 Fix test 2023-11-11 16:47:43 +08:00
Pradeep Chhetri
d0922782ed Revert "Revert "Add 4-letter command for yielding/resigning leadership""
This reverts commit e1766b96d9.
2023-11-11 15:37:49 +08:00
Alexey Milovidov
e1766b96d9
Revert "Add 4-letter command for yielding/resigning leadership" 2023-11-11 05:45:02 +03:00
Alexey Milovidov
e5aad4a6fd
Revert "Add /keeper/availability-zone node to allow server load balancing within AZ." 2023-11-11 05:43:58 +03:00
Alexey Milovidov
28c89ad1c8
Merge pull request #56544 from jmaicher/fix/flaky-ldap-integration-test
Fix flaky LDAP integration tests
2023-11-10 17:00:54 +01:00
Alexey Milovidov
461b80a781
Merge pull request #56570 from ClickHouse/fix-keeper-test_cmd_crst
Fix `test_keeper_four_word_command/test.py::test_cmd_crst`
2023-11-10 16:57:42 +01:00
Nikolay Degterinsky
a6ebeb8422
Merge pull request #56484 from evillique/fix-on-cluster
Fix ON CLUSTER queries without database on initial node
2023-11-10 13:40:41 +01:00
Nikolay Degterinsky
07b2cdb614
Merge pull request #56491 from evillique/fix-alter-comment-on-cluster
Fix ALTER COMMENT queries ON CLUSTER
2023-11-10 13:35:26 +01:00
vdimir
051efccf6c
Delete unnecessary file
<!---
A technical comment, you are free to remove or leave it as it is when PR is created
The following categories are used in the next scripts, update them accordingly
utils/changelog/changelog.py
tests/ci/cancel_and_rerun_workflow_lambda/app.py
-->
### Changelog category (leave one):

- Not for changelog (changelog entry is not required)
2023-11-10 11:31:05 +01:00
Kseniia Sumarokova
e48df94772
Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue
Minor improvements for S3Queue
2023-11-10 11:28:09 +01:00
Antonio Andelic
5364f4e9f8 Fix test 2023-11-10 09:59:43 +00:00
Julian Maicher
c3dc106980 Reformat with black 2023-11-10 04:28:21 +01:00
Julian Maicher
4e1965167e Fix flaky LDAP integration tests
Use LDAP hostname with regular DNS lookup to check if LDAP is online.
Before that, we used the IP address that was extracted via the docker
client (not via DNS lookup) and it could happen that LDAP was reachable
via the IP, thus passing the online check, but not via DNS lookup, which
led to test failures (e.g. LDAP not reachable from ClickHouse instance).
2023-11-09 21:24:52 +01:00
Mike Kot
785183bb3c Keeper reconfig -- sleep before removing leader to avoid losing accepted
but uncommitted commands
2023-11-09 16:22:44 +00:00
robot-clickhouse
188a88fa33 Automatic style fix 2023-11-09 16:15:14 +00:00
Antonio Andelic
f9895ab37b Small fixes and add test 2023-11-09 15:56:57 +00:00
Kseniia Sumarokova
b05a66b9b5
Update test.py 2023-11-09 13:04:46 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
Nikolay Degterinsky
96f558f51a Fix ALTER COMMENT queries ON CLUSTER 2023-11-09 06:19:00 +00:00
Nikolay Degterinsky
cc0d447c52 Fix ON CLUSTER queries without local database 2023-11-08 23:30:35 +00:00
Alexander Tokmakov
32567e16e7
Merge pull request #56429 from ClickHouse/tavplubix-patch-9
Fix `test_attach_without_fetching`
2023-11-08 14:37:15 +01:00
robot-clickhouse
c064488bbf Automatic style fix 2023-11-08 11:48:09 +00:00
kssenii
dfcc94fff0 Fix test 2023-11-08 12:29:40 +01:00
kssenii
dbea50738b Merge remote-tracking branch 'origin/master' into fs-cache-improvement 2023-11-08 11:53:54 +01:00
Sema Checherinda
2ffd51fb36
Merge pull request #56421 from CheSema/move-to-server-settings
move storage_metadata_write_full_object_key setting to the server scope
2023-11-08 11:06:39 +01:00
Antonio Andelic
788c66027c
Merge pull request #56104 from incfly/keeper-az
Add /keeper/availability-zone node to allow server load balancing within AZ.
2023-11-08 09:46:24 +01:00
Alexander Tokmakov
fc1bd0efd5
Update test.py 2023-11-07 19:44:16 +01:00
Sema Checherinda
8216a24abe move storage_metadata_write_full_object_key setting to the server scope 2023-11-07 17:14:46 +01:00
Kseniia Sumarokova
cc3144ea2d
Merge pull request #56370 from ClickHouse/kssenii-patch-6
Update test_storage_s3_queue/test.py
2023-11-07 16:29:34 +01:00
Kseniia Sumarokova
d436414ec6
Merge pull request #56376 from ClickHouse/disable-s3-queue-test-for-ordered-mode
Update test_storage_s3_queue
2023-11-07 16:27:52 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Pradeep Chhetri
361472b29e Add 4-letter command for yielding/resigning leadership 2023-11-07 13:58:45 +08:00
Jianfei Hu
033bb19198 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az 2023-11-07 02:50:54 +00:00
Jianfei Hu
b552bf6928 fix the test node count.
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-11-07 02:50:46 +00:00