8244 Commits

Author	SHA1	Message	Date
Nikolai Kochetov	e1b00b3ee0	Merge branch 'master' into SystemTablesFilterEngine	2023-11-27 18:54:21 +00:00
Han Fei	347efc669e	support memory soft limit for keeper	2023-11-27 18:28:10 +01:00
Antonio Andelic	2ea44adefd	Add test	2023-11-27 15:05:56 +00:00
Antonio Andelic	9707796869	Ignore comments when comparing column descriptions	2023-11-27 12:25:41 +00:00
Kruglov Pavel	b10e46b2bc	Merge pull request #57126 from Avogar/size-virtual-column ... Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines	2023-11-27 10:12:18 +01:00
Bharat Nallan Chakravarthy	6454687fa6	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-26 16:24:18 -08:00
Azat Khuzhin	1168b7910b	Update test_throttling with enabled s3_disable_checksum ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-26 20:03:33 +01:00
Vitaly Baranov	4fed61e8ca	Merge pull request #57146 from vitlibar/fix-test_replicated_merge_tree_encryption_codec_different_keys_2 ... Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys	2023-11-25 09:36:33 +01:00
Alexey Milovidov	c478acab42	Merge pull request #57206 from azat/tests/test_distributed_storage_configuration ... Fix test_distributed_storage_configuration flakiness	2023-11-25 02:57:51 +01:00
Sema Checherinda	abd399705e	Merge pull request #57025 from CheSema/s3_engine_heavy_write_check_mem ... test_s3_engine_heavy_write_check_mem: turn test off	2023-11-24 21:07:35 +01:00
Azat Khuzhin	d0b4917fd3	Fix test_distributed_storage_configuration flakiness ... It fails [1] due to extra reservation on disk2 for some system.*_log tables, sure we can turn them off, but better to fix it explicitly with a separate policy. [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/98cddf5312722e403dcea429639ac13dc6cada33/integration_tests__tsan__[2_6].html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-24 20:28:18 +01:00
Alexey Milovidov	411660c267	Fix integration tests	2023-11-24 17:35:56 +01:00
Vitaly Baranov	5769a88b92	Merge pull request #57133 from vitlibar/change-default-for-wait_dictionaries_load_at_startup ... Change the default for wait_dictionaries_load_at_startup to true	2023-11-24 17:09:05 +01:00
Vitaly Baranov	683827c6df	Add comment.	2023-11-24 14:01:52 +01:00
vdimir	3b4f70a811	Minor changes in test_check_table	2023-11-23 16:24:11 +00:00
Vitaly Baranov	eabdc76e7c	Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys	2023-11-23 15:36:11 +01:00
Vitaly Baranov	5f461ff780	Change the default for "wait_dictionaries_load_at_startup" to true, ... and use this setting only if "dictionaries_lazy_load" is false.	2023-11-23 14:45:42 +01:00
Aleksei Filatov	1a03f5f7f4	Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation	2023-11-23 16:43:33 +03:00
avogar	e3afb4182b	Fix tests	2023-11-23 11:10:41 +00:00
serxa	0fc25fbda8	Merge branch 'master' into async-loader-integration	2023-11-23 09:32:43 +00:00
jsc0218	aba2f0e4b2	Fix Style	2023-11-22 20:02:15 +00:00
jsc0218	a1bde09c9c	move the test from stateless to integration	2023-11-22 19:13:13 +00:00
Kruglov Pavel	b84e3cf683	Merge branch 'master' into size-virtual-column	2023-11-22 19:25:00 +01:00
avogar	193f8a5d23	Add test for azure	2023-11-22 18:12:50 +00:00
zvonand	5153798aeb	Introduced fileCluster table function ... Added fileCluster function Added test and docs	2023-11-22 15:06:04 +01:00
Kruglov Pavel	9fb1acc947	Merge pull request #56810 from Avogar/iceberg-metadata-files ... Iceberg metadata files	2023-11-22 14:40:04 +01:00
Sema Checherinda	adf4ade00a	Update tests/integration/test_merge_tree_s3/test.py	2023-11-22 13:38:15 +01:00
Kseniia Sumarokova	e4f66b8469	Merge pull request #55158 from kssenii/fs-cache-improvement ... fs cache improvement for big reads	2023-11-21 21:50:00 +01:00
Nikita Mikhaylov	087a0a6043	Merge pull request #57040 from ClickHouse/fix-rabbitmq-supress-tsan-in-test ... Fix: suppress TSAN in RabbitMQ test	2023-11-21 17:52:36 +01:00
Sema Checherinda	63bd45fa5f	Update tests/integration/test_merge_tree_s3/test.py	2023-11-21 17:42:37 +01:00
vdimir	a139ae97eb	Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log ... Add system table with blob storage operations log	2023-11-21 17:40:42 +01:00
Vitaly Baranov	4052ae8bfd	Merge pull request #57007 from vitlibar/fix-dropping-tables-in-test_create_or_drop_tables_during_backup ... Fix dropping tables in test_create_or_drop_tables_during_backup	2023-11-21 17:16:16 +01:00
Sema Checherinda	2e1c142d6d	black style	2023-11-21 14:03:49 +01:00
Igor Nikonov	08b2740d0f	Fix: supress test with tsan	2023-11-21 11:26:14 +00:00
Kseniia Sumarokova	d384762123	Merge branch 'master' into fs-cache-improvement	2023-11-21 11:24:52 +01:00
Kseniia Sumarokova	f960036d76	Merge pull request #56874 from ClickHouse/kssenii-patch-8 ... Update test_storage_s3_queue/test.py	2023-11-21 11:13:00 +01:00
vdimir	15234474d7	Implement system table blob_storage_log	2023-11-21 09:18:25 +00:00
Sema Checherinda	524edd8460	turn test off	2023-11-21 00:08:20 +01:00
Alexey Milovidov	6a1955cb34	Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install	2023-11-20 21:34:31 +01:00
Sema Checherinda	485f1834d8	Merge pull request #56938 from CheSema/lz4-buffering ... Lz4 compression: buffer block in a rare case	2023-11-20 20:33:30 +01:00
Kseniia Sumarokova	9454b203e1	Merge branch 'master' into kssenii-patch-8	2023-11-20 20:19:21 +01:00
Vitaly Baranov	897cd06bcf	Fix dropping tables in test "test_create_or_drop_tables_during_backup".	2023-11-20 19:31:53 +01:00
avogar	f537bad469	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union	2023-11-20 14:32:50 +00:00
Sema Checherinda	a7fc8d4b99	test_merge_tree_s3 counts errors, turn off s3_use_adaptive_timeouts	2023-11-20 15:04:14 +01:00
avogar	872556a5d4	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union	2023-11-20 14:03:36 +00:00
Kseniia Sumarokova	4c7daf5167	Fix	2023-11-20 14:55:23 +01:00
Sema Checherinda	f999337dae	Revert "Revert "s3 adaptive timeouts""	2023-11-20 14:53:22 +01:00
Alexander Tokmakov	5031f239c3	Revert "s3 adaptive timeouts"	2023-11-20 14:28:59 +01:00
Alexey Milovidov	241cc2abf4	Merge branch 'master' into remove-useless-install	2023-11-20 01:12:08 +01:00
Bharat Nallan Chakravarthy	d08512d8c0	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-19 14:06:40 -08:00
Igor Nikonov	b9a28028e4	Merge branch 'master' into test-rabbitmq-with-secure-connection	2023-11-19 21:33:09 +01:00
Alexey Milovidov	9367dcc276	Merge pull request #56975 from rschu1ze/unflake-test_backward_compat ... Add exclude for tryBase64Decode to backward compat test (follow-up to #56913)	2023-11-19 16:41:42 +01:00
Robert Schulze	a3c9f13ac9	Add exclude for tryBase64Decode to backward compat test (follow-up to #56913) ... Fixes #56969	2023-11-19 15:33:58 +00:00
Antonio Andelic	ab234a87a8	Merge pull request #56960 from ClickHouse/fix-test_keeper_auth ... Fix `test_keeper_auth`	2023-11-19 16:09:04 +01:00
Sema Checherinda	a950595c24	Merge pull request #56314 from CheSema/s3-aggressive-timeouts ... s3 adaptive timeouts	2023-11-19 14:12:14 +01:00
serxa	9023f61349	Merge branch 'master' into async-loader-integration	2023-11-19 13:05:58 +00:00
Antonio Andelic	7c81d9b2b7	Fix test_keeper_auth	2023-11-18 19:38:33 +00:00
Antonio Andelic	274f2c71f2	Merge pull request #56460 from ClickHouse/keeper-map-backup-restore ... Backup/Restore for KeeperMap tables	2023-11-18 19:27:36 +01:00
Antonio Andelic	9eaafff3d2	Merge pull request #56715 from incfly/keeper-az-fix ... Fix keeper availability zone configuration.	2023-11-18 19:24:24 +01:00
Alexey Milovidov	74319b5cbd	Merge pull request #56082 from Algunenano/less_diff_images ... See what happens if we use less different docker images in integration tests	2023-11-18 17:24:28 +01:00
Sema Checherinda	6d5a5f9fcd	buffer result if out copacity is not enough	2023-11-17 17:31:00 +01:00
Raúl Marín	4d5becb4de	Adapt test_storage_s3/test.py::test_predefined_connection_configuration	2023-11-17 15:01:54 +01:00
Raúl Marín	7074bdb3bb	Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default	2023-11-17 14:53:02 +01:00
Kruglov Pavel	4e6f265e3e	Fix tests	2023-11-17 14:36:48 +01:00
Alexey Milovidov	5f9db3b248	Merge pull request #56794 from ClickHouse/early-exit-interserver-authentication-failure ... Early disconnect if there is authentication failure with interserver secret	2023-11-17 13:36:09 +01:00
Antonio Andelic	803d9668e2	Merge branch 'master' into keeper-map-backup-restore	2023-11-17 10:11:59 +00:00
Antonio Andelic	f8794e72e7	Merge pull request #56858 from ClickHouse/better-test_keeper_broken_logs ... Fix `test_keeper_broken_logs`	2023-11-17 10:36:05 +01:00
Antonio Andelic	8b30a54b48	Merge pull request #56835 from ClickHouse/better-test_keeper_reconfig_replace_leader ... More stable `test_keeper_reconfig_replace_leader`	2023-11-17 10:35:26 +01:00
Aleksei Filatov	163b8a814e	Fix clang-tidy issues and disable parallel execution of tests	2023-11-17 11:02:07 +03:00
Jianfei Hu	ef79bf6467	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az-fix	2023-11-16 21:58:02 +00:00
Bharat Nallan Chakravarthy	7434dd9e0a	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-16 11:17:45 -08:00
Kseniia Sumarokova	2a1467b8da	Update test_storage_s3_queue/test.py	2023-11-16 19:33:17 +01:00
Alexey Milovidov	2941f30678	Merge branch 'master' of github.com:ClickHouse/ClickHouse into early-exit-interserver-authentication-failure	2023-11-16 18:15:09 +01:00
Kseniia Sumarokova	a2ed756eec	Merge branch 'master' into fs-cache-improvement	2023-11-16 17:49:26 +01:00
robot-clickhouse	d03a1aab7b	Automatic style fix	2023-11-16 16:39:57 +00:00
Igor Nikonov	34f8bf8da5	Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection	2023-11-16 16:27:25 +00:00
Igor Nikonov	49c58e7609	Disable RabbitMQ secure connection test in intergatiion test with TSAN	2023-11-16 16:24:09 +00:00
Konstantin Bogdanov	4cc2d6baa5	Merge pull request #56694 from ClickHouse/fix-configuration-merge-issue ... Fix configuration merge for nodes with substitution attributes	2023-11-16 15:19:09 +01:00
Antonio Andelic	bb68321fc1	More stable test_keeper_reconfig_replace_leader	2023-11-16 13:31:39 +00:00
Antonio Andelic	bdf038191a	better test_keeper_broken_logs	2023-11-16 13:08:48 +00:00
Igor Nikonov	b9d083e68d	Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection	2023-11-16 13:05:10 +00:00
Igor Nikonov	4d16c096a1	Use ports from cluster	2023-11-16 13:03:20 +00:00
alesapin	437a911d7b	Merge pull request #56809 from ClickHouse/add_async_moves_execution ... Implement asynchronous execute of `ALTER TABLE ... MOVE ... TO DISK|VOLUME`	2023-11-16 12:47:31 +01:00
Antonio Andelic	203f83c2c2	Merge branch 'master' into keeper-map-backup-restore	2023-11-16 11:31:11 +00:00
Sema Checherinda	7d37c0e070	Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml ... Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>	2023-11-16 12:29:21 +01:00
Sema Checherinda	ebd42187ad	Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml ... Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>	2023-11-16 12:29:15 +01:00
Vitaly Baranov	342e6c7546	Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup ... Add config setting "wait_dictionaries_load_at_startup"	2023-11-16 11:51:29 +01:00
Aleksei Filatov	21a17f8334	Add cancellation hook for moving background operation	2023-11-16 13:37:51 +03:00
Vitaly Baranov	946e02ecbc	Merge pull request #56268 from vitlibar/add-script-backup-view ... Add an external utility to view backups and to extract information from them	2023-11-16 11:17:16 +01:00
Robert Schulze	44bd0598a3	Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns ... Fix incorrect nullable columns reporting in MySQL binary protocol	2023-11-16 01:12:46 +01:00
Alexey Milovidov	3067ca64df	Merge pull request #56573 from mkmkme/mkmkme/reload-config ... Update `query_masking_rules` when reloading the config	2023-11-16 00:27:01 +01:00
Alexey Milovidov	09bec3c754	Fix integration test	2023-11-16 00:16:02 +01:00
Konstantin Bogdanov	67796b18bb	Add missing test config files	2023-11-15 19:36:23 +01:00
robot-clickhouse	af2f986215	Automatic style fix	2023-11-15 17:48:54 +00:00
avogar	808c3f36ed	Remove prints from test	2023-11-15 17:47:10 +00:00
avogar	28522d56b7	Support Iceberg metadata files for metastore tables	2023-11-15 17:45:07 +00:00
Alexander Sapin	3e26161eaa	Implement asynchronous excute of ALTER TABLE ... MOVE ... TO DISK|VOLUME	2023-11-15 18:33:59 +01:00
Vitaly Baranov	21a283049c	Add the test for clickhouse_backupview to CI.	2023-11-15 17:40:53 +01:00
Alexander Tokmakov	bf10989515	Fix unexpected parts handling (#56693) ... * fix unexpected parts handling * Automatic style fix * fix --------- Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>	2023-11-15 16:54:47 +01:00
slvrtrn	9e3ba55070	Fix incorrect nullable columns reporting in MySQL binary protocol	2023-11-15 16:53:38 +01:00
Mikhail Koviazin	08d0a160ae	test_reload_query_masking_rules: don't rely on num of events ... Due to the fact that integration tests are run in parallel and there might be no ClickHouse restart between several tests, relying on `system.events` in the test is fragile as it can be affected by previous tests. This commit removes any assumptions regarding `system.events` from the test and tries to keep it robust.	2023-11-15 17:48:24 +02:00
Antonio Andelic	c3f7c8792a	Merge pull request #56763 from ClickHouse/disable-compress-logs-default ... Disable compressed logs by default in Keeper	2023-11-15 16:17:14 +01:00
Antonio Andelic	d567e718eb	Merge branch 'master' into keeper-map-backup-restore	2023-11-15 11:51:27 +00:00
Vitaly Baranov	308654195c	Add config setting "wait_dictionaries_load_at_startup".	2023-11-15 11:48:50 +01:00
Antonio Andelic	5309dc05ef	Fix test	2023-11-15 07:42:19 +00:00
Alexey Milovidov	37e48e76fe	Merge pull request #56768 from vitlibar/fix-flaky-test_replicated_merge_tree_encryption_codec ... Fix flaky test_replicated_merge_tree_encryption_codec.	2023-11-15 07:46:06 +01:00
Vitaly Baranov	3d95ac5f2a	Fix flaky test_replicated_merge_tree_encryption_codec.	2023-11-14 21:53:23 +01:00
robot-clickhouse	369aaef92f	Automatic style fix	2023-11-14 20:26:32 +00:00
Igor Nikonov	cd909ffc48	Test RabbitMQ with secure connection	2023-11-14 20:13:09 +00:00
Jianfei Hu	9df2775f08	reduce timeout and setTimeout earlier. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-14 17:58:16 +00:00
Sema Checherinda	b9cc1580e0	Merge pull request #56367 from canhld94/ch_table_reinit_new_disk ... Adding new disk to storage configuration without restart	2023-11-14 15:54:22 +01:00
Antonio Andelic	2f9ac9b49c	Address comments	2023-11-14 14:33:34 +00:00
robot-clickhouse	cc3dfafd7b	Automatic style fix	2023-11-14 13:07:45 +01:00
Konstantin Bogdanov	2fddc17642	Add test	2023-11-14 13:07:38 +01:00
Mikhail Koviazin	9e1357dd7e	Update query_masking_rules when reloading the config ... Fixes #56449	2023-11-14 14:03:28 +02:00
Sema Checherinda	3075bd9745	track clickhouse high level retries	2023-11-14 11:34:12 +01:00
Sema Checherinda	bb0b6afe14	reduce cuncurrent request number to the minio in test_storage_s3	2023-11-14 11:34:12 +01:00
Sema Checherinda	1a7be21a66	adjust tests	2023-11-14 11:34:12 +01:00
Sema Checherinda	338c51745f	fix style	2023-11-14 11:34:12 +01:00
Sema Checherinda	ab2594154e	add tests	2023-11-14 11:34:12 +01:00
Jianfei Hu	554d907189	Fix the keeper_server availability zone configuration. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-13 23:42:51 +00:00
Jianfei Hu	d3517140d9	Revert "Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."" ... This reverts commit e5aad4a6fd.	2023-11-13 19:03:27 +00:00
Bharat Nallan Chakravarthy	d90b8b6fba	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-13 08:43:37 -08:00
robot-clickhouse	a9725f22e1	Automatic style fix	2023-11-13 12:38:02 +00:00
Antonio Andelic	59480205d4	Merge branch 'master' into keeper-map-backup-restore	2023-11-13 12:21:26 +00:00
Antonio Andelic	e3c66f8a63	Merge branch 'master' into more-reliable-log-handling-keeper	2023-11-13 12:14:57 +00:00
Antonio Andelic	99d521becf	More reliable log handling in Keeper	2023-11-13 12:09:13 +00:00
Alexey Milovidov	5099859ccd	Merge pull request #56656 from ClickHouse/delete-a-file-2 ... Delete a file (2)	2023-11-13 10:17:13 +01:00
Alexey Milovidov	3807dcc469	Delete a file (2)	2023-11-13 07:08:21 +01:00
Alexey Milovidov	f48527b53a	Merge branch 'concurrency' of github.com:ClickHouse/ClickHouse into concurrency	2023-11-13 02:57:14 +01:00
Alexey Milovidov	7ac931c29d	Merge branch 'master' into concurrency	2023-11-13 02:56:56 +01:00
Alexey Milovidov	812b8c2bc1	Fix test; delete strange file	2023-11-12 00:56:57 +01:00
Pradeep Chhetri	2ec76f2140	Fix test	2023-11-11 16:47:43 +08:00
Pradeep Chhetri	d0922782ed	Revert "Revert "Add 4-letter command for yielding/resigning leadership"" ... This reverts commit e1766b96d9.	2023-11-11 15:37:49 +08:00
Alexey Milovidov	e1766b96d9	Revert "Add 4-letter command for yielding/resigning leadership"	2023-11-11 05:45:02 +03:00
Alexey Milovidov	e5aad4a6fd	Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."	2023-11-11 05:43:58 +03:00
Alexey Milovidov	28c89ad1c8	Merge pull request #56544 from jmaicher/fix/flaky-ldap-integration-test ... Fix flaky LDAP integration tests	2023-11-10 17:00:54 +01:00
Alexey Milovidov	461b80a781	Merge pull request #56570 from ClickHouse/fix-keeper-test_cmd_crst ... Fix `test_keeper_four_word_command/test.py::test_cmd_crst`	2023-11-10 16:57:42 +01:00
Nikolay Degterinsky	a6ebeb8422	Merge pull request #56484 from evillique/fix-on-cluster ... Fix ON CLUSTER queries without database on initial node	2023-11-10 13:40:41 +01:00
Nikolay Degterinsky	07b2cdb614	Merge pull request #56491 from evillique/fix-alter-comment-on-cluster ... Fix ALTER COMMENT queries ON CLUSTER	2023-11-10 13:35:26 +01:00
vdimir	051efccf6c	Delete unnecessary file ... <!--- A technical comment, you are free to remove or leave it as it is when PR is created The following categories are used in the next scripts, update them accordingly utils/changelog/changelog.py tests/ci/cancel_and_rerun_workflow_lambda/app.py --> ### Changelog category (leave one): - Not for changelog (changelog entry is not required)	2023-11-10 11:31:05 +01:00
Kseniia Sumarokova	e48df94772	Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue ... Minor improvements for S3Queue	2023-11-10 11:28:09 +01:00
Antonio Andelic	5364f4e9f8	Fix test	2023-11-10 09:59:43 +00:00
Julian Maicher	c3dc106980	Reformat with black	2023-11-10 04:28:21 +01:00
Julian Maicher	4e1965167e	Fix flaky LDAP integration tests ... Use LDAP hostname with regular DNS lookup to check if LDAP is online. Before that, we used the IP address that was extracted via the docker client (not via DNS lookup) and it could happen that LDAP was reachable via the IP, thus passing the online check, but not via DNS lookup, which led to test failures (e.g. LDAP not reachable from ClickHouse instance).	2023-11-09 21:24:52 +01:00
Mike Kot	785183bb3c	Keeper reconfig -- sleep before removing leader to avoid losing accepted ... but uncommitted commands	2023-11-09 16:22:44 +00:00
robot-clickhouse	188a88fa33	Automatic style fix	2023-11-09 16:15:14 +00:00
Antonio Andelic	f9895ab37b	Small fixes and add test	2023-11-09 15:56:57 +00:00
Kseniia Sumarokova	b05a66b9b5	Update test.py	2023-11-09 13:04:46 +01:00
Antonio Andelic	e9542e4153	Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol ... Support compression for keeper protocol	2023-11-09 10:00:19 +01:00