8367 Commits

Author	SHA1	Message	Date
Han Fei	a316b70917	Merge branch 'master' into hanfei/keeper_soft_limit	2023-11-30 12:29:40 +01:00
Alexander Tokmakov	a2dc2d9a53	Mark a setting obsolete (#57336) ... * Update Settings.h * Update InterpreterUndropQuery.cpp * Update 02888_obsolete_settings.reference * Update test.py * Update 02681_undrop_query.sql * Update 02681_undrop_query_uuid.sh	2023-11-29 19:24:11 +01:00
Alexander Tokmakov	97b63bbbca	Merge pull request #57339 from ClickHouse/fix_ddlworker_hostname_change ... Ignore finished ON CLUSTER tasks if hostname changed	2023-11-29 17:46:17 +01:00
Nikolai Kochetov	823ba2db46	Merge pull request #57075 from yariks5s/s3_links_fix ... S3-style links bug fix	2023-11-29 17:41:08 +01:00
vdimir	b5babe1692	MergeTask uses temporary data storage	2023-11-29 16:18:32 +00:00
zvonand	c329e382ab	resolve conflicts	2023-11-29 16:03:07 +01:00
Han Fei	4c0efb0262	Merge pull request #53240 from hanfei1991/hanfei/statistic ... use statistic to order prewhere conditions better	2023-11-29 12:26:44 +01:00
Nikolai Kochetov	731a1bfcf8	Cleanup	2023-11-29 11:11:58 +00:00
Alexander Tokmakov	84abbafcc5	ignore finished ddl tasks if hostname changed	2023-11-29 02:06:52 +01:00
Nikolai Kochetov	4d906d6e3c	Cleanup	2023-11-28 18:35:19 +00:00
Yarik Briukhovetskyi	ad9583d6e9	style fix	2023-11-28 19:13:37 +01:00
Yarik Briukhovetskyi	a83a046d54	added tests	2023-11-28 17:33:46 +00:00
Nikolai Kochetov	08a7575984	Re-implement filtering a bit.	2023-11-28 16:17:35 +00:00
Han Fei	6733438adc	Merge branch 'master' into hanfei/statistic	2023-11-28 16:35:00 +01:00
zvonand	c306d21b54	merge master + resolve conflicts	2023-11-28 15:51:21 +01:00
Han Fei	3aa4a6ae2c	check integration test	2023-11-28 14:47:31 +01:00
Antonio Andelic	9dd4783675	Merge branch 'master' into fix-readonly-replica	2023-11-28 10:43:29 +00:00
vdimir	ae09d04578	Merge pull request #57154 from ClickHouse/vdimir/params_test_check_table ... Minor changes in test_check_table	2023-11-28 11:10:26 +01:00
Han Fei	7bd2ea3add	Merge branch 'master' into hanfei/statistic	2023-11-27 23:31:23 +01:00
Han Fei	8e1b61cc13	fix style	2023-11-27 22:03:05 +01:00
Nikolai Kochetov	e1b00b3ee0	Merge branch 'master' into SystemTablesFilterEngine	2023-11-27 18:54:21 +00:00
Han Fei	347efc669e	support memory soft limit for keeper	2023-11-27 18:28:10 +01:00
Antonio Andelic	2ea44adefd	Add test	2023-11-27 15:05:56 +00:00
Antonio Andelic	9707796869	Ignore comments when comparing column descriptions	2023-11-27 12:25:41 +00:00
MikhailBurdukov	6f19e8ebd1	Merge branch 'master' into native_copy_for_s3_disks	2023-11-27 14:25:36 +03:00
MikhailBurdukov	c10c30832c	Review fix	2023-11-27 10:58:30 +00:00
Kruglov Pavel	b10e46b2bc	Merge pull request #57126 from Avogar/size-virtual-column ... Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines	2023-11-27 10:12:18 +01:00
Bharat Nallan Chakravarthy	6454687fa6	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-26 16:24:18 -08:00
Azat Khuzhin	1168b7910b	Update test_throttling with enabled s3_disable_checksum ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-26 20:03:33 +01:00
Vitaly Baranov	4fed61e8ca	Merge pull request #57146 from vitlibar/fix-test_replicated_merge_tree_encryption_codec_different_keys_2 ... Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys	2023-11-25 09:36:33 +01:00
Alexey Milovidov	c478acab42	Merge pull request #57206 from azat/tests/test_distributed_storage_configuration ... Fix test_distributed_storage_configuration flakiness	2023-11-25 02:57:51 +01:00
Sema Checherinda	abd399705e	Merge pull request #57025 from CheSema/s3_engine_heavy_write_check_mem ... test_s3_engine_heavy_write_check_mem: turn test off	2023-11-24 21:07:35 +01:00
Azat Khuzhin	d0b4917fd3	Fix test_distributed_storage_configuration flakiness ... It fails [1] due to extra reservation on disk2 for some system.*_log tables, sure we can turn them off, but better to fix it explicitly with a separate policy. [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/98cddf5312722e403dcea429639ac13dc6cada33/integration_tests__tsan__[2_6].html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-24 20:28:18 +01:00
Alexey Milovidov	411660c267	Fix integration tests	2023-11-24 17:35:56 +01:00
Vitaly Baranov	5769a88b92	Merge pull request #57133 from vitlibar/change-default-for-wait_dictionaries_load_at_startup ... Change the default for wait_dictionaries_load_at_startup to true	2023-11-24 17:09:05 +01:00
Vitaly Baranov	683827c6df	Add comment.	2023-11-24 14:01:52 +01:00
vdimir	3b4f70a811	Minor changes in test_check_table	2023-11-23 16:24:11 +00:00
Vitaly Baranov	eabdc76e7c	Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys	2023-11-23 15:36:11 +01:00
Vitaly Baranov	5f461ff780	Change the default for "wait_dictionaries_load_at_startup" to true, ... and use this setting only if "dictionaries_lazy_load" is false.	2023-11-23 14:45:42 +01:00
Aleksei Filatov	1a03f5f7f4	Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation	2023-11-23 16:43:33 +03:00
avogar	e3afb4182b	Fix tests	2023-11-23 11:10:41 +00:00
serxa	0fc25fbda8	Merge branch 'master' into async-loader-integration	2023-11-23 09:32:43 +00:00
jsc0218	aba2f0e4b2	Fix Style	2023-11-22 20:02:15 +00:00
jsc0218	a1bde09c9c	move the test from stateless to integration	2023-11-22 19:13:13 +00:00
Kruglov Pavel	b84e3cf683	Merge branch 'master' into size-virtual-column	2023-11-22 19:25:00 +01:00
avogar	193f8a5d23	Add test for azure	2023-11-22 18:12:50 +00:00
zvonand	5153798aeb	Introduced fileCluster table function ... Added fileCluster function Added test and docs	2023-11-22 15:06:04 +01:00
Kruglov Pavel	9fb1acc947	Merge pull request #56810 from Avogar/iceberg-metadata-files ... Iceberg metadata files	2023-11-22 14:40:04 +01:00
Sema Checherinda	adf4ade00a	Update tests/integration/test_merge_tree_s3/test.py	2023-11-22 13:38:15 +01:00
Kseniia Sumarokova	e4f66b8469	Merge pull request #55158 from kssenii/fs-cache-improvement ... fs cache improvement for big reads	2023-11-21 21:50:00 +01:00
Nikita Mikhaylov	087a0a6043	Merge pull request #57040 from ClickHouse/fix-rabbitmq-supress-tsan-in-test ... Fix: suppress TSAN in RabbitMQ test	2023-11-21 17:52:36 +01:00
Sema Checherinda	63bd45fa5f	Update tests/integration/test_merge_tree_s3/test.py	2023-11-21 17:42:37 +01:00
vdimir	a139ae97eb	Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log ... Add system table with blob storage operations log	2023-11-21 17:40:42 +01:00
Vitaly Baranov	4052ae8bfd	Merge pull request #57007 from vitlibar/fix-dropping-tables-in-test_create_or_drop_tables_during_backup ... Fix dropping tables in test_create_or_drop_tables_during_backup	2023-11-21 17:16:16 +01:00
Sema Checherinda	2e1c142d6d	black style	2023-11-21 14:03:49 +01:00
Igor Nikonov	08b2740d0f	Fix: supress test with tsan	2023-11-21 11:26:14 +00:00
Kseniia Sumarokova	d384762123	Merge branch 'master' into fs-cache-improvement	2023-11-21 11:24:52 +01:00
Kseniia Sumarokova	f960036d76	Merge pull request #56874 from ClickHouse/kssenii-patch-8 ... Update test_storage_s3_queue/test.py	2023-11-21 11:13:00 +01:00
vdimir	15234474d7	Implement system table blob_storage_log	2023-11-21 09:18:25 +00:00
Sema Checherinda	524edd8460	turn test off	2023-11-21 00:08:20 +01:00
Alexey Milovidov	6a1955cb34	Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install	2023-11-20 21:34:31 +01:00
Sema Checherinda	485f1834d8	Merge pull request #56938 from CheSema/lz4-buffering ... Lz4 compression: buffer block in a rare case	2023-11-20 20:33:30 +01:00
Kseniia Sumarokova	9454b203e1	Merge branch 'master' into kssenii-patch-8	2023-11-20 20:19:21 +01:00
Vitaly Baranov	897cd06bcf	Fix dropping tables in test "test_create_or_drop_tables_during_backup".	2023-11-20 19:31:53 +01:00
avogar	f537bad469	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union	2023-11-20 14:32:50 +00:00
Sema Checherinda	a7fc8d4b99	test_merge_tree_s3 counts errors, turn off s3_use_adaptive_timeouts	2023-11-20 15:04:14 +01:00
avogar	872556a5d4	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union	2023-11-20 14:03:36 +00:00
Kseniia Sumarokova	4c7daf5167	Fix	2023-11-20 14:55:23 +01:00
Sema Checherinda	f999337dae	Revert "Revert "s3 adaptive timeouts""	2023-11-20 14:53:22 +01:00
Alexander Tokmakov	5031f239c3	Revert "s3 adaptive timeouts"	2023-11-20 14:28:59 +01:00
Alexey Milovidov	241cc2abf4	Merge branch 'master' into remove-useless-install	2023-11-20 01:12:08 +01:00
Bharat Nallan Chakravarthy	d08512d8c0	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-19 14:06:40 -08:00
Igor Nikonov	b9a28028e4	Merge branch 'master' into test-rabbitmq-with-secure-connection	2023-11-19 21:33:09 +01:00
Alexey Milovidov	9367dcc276	Merge pull request #56975 from rschu1ze/unflake-test_backward_compat ... Add exclude for tryBase64Decode to backward compat test (follow-up to #56913)	2023-11-19 16:41:42 +01:00
Robert Schulze	a3c9f13ac9	Add exclude for tryBase64Decode to backward compat test (follow-up to #56913) ... Fixes #56969	2023-11-19 15:33:58 +00:00
Antonio Andelic	ab234a87a8	Merge pull request #56960 from ClickHouse/fix-test_keeper_auth ... Fix `test_keeper_auth`	2023-11-19 16:09:04 +01:00
Sema Checherinda	a950595c24	Merge pull request #56314 from CheSema/s3-aggressive-timeouts ... s3 adaptive timeouts	2023-11-19 14:12:14 +01:00
serxa	9023f61349	Merge branch 'master' into async-loader-integration	2023-11-19 13:05:58 +00:00
Antonio Andelic	7c81d9b2b7	Fix test_keeper_auth	2023-11-18 19:38:33 +00:00
Antonio Andelic	274f2c71f2	Merge pull request #56460 from ClickHouse/keeper-map-backup-restore ... Backup/Restore for KeeperMap tables	2023-11-18 19:27:36 +01:00
Antonio Andelic	9eaafff3d2	Merge pull request #56715 from incfly/keeper-az-fix ... Fix keeper availability zone configuration.	2023-11-18 19:24:24 +01:00
Alexey Milovidov	74319b5cbd	Merge pull request #56082 from Algunenano/less_diff_images ... See what happens if we use less different docker images in integration tests	2023-11-18 17:24:28 +01:00
Sema Checherinda	6d5a5f9fcd	buffer result if out copacity is not enough	2023-11-17 17:31:00 +01:00
Raúl Marín	4d5becb4de	Adapt test_storage_s3/test.py::test_predefined_connection_configuration	2023-11-17 15:01:54 +01:00
Raúl Marín	7074bdb3bb	Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default	2023-11-17 14:53:02 +01:00
Kruglov Pavel	4e6f265e3e	Fix tests	2023-11-17 14:36:48 +01:00
Alexey Milovidov	5f9db3b248	Merge pull request #56794 from ClickHouse/early-exit-interserver-authentication-failure ... Early disconnect if there is authentication failure with interserver secret	2023-11-17 13:36:09 +01:00
Antonio Andelic	803d9668e2	Merge branch 'master' into keeper-map-backup-restore	2023-11-17 10:11:59 +00:00
Antonio Andelic	f8794e72e7	Merge pull request #56858 from ClickHouse/better-test_keeper_broken_logs ... Fix `test_keeper_broken_logs`	2023-11-17 10:36:05 +01:00
Antonio Andelic	8b30a54b48	Merge pull request #56835 from ClickHouse/better-test_keeper_reconfig_replace_leader ... More stable `test_keeper_reconfig_replace_leader`	2023-11-17 10:35:26 +01:00
Aleksei Filatov	163b8a814e	Fix clang-tidy issues and disable parallel execution of tests	2023-11-17 11:02:07 +03:00
Jianfei Hu	ef79bf6467	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az-fix	2023-11-16 21:58:02 +00:00
Bharat Nallan Chakravarthy	7434dd9e0a	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-16 11:17:45 -08:00
Kseniia Sumarokova	2a1467b8da	Update test_storage_s3_queue/test.py	2023-11-16 19:33:17 +01:00
Alexey Milovidov	2941f30678	Merge branch 'master' of github.com:ClickHouse/ClickHouse into early-exit-interserver-authentication-failure	2023-11-16 18:15:09 +01:00
Kseniia Sumarokova	a2ed756eec	Merge branch 'master' into fs-cache-improvement	2023-11-16 17:49:26 +01:00
robot-clickhouse	d03a1aab7b	Automatic style fix	2023-11-16 16:39:57 +00:00
Igor Nikonov	34f8bf8da5	Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection	2023-11-16 16:27:25 +00:00
Igor Nikonov	49c58e7609	Disable RabbitMQ secure connection test in intergatiion test with TSAN	2023-11-16 16:24:09 +00:00
Konstantin Bogdanov	4cc2d6baa5	Merge pull request #56694 from ClickHouse/fix-configuration-merge-issue ... Fix configuration merge for nodes with substitution attributes	2023-11-16 15:19:09 +01:00
Antonio Andelic	bb68321fc1	More stable test_keeper_reconfig_replace_leader	2023-11-16 13:31:39 +00:00
Antonio Andelic	bdf038191a	better test_keeper_broken_logs	2023-11-16 13:08:48 +00:00
Igor Nikonov	b9d083e68d	Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection	2023-11-16 13:05:10 +00:00
Igor Nikonov	4d16c096a1	Use ports from cluster	2023-11-16 13:03:20 +00:00
alesapin	437a911d7b	Merge pull request #56809 from ClickHouse/add_async_moves_execution ... Implement asynchronous execute of `ALTER TABLE ... MOVE ... TO DISK|VOLUME`	2023-11-16 12:47:31 +01:00
Antonio Andelic	203f83c2c2	Merge branch 'master' into keeper-map-backup-restore	2023-11-16 11:31:11 +00:00
Sema Checherinda	7d37c0e070	Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml ... Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>	2023-11-16 12:29:21 +01:00
Sema Checherinda	ebd42187ad	Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml ... Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>	2023-11-16 12:29:15 +01:00
Vitaly Baranov	342e6c7546	Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup ... Add config setting "wait_dictionaries_load_at_startup"	2023-11-16 11:51:29 +01:00
Aleksei Filatov	21a17f8334	Add cancellation hook for moving background operation	2023-11-16 13:37:51 +03:00
Vitaly Baranov	946e02ecbc	Merge pull request #56268 from vitlibar/add-script-backup-view ... Add an external utility to view backups and to extract information from them	2023-11-16 11:17:16 +01:00
Robert Schulze	44bd0598a3	Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns ... Fix incorrect nullable columns reporting in MySQL binary protocol	2023-11-16 01:12:46 +01:00
Alexey Milovidov	3067ca64df	Merge pull request #56573 from mkmkme/mkmkme/reload-config ... Update `query_masking_rules` when reloading the config	2023-11-16 00:27:01 +01:00
Alexey Milovidov	09bec3c754	Fix integration test	2023-11-16 00:16:02 +01:00
Konstantin Bogdanov	67796b18bb	Add missing test config files	2023-11-15 19:36:23 +01:00
robot-clickhouse	af2f986215	Automatic style fix	2023-11-15 17:48:54 +00:00
avogar	808c3f36ed	Remove prints from test	2023-11-15 17:47:10 +00:00
avogar	28522d56b7	Support Iceberg metadata files for metastore tables	2023-11-15 17:45:07 +00:00
Alexander Sapin	3e26161eaa	Implement asynchronous excute of ALTER TABLE ... MOVE ... TO DISK|VOLUME	2023-11-15 18:33:59 +01:00
Vitaly Baranov	21a283049c	Add the test for clickhouse_backupview to CI.	2023-11-15 17:40:53 +01:00
Alexander Tokmakov	bf10989515	Fix unexpected parts handling (#56693) ... * fix unexpected parts handling * Automatic style fix * fix --------- Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>	2023-11-15 16:54:47 +01:00
slvrtrn	9e3ba55070	Fix incorrect nullable columns reporting in MySQL binary protocol	2023-11-15 16:53:38 +01:00
Mikhail Koviazin	08d0a160ae	test_reload_query_masking_rules: don't rely on num of events ... Due to the fact that integration tests are run in parallel and there might be no ClickHouse restart between several tests, relying on `system.events` in the test is fragile as it can be affected by previous tests. This commit removes any assumptions regarding `system.events` from the test and tries to keep it robust.	2023-11-15 17:48:24 +02:00
Antonio Andelic	c3f7c8792a	Merge pull request #56763 from ClickHouse/disable-compress-logs-default ... Disable compressed logs by default in Keeper	2023-11-15 16:17:14 +01:00
Antonio Andelic	d567e718eb	Merge branch 'master' into keeper-map-backup-restore	2023-11-15 11:51:27 +00:00
Vitaly Baranov	308654195c	Add config setting "wait_dictionaries_load_at_startup".	2023-11-15 11:48:50 +01:00
Antonio Andelic	5309dc05ef	Fix test	2023-11-15 07:42:19 +00:00
Alexey Milovidov	37e48e76fe	Merge pull request #56768 from vitlibar/fix-flaky-test_replicated_merge_tree_encryption_codec ... Fix flaky test_replicated_merge_tree_encryption_codec.	2023-11-15 07:46:06 +01:00
Vitaly Baranov	3d95ac5f2a	Fix flaky test_replicated_merge_tree_encryption_codec.	2023-11-14 21:53:23 +01:00
robot-clickhouse	369aaef92f	Automatic style fix	2023-11-14 20:26:32 +00:00
Igor Nikonov	cd909ffc48	Test RabbitMQ with secure connection	2023-11-14 20:13:09 +00:00
Jianfei Hu	9df2775f08	reduce timeout and setTimeout earlier. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-14 17:58:16 +00:00
Sema Checherinda	b9cc1580e0	Merge pull request #56367 from canhld94/ch_table_reinit_new_disk ... Adding new disk to storage configuration without restart	2023-11-14 15:54:22 +01:00
Antonio Andelic	2f9ac9b49c	Address comments	2023-11-14 14:33:34 +00:00
MikhailBurdukov	1aea8186c7	Enable s3 native copy for scenario: from s3 to s3.	2023-11-14 13:53:48 +00:00
robot-clickhouse	cc3dfafd7b	Automatic style fix	2023-11-14 13:07:45 +01:00
Konstantin Bogdanov	2fddc17642	Add test	2023-11-14 13:07:38 +01:00
Mikhail Koviazin	9e1357dd7e	Update query_masking_rules when reloading the config ... Fixes #56449	2023-11-14 14:03:28 +02:00
Sema Checherinda	3075bd9745	track clickhouse high level retries	2023-11-14 11:34:12 +01:00
Sema Checherinda	bb0b6afe14	reduce cuncurrent request number to the minio in test_storage_s3	2023-11-14 11:34:12 +01:00
Sema Checherinda	1a7be21a66	adjust tests	2023-11-14 11:34:12 +01:00
Sema Checherinda	338c51745f	fix style	2023-11-14 11:34:12 +01:00
Sema Checherinda	ab2594154e	add tests	2023-11-14 11:34:12 +01:00
Jianfei Hu	554d907189	Fix the keeper_server availability zone configuration. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-13 23:42:51 +00:00
Jianfei Hu	d3517140d9	Revert "Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."" ... This reverts commit e5aad4a6fd.	2023-11-13 19:03:27 +00:00
Bharat Nallan Chakravarthy	d90b8b6fba	Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables	2023-11-13 08:43:37 -08:00
robot-clickhouse	a9725f22e1	Automatic style fix	2023-11-13 12:38:02 +00:00
Antonio Andelic	59480205d4	Merge branch 'master' into keeper-map-backup-restore	2023-11-13 12:21:26 +00:00
Antonio Andelic	e3c66f8a63	Merge branch 'master' into more-reliable-log-handling-keeper	2023-11-13 12:14:57 +00:00
Antonio Andelic	99d521becf	More reliable log handling in Keeper	2023-11-13 12:09:13 +00:00
Alexey Milovidov	5099859ccd	Merge pull request #56656 from ClickHouse/delete-a-file-2 ... Delete a file (2)	2023-11-13 10:17:13 +01:00
Alexey Milovidov	3807dcc469	Delete a file (2)	2023-11-13 07:08:21 +01:00
Alexey Milovidov	f48527b53a	Merge branch 'concurrency' of github.com:ClickHouse/ClickHouse into concurrency	2023-11-13 02:57:14 +01:00
Alexey Milovidov	7ac931c29d	Merge branch 'master' into concurrency	2023-11-13 02:56:56 +01:00
Alexey Milovidov	812b8c2bc1	Fix test; delete strange file	2023-11-12 00:56:57 +01:00
Pradeep Chhetri	2ec76f2140	Fix test	2023-11-11 16:47:43 +08:00
Pradeep Chhetri	d0922782ed	Revert "Revert "Add 4-letter command for yielding/resigning leadership"" ... This reverts commit e1766b96d9.	2023-11-11 15:37:49 +08:00
Alexey Milovidov	e1766b96d9	Revert "Add 4-letter command for yielding/resigning leadership"	2023-11-11 05:45:02 +03:00
Alexey Milovidov	e5aad4a6fd	Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."	2023-11-11 05:43:58 +03:00
Alexey Milovidov	28c89ad1c8	Merge pull request #56544 from jmaicher/fix/flaky-ldap-integration-test ... Fix flaky LDAP integration tests	2023-11-10 17:00:54 +01:00
Alexey Milovidov	461b80a781	Merge pull request #56570 from ClickHouse/fix-keeper-test_cmd_crst ... Fix `test_keeper_four_word_command/test.py::test_cmd_crst`	2023-11-10 16:57:42 +01:00
Nikolay Degterinsky	a6ebeb8422	Merge pull request #56484 from evillique/fix-on-cluster ... Fix ON CLUSTER queries without database on initial node	2023-11-10 13:40:41 +01:00
Nikolay Degterinsky	07b2cdb614	Merge pull request #56491 from evillique/fix-alter-comment-on-cluster ... Fix ALTER COMMENT queries ON CLUSTER	2023-11-10 13:35:26 +01:00
vdimir	051efccf6c	Delete unnecessary file ... <!--- A technical comment, you are free to remove or leave it as it is when PR is created The following categories are used in the next scripts, update them accordingly utils/changelog/changelog.py tests/ci/cancel_and_rerun_workflow_lambda/app.py --> ### Changelog category (leave one): - Not for changelog (changelog entry is not required)	2023-11-10 11:31:05 +01:00
Kseniia Sumarokova	e48df94772	Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue ... Minor improvements for S3Queue	2023-11-10 11:28:09 +01:00
Antonio Andelic	5364f4e9f8	Fix test	2023-11-10 09:59:43 +00:00
Julian Maicher	c3dc106980	Reformat with black	2023-11-10 04:28:21 +01:00
Julian Maicher	4e1965167e	Fix flaky LDAP integration tests ... Use LDAP hostname with regular DNS lookup to check if LDAP is online. Before that, we used the IP address that was extracted via the docker client (not via DNS lookup) and it could happen that LDAP was reachable via the IP, thus passing the online check, but not via DNS lookup, which led to test failures (e.g. LDAP not reachable from ClickHouse instance).	2023-11-09 21:24:52 +01:00
Mike Kot	785183bb3c	Keeper reconfig -- sleep before removing leader to avoid losing accepted ... but uncommitted commands	2023-11-09 16:22:44 +00:00
robot-clickhouse	188a88fa33	Automatic style fix	2023-11-09 16:15:14 +00:00
Antonio Andelic	f9895ab37b	Small fixes and add test	2023-11-09 15:56:57 +00:00
Kseniia Sumarokova	b05a66b9b5	Update test.py	2023-11-09 13:04:46 +01:00
Antonio Andelic	e9542e4153	Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol ... Support compression for keeper protocol	2023-11-09 10:00:19 +01:00
Nikolay Degterinsky	96f558f51a	Fix ALTER COMMENT queries ON CLUSTER	2023-11-09 06:19:00 +00:00
Nikolay Degterinsky	cc0d447c52	Fix ON CLUSTER queries without local database	2023-11-08 23:30:35 +00:00
Alexander Tokmakov	32567e16e7	Merge pull request #56429 from ClickHouse/tavplubix-patch-9 ... Fix `test_attach_without_fetching`	2023-11-08 14:37:15 +01:00
robot-clickhouse	c064488bbf	Automatic style fix	2023-11-08 11:48:09 +00:00
kssenii	dfcc94fff0	Fix test	2023-11-08 12:29:40 +01:00
kssenii	dbea50738b	Merge remote-tracking branch 'origin/master' into fs-cache-improvement	2023-11-08 11:53:54 +01:00
Sema Checherinda	2ffd51fb36	Merge pull request #56421 from CheSema/move-to-server-settings ... move storage_metadata_write_full_object_key setting to the server scope	2023-11-08 11:06:39 +01:00
Antonio Andelic	788c66027c	Merge pull request #56104 from incfly/keeper-az ... Add /keeper/availability-zone node to allow server load balancing within AZ.	2023-11-08 09:46:24 +01:00
Alexander Tokmakov	fc1bd0efd5	Update test.py	2023-11-07 19:44:16 +01:00
Sema Checherinda	8216a24abe	move storage_metadata_write_full_object_key setting to the server scope	2023-11-07 17:14:46 +01:00
Kseniia Sumarokova	cc3144ea2d	Merge pull request #56370 from ClickHouse/kssenii-patch-6 ... Update test_storage_s3_queue/test.py	2023-11-07 16:29:34 +01:00
Kseniia Sumarokova	d436414ec6	Merge pull request #56376 from ClickHouse/disable-s3-queue-test-for-ordered-mode ... Update test_storage_s3_queue	2023-11-07 16:27:52 +01:00
serxa	19aa1375fc	Merge branch 'master' into async-loader-integration	2023-11-07 10:25:38 +00:00
Pradeep Chhetri	361472b29e	Add 4-letter command for yielding/resigning leadership	2023-11-07 13:58:45 +08:00
Jianfei Hu	033bb19198	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az	2023-11-07 02:50:54 +00:00
Jianfei Hu	b552bf6928	fix the test node count. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-07 02:50:46 +00:00
Alexander Tokmakov	cf6ab2e110	Merge pull request #56282 from ClickHouse/fix_unexpected_parts_after_truncate ... Fix unexpected parts after drop range	2023-11-06 21:03:57 +01:00
Sema Checherinda	a5e17dc919	Merge pull request #55566 from CheSema/remote-blobs-naming ... feature: storage_metadata_write_full_object_key	2023-11-06 16:41:49 +01:00
robot-clickhouse	d55a0bd686	Automatic style fix	2023-11-06 15:04:45 +00:00
kssenii	f2c0434c4d	Merge remote-tracking branch 'origin/master' into minor-improvements-for-s3-queue	2023-11-06 15:51:11 +01:00
kssenii	8db2aca832	Add a test	2023-11-06 15:48:04 +01:00
kssenii	3ecce143fc	Restrict modes for the test	2023-11-06 14:44:24 +01:00
Kseniia Sumarokova	036922e3b4	Update test.py	2023-11-06 12:21:13 +01:00
Sema Checherinda	cf07fd79fc	remove unstable test	2023-11-06 12:00:23 +01:00
Duc Canh Le	4c21ba7b6f	tables auto initialize new disks without restart ... Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>	2023-11-06 10:26:48 +00:00
Alexander Tokmakov	155bdfcf0d	fix	2023-11-04 22:50:19 +01:00
Arthur Passos	b6e205dcdf	Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033) ... * initial commit. integ tests passing, need to re-run unit & my own personal tests * partial refactoring to remove Protocol::ANY * improve naming * remove all usages of ProxyConfiguration::Protocol::ANY * fix ut * blabla * support url functions as well * support for HTTPS requests over HTTP proxy with tunneling off * remove gtestabc * fix silly mistake * ... * remove usages of httpclientsession::proxyconfig in src/ * got you * remove stale comment * it seems like I need reasonable defaults * fix ut * add some comments * remove no longer needed header * matrix out * add https over http proxy with no tunneling * soem docs * partial refactoring * rename to use_tunneling_for_https_requests_over_http_proxy * improve docs * use shorter version * remove useless test * rename the setting * update * fix typo * fix setting docs typo * move ); up * move ) up	2023-11-04 13:47:52 -04:00
robot-clickhouse	6ad8e789f6	Automatic style fix	2023-11-04 14:56:15 +00:00
Alexander Tokmakov	9acd3707cb	fix tests	2023-11-04 15:44:55 +01:00
Jianfei Hu	b426cfe462	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-03 16:42:29 +00:00
Kruglov Pavel	6345d94d2b	Fix test	2023-11-03 16:27:04 +00:00
vdimir	a70d0c5203	Merge pull request #56264 from azat/rocksdb/block-based-table-options ... Add ability to specify BlockBasedTableOptions for rocksdb	2023-11-03 10:15:19 +01:00
vdimir	55a1baf029	Merge pull request #56022 from ClickHouse/vdimir/check_all_tables ... Add CHECK query for all the tables	2023-11-03 10:10:42 +01:00
Jianfei Hu	136efba321	integration test working and std::exception_ptr. ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-03 02:24:42 +00:00
Alexander Tokmakov	e88fa10aa2	Merge pull request #56142 from ClickHouse/make_replicated_start_more_robust ... Better process broken parts on table start for replicated tables	2023-11-02 20:11:22 +01:00
Jianfei Hu	06ff714e2e	add configuration option and integration test(wip). ... Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>	2023-11-02 16:21:24 +00:00
Alexander Tokmakov	76e6b75ae2	Merge pull request #56214 from ClickHouse/hide-setup-plan ... Improve integrations tests	2023-11-02 16:59:40 +01:00
avogar	940449dd59	Try to fix azure test	2023-11-02 15:09:53 +00:00
serxa	e97edf5285	Merge branch 'master' into async-loader-integration	2023-11-02 14:56:32 +00:00
Azat Khuzhin	decf85baca	Add ability to specify BlockBasedTableOptions for rocksdb ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-02 15:36:00 +01:00
Sema Checherinda	90b64bcdb9	backward compatibility and implementation feature storage_metadata_write_full_object_key	2023-11-02 15:20:55 +01:00
Raúl Marín	39163b4e31	Merge pull request #56175 from amosbird/fix-flaky-jbod-balancer ... Fix flaky test of jbod balancer.	2023-11-02 13:19:21 +01:00
Mikhail f. Shiryaev	28463cdcd3	Do not print --setup-plan to integration tests logs	2023-11-02 08:50:03 +01:00
Alexander Sapin	abc1dfc203	Fix test	2023-11-01 20:38:09 +01:00
Amos Bird	aea0c8dddc	Add wait_until_fully_merged.	2023-11-02 01:50:09 +08:00
robot-clickhouse	2a24d15204	Automatic style fix	2023-11-01 16:06:24 +00:00
Alexander Sapin	bfcd8b7de5	Better logging and tests	2023-11-01 16:50:02 +01:00
Azat Khuzhin	c25d6cd624	Rename directory monitor concept into background INSERT (#55978) ... * Limit log frequence for "Skipping send data over distributed table" message After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this message. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> * Rename directory monitor concept into async INSERT Rename the following query settings (with preserving backward compatiblity, by keeping old name as an alias): - distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms - distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms - distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts - distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure Rename the following table settings (with preserving backward compatiblity, by keeping old name as an alias): - monitor_batch_inserts -> async_insert_batch - monitor_split_batch_on_failure -> async_insert_split_batch_on_failure - directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms - directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms And also update all the references: $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> * Rename async_insert for Distributed into background_insert This will avoid amigibuity between general async INSERT's and INSERT into Distributed, which are indeed background, so new term express it even better. Mostly done with: $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g' Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> * Mark 02417_opentelemetry_insert_on_distributed_table as long CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> --------- Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-11-01 15:09:39 +01:00
Kruglov Pavel	5533258091	Merge pull request #55477 from Avogar/streaming-errors ... Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines	2023-11-01 14:35:35 +01:00
Kseniia Sumarokova	e5efc42633	Merge branch 'master' into fs-cache-improvement	2023-11-01 10:47:36 +01:00
Raúl Marín	f2f84fe6b7	Adapt version changes	2023-10-31 18:24:33 +01:00
Raúl Marín	957671bf74	Adapt to work with releases without DROP SYNC	2023-10-31 18:06:28 +01:00
Raúl Marín	52a3d37ebe	Try reducing number of different images	2023-10-31 17:20:07 +01:00
Amos Bird	c75cd615c3	Fix flaky test of jbod balancer.	2023-10-31 23:03:55 +08:00
Kseniia Sumarokova	b57906609c	Merge pull request #56011 from kssenii/fix-flaky-s3-queue-test ... test_storage_s3_queue - add debug info	2023-10-31 11:25:02 +01:00
Smita Kulkarni	3fdf0daf1b	Merge branch 'master' into 49507_Support_compression_for_keeper_protocol	2023-10-31 10:43:28 +01:00
Kruglov Pavel	50c53fdbfd	Increase number of attempts in test	2023-10-30 20:51:03 +01:00
avogar	7eefb72c53	Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union	2023-10-30 19:44:26 +00:00
avogar	7689961a8f	Try to fix test with azuer	2023-10-30 19:44:02 +00:00
Raúl Marín	19c2ad5c9b	Merge pull request #56116 from azat/tests/fix-test_format_schema_on_server ... Fix test_format_schema_on_server flakiness	2023-10-30 12:02:14 +01:00
Kseniia Sumarokova	41e2111534	Merge branch 'master' into fix-flaky-s3-queue-test	2023-10-30 11:24:12 +01:00
Azat Khuzhin	b87ebb2a83	Fix test_format_schema_on_server flakiness ... Sometimes the requests library detect the encoding incorrectly, and because this test compares binary data it fails. Here is an example of successfull attempt: 2023-10-30 07:32:37 [ 654 ] DEBUG : http://172.16.1.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27simple%3AKeyValuePair%27 HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: utf_8 will be used as a fallback match (api.py:480, from_bytes) 2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: Found utf_8 as plausible (best-candidate) for content. With 0 alternatives. (api.py:487, from_bytes) And here is failed [1]: 2023-10-29 18:12:56 [ 525 ] DEBUG : http://172.16.9.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27message_tmp%3AMessageTmp%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2023-10-29 18:12:56 [ 525 ] DEBUG : Encoding detection: Found utf_16_be as plausible (best-candidate) for content. With 1 alternatives. (api.py:487, from_bytes) E AssertionError: assert '܈Ē͡扣܈Ȓͤ敦' == '\x07\x08\x01\x12\x03abc\x07\x08\x02\x12\x03def' E -  abcdef E + ܈Ē͡扣܈Ȓͤ敦 [1]: https://s3.amazonaws.com/clickhouse-test-reports/56030/c7f392500e93863638c9ca9bd56c93b3193091f3/integration_tests__release__[3_4].html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-10-30 08:45:47 +01:00
Han Fei	19cdc6dfe2	Merge branch 'master' into hanfei/statistic	2023-10-30 04:53:18 +01:00
Azat Khuzhin	c7f392500e	Fix incorrect free space accounting for least_used JBOD policy ... Before least_used fails to detect when the disk started to have more space, it works only when the disk starts to have less space. The reason for this is that it uses priority_queue, and once the disk goes at the bottom of the queue, free space will not be updated for it until it will be selected again. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-10-29 17:36:31 +01:00
Alexey Milovidov	243499aad1	Merge pull request #55796 from ClickHouse/Fix_azurite_port ... Fix azurite port issue	2023-10-28 00:40:24 +02:00
Bharat Nallan Chakravarthy	ebd03fbd77	add a test	2023-10-27 11:02:51 -07:00
vdimir	60c93cefbe	Add test for CHECK ALL TABLES	2023-10-27 15:22:11 +00:00
Smita Kulkarni	960927a323	Updated name to use_compression	2023-10-27 14:53:54 +02:00
Kseniia Sumarokova	8984ba9c7e	Merge branch 'master' into fix-flaky-s3-queue-test	2023-10-27 14:14:24 +02:00
Sergei Trifonov	a5d7c2b6a2	Merge branch 'master' into async-loader-integration	2023-10-27 10:39:12 +02:00
Kruglov Pavel	570b66f027	Merge branch 'master' into schema-inference-union	2023-10-26 19:26:00 +02:00
Konstantin Bogdanov	ecafc77e0f	Merge pull request #55521 from ClickHouse/fix-query-params-with-custom-http-handlers ... Fix Query Parameters not working with custom HTTP handlers	2023-10-26 18:34:37 +02:00
kssenii	5d700605a5	Merge remote-tracking branch 'upstream/master' into fix-flaky-s3-queue-test	2023-10-26 17:18:26 +02:00
Smita Kulkarni	d1d8f4b2e1	Merge branch 'master' into 49507_Support_compression_for_keeper_protocol	2023-10-26 16:56:03 +02:00
Alexander Tokmakov	fa963d60d0	Merge pull request #55641 from evillique/resubmit-cluster-groups ... Resubmit #54421	2023-10-26 15:53:53 +02:00
helifu	4015176d27	A small fix (#55938)	2023-10-26 13:19:58 +02:00
robot-clickhouse	c4d498f961	Automatic style fix	2023-10-26 09:57:22 +00:00