5094 Commits

Author	SHA1	Message	Date
Nikolai Kochetov	5c4444237e	Merge pull request #42617 from ClickHouse/revert-revert-41268-disable-s3-parallel-write-for-part-moves-to-disk-s3 ... Revert revert 41268 disable s3 parallel write for part moves to disk s3	2022-10-25 14:29:27 +02:00
Nikita Taranov	49f6692a2e	Adapt internal data structures to 512-bit era (#42564) ... * impl * update tests * fix tests	2022-10-25 13:56:28 +02:00
Raúl Marín	0016bc2b73	Improve the time to recover keeper connections (#42541) ... Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com> Co-authored-by: robot-clickhouse <robot-clickhouse@clickhouse.com> Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>	2022-10-25 13:26:29 +02:00
Alexey Milovidov	9ee7131f67	Merge pull request #42423 from ClickHouse/optimize-partitions-in-background ... Optimize partitions in background	2022-10-24 19:41:50 +02:00
Nikolai Kochetov	beb40e4579	Split tests.	2022-10-24 14:22:06 +00:00
Vitaly Baranov	cd158b021f	Merge pull request #42562 from vitlibar/subqueries-in-row-policy-filters ... Fix using subqueries in row policy filters	2022-10-24 13:38:15 +02:00
Azat Khuzhin	dbb4f8216f	Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32 ... Conflicts: - src/Functions/GregorianDate.h	2022-10-22 08:20:05 +02:00
Nikolay Degterinsky	22f87e2bf9	Merge pull request #42549 from evillique/disks-better-logs ... Better logs in clickhouse-disks	2022-10-22 04:31:44 +02:00
Azat Khuzhin	4eeb7337ed	Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32 ... Conflicts: - src/Common/intExp.h - src/Functions/DateTimeTransforms.h - src/Functions/FunctionsConversion.h	2022-10-21 22:51:56 +02:00
Vitaly Baranov	2033ea1216	Support subqueries in row policy filters.	2022-10-21 15:42:29 +02:00
Alexander Tokmakov	5ffd026261	Merge pull request #42529 from azat/tests/integration/fix-sanitizer-reports ... Fix sanitizer reports in integration tests	2022-10-21 16:01:43 +03:00
Alexander Tokmakov	1343f62e8f	Update test.py	2022-10-21 15:59:27 +03:00
Azat Khuzhin	0365bc56aa	Add backward compatiblity check for some functions ... * State of aggregate functions This test goes though all aggregate functions that: - has only one argument - support string as an argument And do a simple check by creating the aggregate state with one string. Yes this is not covers everything (does not cover functions with different number of arguments, types, different states in case of multiple values - uniqCombined, but as for uniqCombined it will be checked via uniqHLL12), but at least something. And about type, String had been selected, since it more likely that there will be used some hash function internally. * Function(String) Check every function which has only one argument, and it's type is String. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-10-21 13:25:43 +02:00
Antonio Andelic	3091d609fa	Merge branch 'master' into optimize-partitions-in-background	2022-10-21 11:01:41 +02:00
Nikolay Degterinsky	d7d0794d2f	Better logs in clickhouse-disks	2022-10-20 23:17:29 +00:00
Nikolai Kochetov	57ffcb7ed0	Revert "Merge pull request #41681 from ClickHouse/revert-41268-disable-s3-parallel-write-for-part-moves-to-disk-s3" ... This reverts commit 7956c2becf, reversing changes made to 57be648984.	2022-10-20 19:51:27 +02:00
Alexander Tokmakov	905a4ded42	Merge pull request #42535 from ClickHouse/tavplubix-patch-7 ... Disable `test_storage_nats`, because it's permanently broken	2022-10-20 16:58:46 +03:00
Alexander Tokmakov	5b03bbce2e	Merge pull request #41981 from ClickHouse/fixes_for_replicated_merge_tree2 ... Some fixes for ReplicatedMergeTree	2022-10-20 16:57:51 +03:00
Alexander Tokmakov	89ff3d4731	Update test.py	2022-10-20 16:54:52 +03:00
Azat Khuzhin	c399b021cf	Fix sanitizer reports in integration tests ... Before they was ignored because first there was a check for a sign of sanitizer (==================), but it was done by clickhouse-server.log, while sanitizer write to stderr.log. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-10-20 15:45:40 +02:00
Antonio Andelic	9d7e44409a	Merge pull request #41342 from ClickHouse/keeper-upload-snapshot-to-s3 ... Upload Keeper snapshots to S3	2022-10-20 09:14:59 +02:00
Antonio Andelic	77eb353839	Merge pull request #42243 from ClickHouse/use-multiread-more ... Use MultiRead where possible	2022-10-20 09:04:54 +02:00
Alexander Tokmakov	f958c155f3	Merge branch 'master' into fixes_for_replicated_merge_tree2	2022-10-19 17:25:24 +03:00
Antonio Andelic	05e6b94b54	Polishing	2022-10-19 12:59:28 +00:00
Antonio Andelic	e5408aac99	Simplify logic	2022-10-19 12:34:20 +00:00
Vitaly Baranov	1365105bc4	Implement backup to S3	2022-10-19 00:04:41 +02:00
Alexander Tokmakov	ea77ff9022	Merge branch 'master' into fixes_for_replicated_merge_tree2	2022-10-18 17:25:25 +02:00
Antonio Andelic	e828dce331	Disable auto optimize by default	2022-10-18 12:11:23 +00:00
Antonio Andelic	bd2522fdd0	Merge branch 'master' into optimize-partitions-in-background	2022-10-18 09:13:59 +00:00
Antonio Andelic	ee2f5977d5	Merge branch 'master' into keeper-upload-snapshot-to-s3	2022-10-18 10:02:50 +02:00
Vitaly Baranov	eb637a6f81	Merge pull request #42232 from azat/backups/s3 ... Support BACKUP to S3 with as-is path/data structure	2022-10-18 02:37:07 +02:00
Yakov Olkhovskiy	3ce1fa09d6	Merge pull request #41198 from ClickHouse/composable-protocol ... Composable protocol	2022-10-17 11:23:12 -04:00
Antonio Andelic	7c7395575f	Merge branch 'master' into keeper-upload-snapshot-to-s3	2022-10-17 11:02:36 +00:00
Antonio Andelic	878dee40b1	Use ZooKeeper in a single test	2022-10-17 07:36:49 +00:00
Azat Khuzhin	8830f0608d	Support BACKUP to S3 with as-is path/data structure ... Right now backup to S3 does not make a lot of sense, since: - it has random names, and to decoding them - requires metadata from local disk (/var/lib/disks/DISK/BACKUP_NAME) - or send_metadata (but it is also tricky even with it) So this patch adds simpler interface for S3, it is only suitable for BACKUP/RESTORE, so don't try to use it for MergeTree engine. It is done by adding separate disk - `s3_plain` for this, that: - does not support any extended features, like renames/hardlinks/attrs/... (so basically everything that MergeTree requires) - only write/read/unlink/list files Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-10-14 12:59:25 +02:00
nvartolomei	ea47ab1400	assert unused value in test_replicated_merge_tree_compatibility	2022-10-12 18:12:25 +01:00
Yakov Olkhovskiy	6c8e52eb67	Merge branch 'master' into composable-protocol	2022-10-08 20:33:32 -04:00
robot-clickhouse	3bed015a1f	Automatic style fix	2022-10-08 00:09:24 +00:00
Yakov Olkhovskiy	6bb62d4d03	add test for PROXYv1	2022-10-08 00:01:58 +00:00
Vitaly Baranov	69ebf12dab	Merge pull request #42146 from azat/backups/metadata-overflow-fix ... Fix reusing of files > 4GB from base backup	2022-10-08 00:22:28 +02:00
Alexander Tokmakov	b8d9066004	Revert "Resurrect parallel distributed insert select with s3Cluster (#41535)" ... This reverts commit 860e34e760.	2022-10-07 15:53:30 +02:00
Azat Khuzhin	94566abda9	Fix reusing of files > 4GB from base backup ... Previosly u64 numbers was truncated to u32 numbers during writing to the mdatadata xml file, and further incremental backup cannot reuse them, since the file in base backup is smaller. P.S. There can be other places, I thought about enabling -Wshorten-64-to-32, but there are lots of warnings right now. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-10-07 14:56:09 +02:00
Yakov Olkhovskiy	2229087896	Merge branch 'master' into composable-protocol	2022-10-07 02:23:26 -04:00
Yakov Olkhovskiy	997fa5e295	review suggestions	2022-10-07 01:16:22 +00:00
Nikita Mikhaylov	860e34e760	Resurrect parallel distributed insert select with s3Cluster (#41535)	2022-10-06 13:47:32 +02:00
Nikita Mikhaylov	766107df0a	Fixed the restriction on maximum size of replicated fetches (#42090)	2022-10-06 13:18:46 +02:00
Kseniia Sumarokova	316824c02a	Merge pull request #42085 from elenatorro/use_send_metadata_setting_on_storage_config ... Use send_metadata instead of send_object_metadata	2022-10-06 12:33:25 +02:00
Kseniia Sumarokova	3cff776109	Merge pull request #41254 from filimonov/system_disks_unreserved_space ... Add unreserved_space column to system.disks	2022-10-06 12:28:23 +02:00
Elena	3914b8afda	Remove 'send_metadata' setting	2022-10-05 14:54:08 +02:00
Elena	5bbd2d1729	Use send_metadata instead of send_object_metadata	2022-10-05 13:43:59 +02:00