419 Commits

Author	SHA1	Message	Date
roverxu	8e72b6d31b	Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts	2020-12-21 09:25:54 +08:00
Nikita Mikhailov	6a55e018e4	Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format	2020-12-18 02:25:32 +03:00
Alexey Milovidov	b25f126569	Added a test	2020-12-17 04:52:27 +03:00
Alexey Milovidov	9a017b77df	Merge branch 'master' into relax-too-many-parts-1	2020-12-17 04:40:39 +03:00
roverxu	1065ddef65	fix bug when drop data	2020-12-16 22:02:34 +08:00
Nikita Mikhaylov	5a47928431	save	2020-12-15 00:56:47 +03:00
Nikita Mikhaylov	f40f3ced2a	fix JSONEachRowArray	2020-12-15 00:56:46 +03:00
Nikita Mikhaylov	e0addac6fc	save changes	2020-12-15 00:56:46 +03:00
alesapin	0eec52b1fd	Merge pull request #17737 from ClickHouse/fix_segfault_in_distributed_out_stream ... Fix segfault when 'not enough space'	2020-12-05 16:14:30 +03:00
detailyang	e7a151fd1e	hotfix:check in_memory_parts_enable_wal	2020-12-04 23:14:27 +08:00
roverxu	2a6c1463a1	Add metrics for part number in MergeTree	2020-12-04 11:42:58 +08:00
Alexander Tokmakov	bfbf150c67	fix segfault when 'not enough space'	2020-12-02 17:49:43 +03:00
Alexey Milovidov	2e6bedce91	Relax "Too many parts" threshold, part 1	2020-11-29 18:08:02 +03:00
feng lv	7e3524caa1	fix spelling errors	2020-11-28 08:17:20 +00:00
tavplubix	5cc9cb01cd	Merge pull request #16751 from amosbird/globalcontext ... Make global_context consistent.	2020-11-22 18:46:17 +03:00
Amos Bird	1d9d586e20	Make global_context consistent.	2020-11-20 18:23:14 +08:00
Nicolae Vartolomei	746f8e45f5	All new parts must have uuids	2020-11-19 13:18:03 +00:00
Anton Popov	de5ead0c40	add setting remove_empty_parts	2020-11-15 05:24:47 +03:00
alexey-milovidov	915d96fee0	Merge pull request #16955 from nikitamikhaylov/fix-typos ... Fix typos	2020-11-14 17:17:37 +03:00
Nikolai Kochetov	ed98b48845	Merge pull request #16618 from ClickHouse/actions-dag-f14 ... Actions dag 2	2020-11-13 18:34:51 +03:00
nikitamikhaylov	c0940f2ebd	done	2020-11-13 02:27:18 +03:00
Anton Popov	4cecd89e84	fix dropping of empty parts	2020-11-12 20:37:54 +03:00
Anton Popov	0aa35d53c7	Merge remote-tracking branch 'upstream/master' into HEAD	2020-11-12 14:31:58 +03:00
alesapin	2cac5e5d97	Merge pull request #16875 from CurtizJ/refactor-alter-partition ... Avoid code duplication in alterPartition	2020-11-12 13:19:59 +03:00
Nikolai Kochetov	46f70dd0de	Merge branch 'master' into actions-dag-f14	2020-11-12 11:54:44 +03:00
tavplubix	058aa8f85e	Merge pull request #16824 from ClickHouse/replace_stringstreams_with_buffers ... Replace std::*stringstreams with DB::*Buffers	2020-11-12 01:11:44 +03:00
Anton Popov	2497598a49	Remove empty parts after they were pruned by TTL	2020-11-11 19:19:43 +03:00
Anton Popov	6f0dc08ba7	avoid code duplication in alterPartition	2020-11-11 16:34:07 +03:00
Nikolai Kochetov	1846bb3cac	Merge branch 'master' into actions-dag-f14	2020-11-11 13:08:57 +03:00
Nikolai Kochetov	c6575c9032	Update ExpressionActions constructur	2020-11-10 19:27:55 +03:00
Nikolai Kochetov	1db8e77371	Add comments. Update ActionsDAG::Index	2020-11-10 17:54:59 +03:00
Alexander Tokmakov	5cdfcfb307	remove other stringstreams	2020-11-09 22:12:44 +03:00
Nikolai Kochetov	6717c7a0af	Merge branch 'master' into actions-dag-f14	2020-11-09 14:57:48 +03:00
alesapin	72046313d4	Merge branch 'master' into nvartolomei-drop-part	2020-11-09 10:02:02 +03:00
Alexey Milovidov	fd84d16387	Fix "server failed to start" error	2020-11-07 03:14:53 +03:00
Nikolai Kochetov	9aeb757da4	Merge branch 'master' into actions-dag-f14	2020-11-06 15:04:20 +03:00
alesapin	faca9d9b91	Check max bytes on disk	2020-11-03 18:41:46 +03:00
Nikolai Kochetov	07a7c46b89	Refactor ExpressionActions [Part 3]	2020-11-03 14:28:28 +03:00
alesapin	dac6705995	DROP PART and clear blocks in a single zookeeper op	2020-11-02 20:30:59 +03:00
alesapin	39e47c5338	Less strange lambdas	2020-10-23 11:54:00 +03:00
alesapin	7a63b373f9	Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more	2020-10-22 15:47:11 +03:00
Vladimir Chebotarev	aa5f207fd4	Added disable_merges option for volumes in multi-disk configuration (#13956) ... Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>	2020-10-20 18:10:24 +03:00
alesapin	7edbe4d276	Add some comments	2020-10-16 13:12:31 +03:00
alesapin	4014e0f08d	Something very similar to working code	2020-10-14 15:32:35 +03:00
alesapin	efd3126b5d	Moving pool	2020-10-14 10:22:48 +03:00
nikitamikhaylov	88a5302759	Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-backquotes	2020-10-09 16:26:31 +03:00
alesapin	8ec58c17f3	More consistent metadata usage	2020-10-05 19:41:46 +03:00
alesapin	8bc9ede711	Fix clang tidy	2020-10-01 09:53:47 +03:00
alesapin	97c2579fb9	Use separate function	2020-09-30 22:50:23 +03:00
alesapin	ac9f0ff4da	More strict check for version column	2020-09-30 22:44:35 +03:00
alesapin	65a05a970d	Better message on error	2020-09-29 15:07:01 +03:00
Nikita Mikhaylov	a4832ed5ce	Merge branch 'master' into HyaZz-master	2020-09-28 13:55:45 +03:00
alexey-milovidov	1fcebce926	Merge pull request #15000 from Jokser/disable-ttl-move-on-insert ... Option to disable TTL move on data part insert	2020-09-19 13:45:02 +03:00
Pavel Kovalenko	6b4b5898a7	Renaming.	2020-09-18 18:41:14 +03:00
Pavel Kovalenko	0da19ab46d	Add option to disable ttl move on data part insert	2020-09-18 18:30:00 +03:00
alesapin	b07c00ef7c	Ugly, but probably working implementation	2020-09-17 18:33:50 +03:00
Alexey Milovidov	c1e9ce2cf2	Remove questionable code	2020-09-17 17:38:06 +03:00
alesapin	6c369c8dc6	Fix merge error	2020-09-17 15:01:03 +03:00
alesapin	40b2f203b6	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-09-17 13:21:00 +03:00
Anton Popov	af4089c606	Merge remote-tracking branch 'upstream/master' into HEAD	2020-09-11 00:39:21 +03:00
alesapin	485b104898	Use max ttl and add introspection to system parts about recompression	2020-09-09 12:15:42 +03:00
alesapin	f274ffc9d1	Add comments	2020-09-07 10:59:14 +03:00
alesapin	fecb2f1311	Less copypaste	2020-09-04 17:08:43 +03:00
alesapin	4079636f81	Merge	2020-09-04 13:52:51 +03:00
alesapin	82c56349a5	Some comments	2020-09-04 13:08:09 +03:00
alesapin	dcbddbb8d0	Add recompression ttls tests and fix bugs	2020-09-02 19:15:41 +03:00
alesapin	128cb7ce22	Don't select already selected parts	2020-09-02 15:16:12 +03:00
alesapin	aac466ab1c	Merge branch 'better_ttl_merges_selection' into recompression_in_background	2020-09-02 13:30:04 +03:00
Anton Popov	4fe57fc169	Merge remote-tracking branch 'upstream/master' into HEAD	2020-09-02 01:29:44 +03:00
alesapin	f0dc5a3085	First working test	2020-09-01 13:49:53 +03:00
Anton Popov	25140b9bd5	fsync MergeTree format file	2020-09-01 04:39:36 +03:00
alesapin	46f833b7df	Some changes	2020-08-31 22:50:42 +03:00
alesapin	ebc163c924	Merge branch 'master' into parts_default_compression	2020-08-28 23:11:42 +03:00
alesapin	0896b49533	Small fixes	2020-08-28 13:18:56 +03:00
alesapin	77faf9587f	Better interface	2020-08-28 12:07:20 +03:00
Alexey Milovidov	5763737d97	Fixups	2020-08-28 03:53:22 +03:00
Amos Bird	078b14610d	ALTER MODIFY SAMPLE BY	2020-08-27 22:31:30 +08:00
alesapin	886a7b485e	Fixed codec in clone part	2020-08-27 09:49:41 +03:00
alesapin	2fc80189af	Add default compression codec to merge tree data part	2020-08-26 18:29:46 +03:00
alexey-milovidov	7b53a0ef33	Revert "Added allow_merges option for volumes in multi-disk configuration (#13402)" ... This reverts commit 1e2616542a.	2020-08-21 18:44:29 +03:00
Vladimir Chebotarev	1e2616542a	Added allow_merges option for volumes in multi-disk configuration (#13402)	2020-08-21 12:04:13 +03:00
Alexey Milovidov	5059d1f441	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-08-16 15:58:57 +03:00
Alexey Milovidov	9e6d4802ac	Do not drop cache if DROP/RENAME in Atomic database	2020-08-15 09:56:47 +03:00
Amos Bird	de4a070d6a	log error message	2020-08-14 09:54:51 +08:00
Amos Bird	3b92692458	Make drop table a little bit more robust	2020-08-13 22:22:04 +08:00
Alexey Milovidov	edd89a8610	Fix half of typos	2020-08-08 03:47:03 +03:00
Alexey Milovidov	77516b48fa	Merge branch 'master' into merge-tree-settings-sanity-check	2020-08-03 00:30:56 +03:00
alesapin	75a9053511	Merge pull request #13150 from nvartolomei/nv/freeze-verbose-absolute-path ... Use absolute paths to backup locations (shadow)	2020-08-02 19:25:24 +03:00
Alexey Milovidov	778abb346f	Merge branch 'master' into merge-tree-settings-sanity-check	2020-08-02 17:13:17 +03:00
Vitaly Baranov	56665a15f7	Rework and rename the template class SettingsCollection => BaseSettings.	2020-07-31 20:54:18 +03:00
Vitaly Baranov	90602b869a	Make SettingsChanges a class.	2020-07-31 19:11:27 +03:00
Alexey Milovidov	2c40539df6	Check ALTERs; update test	2020-07-31 00:42:55 +03:00
Alexey Milovidov	b9f49d31df	Sanity checks for MergeTreeSettings	2020-07-30 22:08:13 +03:00
Nicolae Vartolomei	85174d64a0	Use absolute paths to backup locations (shadow) ... Tests are frankenstain. Had to hide absolute path `/tmp/clickhouse.test..IP69I/data/shadow/test_01417_single_part_7/data/default/table_for_freeze/7_8_8_0` to make them deterministic and independend of the method they are run (local vs remote target)	2020-07-30 18:03:26 +01:00
alesapin	7a806eb90f	Merge pull request #13017 from ClickHouse/freeze_partition_with_name ... Alter table freeze with verbose output	2020-07-29 18:42:48 +03:00
alesapin	c75830e878	Alter table freeze with verbose output	2020-07-28 18:10:36 +03:00
alesapin	1bece3de0a	Remove strange code and test	2020-07-28 12:36:08 +03:00
Artem Zuikov	2afd123eda	Refactoring: extract TreeOptimizer from SyntaxAnalyzer (#12645)	2020-07-22 20:13:05 +03:00
alesapin	be106b662e	Comment and style	2020-07-21 18:19:41 +03:00
alesapin	daaa5cc382	Add setting allow_non_metadata_alters	2020-07-21 17:05:30 +03:00
alesapin	379a5a750a	Fix error message about granularity	2020-07-21 14:10:23 +03:00
alesapin	b3ec3b1ed1	Fix loading parts without checksums	2020-07-16 13:54:49 +03:00
alesapin	9e41fbca55	Remove check for drop detached partition	2020-07-14 16:56:30 +03:00
alesapin	014bb070ec	Fix tests	2020-07-14 11:19:39 +03:00
alesapin	1f576ee039	Some intermediate solution	2020-07-13 20:27:52 +03:00
alesapin	4a53264a86	Remove redundant and duplicated code	2020-07-13 19:19:08 +03:00
Amos Bird	cac5a89169	Allow nullable key in MergeTree	2020-07-12 22:21:51 +08:00
alesapin	84f8bf1e14	Merge pull request #10697 from CurtizJ/polymorphic-parts ... Polymorphic parts (in-memory format)	2020-07-08 13:25:45 +03:00
Anton Popov	416d9648c2	remove questionable functionality	2020-07-07 12:58:14 +03:00
Nikita Mikhaylov	2b539e6ace	fix style	2020-07-06 20:26:15 +03:00
Nikita Mikhaylov	d31ed58f01	done	2020-07-06 17:33:31 +03:00
Anton Popov	4422df2e37	Merge remote-tracking branch 'upstream/master' into HEAD	2020-07-02 20:18:21 +03:00
Anton Popov	d45697a1b5	in-memory-parts: lazy creation of WAL	2020-06-30 21:47:12 +03:00
Vladimir Chebotarev	bb8da71eff	Moves task shall be started if new storage policy needs them.	2020-06-30 15:36:44 +03:00
Anton Popov	53e955c6dd	several fixes	2020-06-29 23:36:18 +03:00
Alexey Milovidov	1f9c27de34	Fix clang-tidy	2020-06-28 22:39:31 +03:00
Alexey Milovidov	b6e31f0a5e	Only allow Enum extension within the same width	2020-06-28 22:39:31 +03:00
Alexey Milovidov	e4d8cc2b44	Slightly more safe	2020-06-28 22:39:31 +03:00
Alexey Milovidov	97ad23b905	Allow to ALTER partition key in some cases	2020-06-28 22:39:31 +03:00
Alexey Milovidov	678d127503	Whitespace	2020-06-28 22:39:31 +03:00
Alexey Milovidov	c4d5ca485e	Remove the usage of obsolete setting	2020-06-28 22:39:31 +03:00
alesapin	9710a67704	Fix style check	2020-06-26 15:27:12 +03:00
alesapin	6f1824f0ea	Correct merge with master	2020-06-26 14:30:23 +03:00
alesapin	e9c47dc89c	Merge branch 'master' into CurtizJ-polymorphic-parts	2020-06-26 14:27:19 +03:00
Anton Popov	78d28be8cf	check in-memory parts, comments and style-fixes	2020-06-22 21:57:50 +03:00
Alexey Milovidov	0e6fb617aa	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-06-22 01:54:03 +03:00
alesapin	a2e7e9f232	Remove unused constructor and rename method	2020-06-19 18:21:48 +03:00
alesapin	3c47faa9da	Move partition key initialization into registerMergeTree	2020-06-19 18:14:08 +03:00
alesapin	c666763cc0	Remove unused method better	2020-06-18 20:09:06 +03:00
alesapin	e888dafdc2	Remove unused method	2020-06-18 20:03:42 +03:00
alesapin	d79982f497	Better locks in Storages	2020-06-18 19:10:47 +03:00
alesapin	eaaef83742	Settings changes in StorageInMemoryMetadata	2020-06-17 16:46:01 +03:00
alesapin	ed8f3b2fc4	TTL in storage in memory metadata	2020-06-17 16:39:26 +03:00
alesapin	1afdebeebd	Primary key in storage metadata	2020-06-17 15:39:20 +03:00
alesapin	ba04d02f1e	Compilable sorting key in metadata	2020-06-17 14:05:11 +03:00
alesapin	ab61abccc1	Partition key in StorageInMemoryMetadata	2020-06-17 13:34:23 +03:00
alesapin	62f2c17a66	Secondary indices in StorageInMemoryMetadata	2020-06-17 12:38:47 +03:00
Anton Popov	b19d48a11c	Merge remote-tracking branch 'upstream/master' into HEAD	2020-06-16 06:37:55 +03:00
Anton Popov	a3ac224ae4	in-memory parts: sync insert to replicated	2020-06-15 22:57:12 +03:00
Alexey Milovidov	e44e1ad0d4	Don't ignore duplicate parts written to replicas	2020-06-15 21:57:38 +03:00
alesapin	b47a7327fd	All set methods in metadata	2020-06-15 21:08:05 +03:00
alesapin	33a74a3ea0	TTL methods in StorageInMemoryMetadata	2020-06-15 20:50:53 +03:00
alesapin	e667eb57b2	Working set*Keys methods	2020-06-15 20:24:49 +03:00
alesapin	5fc41c7ecc	Move set*Key methods to StorageInMemoryMetadata	2020-06-15 20:17:06 +03:00
alesapin	aa30649ce5	Working setColumns, setConstraints, setIndices	2020-06-15 20:10:14 +03:00
alesapin	af2fe2ba55	Compilable setColumns, setConstraints, setIndices	2020-06-15 19:55:33 +03:00
alesapin	18b58e8483	Revert too strict lock	2020-06-13 12:12:45 +03:00
alesapin	0edf5ff7a2	Fix race condition	2020-06-12 17:32:47 +03:00
alesapin	465c4b65b7	Slightly better interfaces and comments	2020-06-12 12:37:52 +03:00
alesapin	a39d010f94	Merge branch 'master' into consistent_metadata4	2020-06-11 18:47:41 +03:00
Alexey Milovidov	b72a095e99	Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree	2020-06-11 06:24:52 +03:00
alesapin	8be957ecb5	Better checks around metadata	2020-06-10 14:16:31 +03:00
alesapin	ec933d9d03	Better naming	2020-06-10 12:09:51 +03:00
alesapin	75977bd939	Gcc fixed	2020-06-10 00:22:01 +03:00
alesapin	d2fcf5aea5	Fixes for gcc	2020-06-09 20:28:29 +03:00
alesapin	4c2e0561f5	Fix primary key update	2020-06-09 20:21:38 +03:00
alesapin	f7a397242f	Merge branch 'master' into consistent_metadata4	2020-06-09 18:59:59 +03:00
alesapin	de59629b38	Fix benign race condition during shutdown	2020-06-09 04:48:30 +03:00
alesapin	0d375e4522	Fix constraints	2020-06-08 21:49:54 +03:00
alesapin	7b63a88120	Remove redundant error code	2020-06-08 18:19:41 +03:00
alesapin	d625162fce	Better comment	2020-06-08 17:23:32 +03:00
alesapin	37a1d128c9	Better	2020-06-08 17:22:11 +03:00
alesapin	a30b72a128	Less debug	2020-06-08 17:21:12 +03:00
alesapin	638cd50ce4	Fix several bugs	2020-06-08 17:18:38 +03:00
alesapin	2226f79f16	Fix some bugs	2020-06-08 15:57:25 +03:00
alesapin	ac67d0485c	Merge branch 'master' into consistent_metadata4	2020-06-08 15:06:51 +03:00
Alexey Milovidov	f2cfb7d132	Whitespaces	2020-06-08 00:05:36 +03:00
Anton Popov	66e31d4311	in-memory parts: several fixes	2020-06-05 23:49:24 +03:00
alesapin	abaf47f0cd	Make metadata single structure	2020-06-05 20:29:40 +03:00
alesapin	5bc7f67e61	Better metadata for select query and renames	2020-06-05 14:54:54 +03:00
Anton Popov	df3dfd5b81	fix clang-tidy build	2020-06-04 01:00:02 +03:00
Anton Popov	1ce09e1faa	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-06-03 16:27:54 +03:00
Anton Popov	caf1e4e8cc	in-memory-parts: fixes	2020-06-03 12:51:23 +03:00
alesapin	e0e77194f4	Remove redundant parts from MergeTree	2020-06-01 15:39:20 +03:00
alesapin	b49be4c7f2	Better names	2020-06-01 15:11:23 +03:00
alesapin	663e92b1c5	Rename to methods	2020-06-01 14:29:11 +03:00
alesapin	d9a817f578	Less virtual methods in IStorage	2020-06-01 14:17:18 +03:00
alesapin	3847ea892d	Merge branch 'master' into consistent_metadata3	2020-06-01 13:17:59 +03:00
alexey-milovidov	9984e989c1	Merge pull request #11317 from ClickHouse/logger-fmt-2 ... Preparation for structured logging	2020-06-01 00:11:29 +03:00
alexey-milovidov	8accde79b5	Merge pull request #11162 from azat/data-skip-index-merging-params-fix ... [RFC] Fix data skipping indexes for columns with additional actions during merge	2020-05-31 19:10:53 +03:00
Alexey Milovidov	25f941020b	Remove namespace pollution	2020-05-31 00:57:37 +03:00
Alexey Milovidov	5aff138956	Preparation for structured logging	2020-05-31 00:35:52 +03:00
Anton Popov	fa05641b06	in-memory parts: partition commands	2020-05-29 19:58:08 +03:00
Anton Popov	c919840722	in-memory parts: partition commands	2020-05-29 18:02:12 +03:00
Anton Popov	4769ce7271	in-memory parts: several fixes	2020-05-29 02:59:13 +03:00
alesapin	860dc2c814	Merge with consistent_metadata2	2020-05-28 19:45:51 +03:00
alesapin	61aff798d3	Compileable code	2020-05-28 18:33:44 +03:00
alesapin	26a9829e04	Indices description as vector	2020-05-28 15:47:17 +03:00
alesapin	52ca6b2051	I'm able to build it	2020-05-28 15:37:05 +03:00
Anton Popov	d8342e5b12	in-memory parts: better restore and clear stale wal files	2020-05-27 23:05:55 +03:00
alesapin	380c60a33f	Intermediate stage (doesn't compile)	2020-05-27 21:38:34 +03:00
Nikolai Sorokin	57555dbabf	Fix after rebase	2020-05-27 14:00:17 +03:00
Anton Popov	f62adfd588	Fix Arcadia build	2020-05-27 12:53:15 +03:00
Nikolai Sorokin	141ed88751	Allow functions in group by keys; Add default aggregate function; Add more tests	2020-05-27 12:53:15 +03:00
Nikolai Sorokin	66496dc7e3	Fix trailing spaces	2020-05-27 12:53:15 +03:00
Nikolai Sorokin	eeaf608aa9	Refactor code; support prefix of PK as GROUP BY key	2020-05-27 12:53:15 +03:00
Nikolai Sorokin	61974e0047	TTL Expressions WHERE and GROUP BY draft	2020-05-27 12:53:15 +03:00
alesapin	c7cda399c7	Merge branch 'master' into consistent_metadata2	2020-05-27 12:51:56 +03:00
alesapin	9d0c28d96c	Add missing methods	2020-05-26 17:14:08 +03:00
alesapin	6626ef08e8	Fix PVS studio errors	2020-05-26 15:14:50 +03:00