338 Commits

Author	SHA1	Message	Date
Nikolai Kochetov	d7fa440356	Merge branch 'master' into remove-adding-const-column-transform	2021-02-08 15:49:23 +03:00
Alexander Kuzmenkov	4bb38f333b	some simple cases	2021-02-05 18:34:03 +03:00
Nikolai Kochetov	9869f70a0d	Remove AddMissed step and transform.	2021-02-05 14:41:44 +03:00
Alexander Kuzmenkov	6824f13a35	tmp	2021-02-05 12:13:19 +03:00
Nikolai Kochetov	e3d6ffd9dc	Remove AddingConstColumn step and transform.	2021-02-04 17:25:11 +03:00
Alexander Kuzmenkov	c1c71fc8e9	ROWS OFFSET frame end	2021-02-04 10:41:09 +03:00
Alexander Kuzmenkov	4abbbae583	Merge remote-tracking branch 'origin/aku/window-prototype-3' into HEAD	2021-02-04 09:52:02 +03:00
Alexander Kuzmenkov	1b6262f874	cleanup	2021-02-04 09:51:46 +03:00
Alexander Kuzmenkov	d6372bd3d9	linker woes	2021-02-04 09:38:42 +03:00
Alexander Kuzmenkov	35754abb4a	CURRENT ROW frame start for RANGE frame	2021-02-03 17:22:37 +03:00
Alexander Kuzmenkov	7c55ecf67d	cleanup	2021-02-03 16:41:59 +03:00
Alexander Kuzmenkov	f31d2206a7	more fuzzing and less bugs	2021-02-03 15:50:25 +03:00
Alexander Kuzmenkov	bb45c5a8ff	Merge remote-tracking branch 'origin/master' into HEAD	2021-02-03 12:13:23 +03:00
Alexander Kuzmenkov	3c0a5d2226	fix invalid iterator addition	2021-02-03 12:09:31 +03:00
Alexander Kuzmenkov	dad4f82e0e	fix invalid iterator addition	2021-02-03 12:08:46 +03:00
Alexander Kuzmenkov	7e945bab03	fix the calculation for moving frame start	2021-02-03 08:53:21 +03:00
Alexander Kuzmenkov	264aea20be	Merge remote-tracking branch 'origin/master' into HEAD	2021-02-02 19:12:46 +03:00
Alexander Kuzmenkov	d2a0e44a3a	Merge pull request #19299 from ClickHouse/aku/window-prototype ... [wip] support RANGE frame for window functions	2021-02-02 17:59:16 +03:00
Alexander Kuzmenkov	8bd026271a	more cleanup	2021-02-02 04:16:44 +03:00
Alexander Kuzmenkov	78a9624fc5	CURRENT ROW frame start for ROWS frame	2021-02-02 02:27:23 +03:00
Alexander Kuzmenkov	5e99b4461d	cleanup 2	2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov	ef46c36317	start offset for ROWS frame	2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov	5e78105786	cleanup 3	2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov	5519e4c134	unbounded following frame end	2021-01-30 04:16:44 +03:00
Alexander Kuzmenkov	2dd5062cc0	use current row as partition etalon	2021-01-28 23:46:22 +03:00
Alexander Kuzmenkov	09e192395a	update comments and apply the setNeeded() advice from Nikolai	2021-01-28 23:39:27 +03:00
Alexander Kuzmenkov	1b891e042d	fix a bug	2021-01-28 21:18:16 +03:00
Alexander Kuzmenkov	3ace39fbf7	simplify a loop and make RANGE frame the default	2021-01-28 20:05:01 +03:00
Alexander Kuzmenkov	e553eb112f	cleanup	2021-01-28 16:47:06 +03:00
Alexander Kuzmenkov	629cb44d4c	everything was wrong	2021-01-28 16:42:18 +03:00
Alexey Milovidov	093108bf81	Normalize BigInt implementation	2021-01-27 03:54:57 +03:00
Alexander Kuzmenkov	0d69249c56	typo	2021-01-27 03:27:40 +03:00
Alexander Kuzmenkov	83cfdde6d9	RANGE frame works in some cases	2021-01-27 03:08:15 +03:00
Anton Popov	666aab676e	add comments to algorithm	2021-01-26 21:45:22 +03:00
Alexander Kuzmenkov	10a8831d8b	partition by -- single loop	2021-01-26 20:59:38 +03:00
Alexander Kuzmenkov	b8a2a29f94	cleanup	2021-01-26 18:31:09 +03:00
kreuzerkrieg	29a2ef3089	Add IStoragePolicy interface	2021-01-26 10:55:28 +02:00
Alexander Kuzmenkov	574454c270	cleanup	2021-01-25 18:07:09 +03:00
Alexander Kuzmenkov	f8f79d5788	tmp -- the tests pass by some miracle	2021-01-23 02:03:07 +03:00
Anton Popov	573edbcd11	improve performance of aggregation in order of sorting key	2021-01-22 05:34:08 +03:00
Alexander Kuzmenkov	18c944257a	cleanup	2021-01-20 20:23:15 +03:00
Alexander Kuzmenkov	6e4b9aa862	don't use simple transform	2021-01-20 10:10:54 +03:00
Alexander Kuzmenkov	d4e5d5fdb4	Merge pull request #18455 from ClickHouse/aku/window-prototype ... [wip] some window function fixes	2020-12-29 19:23:19 +03:00
Alexander Kuzmenkov	844239b1c3	tmp fixes (split me)	2020-12-24 07:03:33 +03:00
Anton Popov	204a20fe29	remove unused code	2020-12-23 20:34:00 +03:00
Alexander Kuzmenkov	3f33e6b3e0	some review fixes	2020-12-22 20:46:31 +03:00
Alexander Kuzmenkov	dadfc76f8f	fix the fuzzer	2020-12-22 07:02:39 +03:00
Alexander Kuzmenkov	abad6b9e49	clang-tidy is so annoying	2020-12-22 04:41:02 +03:00
Alexander Kuzmenkov	575d5c69ef	fix partition boundaries for multiple window functions	2020-12-22 00:23:45 +03:00
Alexander Kuzmenkov	ac9fc15509	cleanup	2020-12-21 12:59:11 +03:00
Alexander Kuzmenkov	132a0b42eb	cleanup	2020-12-18 20:13:28 +03:00
Alexander Kuzmenkov	a1326414ff	Merge remote-tracking branch 'origin/master' into tmp	2020-12-17 00:46:14 +03:00
Alexander Kuzmenkov	e335074c39	works across the blocks	2020-12-16 15:57:47 +03:00
Alexander Kuzmenkov	fabb37d3c9	cleanup	2020-12-15 20:39:58 +03:00
Nikolai Kochetov	6defcbb662	Merge branch 'master' into optimize-data-on-insert	2020-12-15 16:50:42 +03:00
Alexander Kuzmenkov	a75ca3cb79	Merge remote-tracking branch 'origin/master' into tmp	2020-12-15 03:36:43 +03:00
Alexander Kuzmenkov	6d5b23de67	something works	2020-12-15 03:36:03 +03:00
Alexander Kuzmenkov	6f991725c3	forgot new files	2020-12-11 01:16:58 +03:00
Alexander Kuzmenkov	eb0c817bf2	expression analyzer part	2020-12-09 14:14:40 +03:00
Pavel Kruglov	4b58528b9e	Rename getPos to getRow, change mergeBlock, pass setting instead of context	2020-12-04 19:25:30 +03:00
Pavel Kruglov	905ba78adc	Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert	2020-12-04 18:56:46 +03:00
Alexander Kuzmenkov	8ee86e35d2	debug	2020-12-02 21:16:31 +03:00
Azat Khuzhin	ccd794a676	Add remerge_sort_lowered_memory_bytes_ratio setting ... Sometimes default ratio is not good enough (2), since it depends on lots of factors: - size of LIMIT - max_memory_usage - ... So add a separate setting for it. But note that it make sense to set remerge_sort_lowered_memory_bytes_ratio only in range (1, 2] Since <= 1 will just use more CPU, and > 2 will use more RAM and will unlikely be faster.	2020-11-29 21:16:42 +03:00
Pavel Kruglov	547ec19fb3	Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert	2020-11-18 12:01:59 +03:00
Nikolai Kochetov	13eceff55c	Remove Converting transform and step.	2020-11-17 20:16:55 +03:00
Pavel Kruglov	8d5e0784d3	Add setting optimize_on_insert	2020-11-12 23:37:23 +03:00
Nikolai Kochetov	9b13d0e0eb	Revert "Add ActionsDAG::updateHeader()" ... This reverts commit b78657656c.	2020-11-11 20:17:26 +03:00
Nikolai Kochetov	b78657656c	Add ActionsDAG::updateHeader()	2020-11-11 16:50:29 +03:00
Nikolai Kochetov	1846bb3cac	Merge branch 'master' into actions-dag-f14	2020-11-11 13:08:57 +03:00
Nikolai Kochetov	1db8e77371	Add comments. Update ActionsDAG::Index	2020-11-10 17:54:59 +03:00
Nikolai Kochetov	c10f733587	Merge branch 'master' into storage-read-query-plan	2020-11-06 15:43:46 +03:00
Nikolai Kochetov	9aeb757da4	Merge branch 'master' into actions-dag-f14	2020-11-06 15:04:20 +03:00
nikitamikhaylov	aceb82ae6a	better	2020-11-05 19:00:05 +03:00
Nikolai Kochetov	6767a226fc	Merge branch 'master' into actions-dag-f14	2020-11-03 15:21:06 +03:00
Nikolai Kochetov	07a7c46b89	Refactor ExpressionActions [Part 3]	2020-11-03 14:28:28 +03:00
Alexey Milovidov	32ed8c9681	Fix trailing whitespace	2020-10-26 22:12:40 +03:00
Nikolai Kochetov	7fa045cff8	Merge branch 'master' into storage-read-query-plan	2020-10-22 13:31:10 +03:00
Amos Bird	ca7a5ccd0d	More resize	2020-10-13 09:56:35 +08:00
Nikolai Kochetov	7e58f99f64	Merge branch 'master' into storage-read-query-plan	2020-10-12 13:12:39 +03:00
Amos Bird	d2dcfc3f0d	Refactor processors.	2020-10-12 17:30:05 +08:00
Alexey Milovidov	269b6383f5	Check for #pragma once in headers	2020-10-10 21:37:02 +03:00
Nikolai Kochetov	f9bf1e3406	Merge branch 'master' into storage-read-query-plan	2020-10-06 09:50:10 +03:00
Azat Khuzhin	2a2f858365	Significantly reduce memory usage in AggregatingInOrderTransform ... Clean the aggregates pools (Arena's objects) between flushes, this will reduce memory usage significantly (since Arena is not intended for memory reuse in the already full Chunk's) Before this patch you cannot run SELECT FROM huge_table GROUP BY primary_key SETTINGS optimize_aggregation_in_order=1 (and the whole point of optimize_aggregation_in_order got lost), while after, this should be possible.	2020-10-03 00:56:58 +03:00
alesapin	17b86dec96	Recursive defaults	2020-10-02 15:38:50 +03:00
Nikolai Kochetov	ec64def384	Use QueryPlan while reading from MergeTree.	2020-10-01 20:34:22 +03:00
Alexander Kuzmenkov	679c0988a5	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 16:25:52 +03:00
Alexander Kuzmenkov	fb64cf210a	straighten the protocol version	2020-09-17 17:37:29 +03:00
Nikolai Kochetov	3cc89d467c	Merge branch 'master' into query-plan-for-creating-sets	2020-09-15 20:15:41 +03:00
Nikolai Kochetov	118a8a513e	Update mutations interpreter.	2020-09-15 20:13:13 +03:00
Nikolai Kochetov	6eac433c55	Review fixes.	2020-09-15 13:40:39 +03:00
Nikolai Kochetov	bcfc83022a	Return query plan from storage.	2020-09-14 17:13:58 +03:00
alexey-milovidov	f2e9a09b11	Merge pull request #14585 from ClickHouse/join-processor ... Remove Join from ExpressionActions	2020-09-08 23:56:09 +03:00
Nikolai Kochetov	b0cb5511a9	Fix build.	2020-09-08 14:17:39 +03:00
Nikolai Kochetov	39aad9979a	Remove Join from ExpressionActions.	2020-09-08 13:40:53 +03:00
Nikolai Kochetov	c3eeb8f71e	Merge pull request #14412 from ClickHouse/pipes-and-creating-sets ... Pipes and creating sets	2020-09-08 10:47:56 +03:00
Nikolai Kochetov	41a3fad1ea	Allow many rows in totals.	2020-09-04 15:34:36 +03:00
Nikolai Kochetov	b7e53208d1	Fix tests.	2020-09-04 11:36:47 +03:00
Nikolai Kochetov	acfd35a908	Update QueryPipeline::addCreatingSetsTransform	2020-09-02 16:04:54 +03:00
Nikolai Kochetov	f82b799f12	Update CreatingSetsTransform.	2020-09-01 16:53:11 +03:00
Mark Papadakis	ff76790a59	Update AggregatingTransform.cpp ... Replaced redundant call to chunk.getNumRows() with local var.	2020-08-28 16:08:06 +03:00
Nikolai Kochetov	7c0fcb2039	Merge pull request #13611 from ClickHouse/array-join-processor ... Refactor ARRAY JOIN	2020-08-20 17:56:37 +03:00
Nikolai Kochetov	8e631a98ea	Refactor ActionsChain.	2020-08-14 21:24:58 +03:00
Nikolai Kochetov	95bbda3667	Specify columns after ARRAY JOIN and JOIN. ... Add ArrayJoinTransform and ArrayJoinStep.	2020-08-14 21:24:03 +03:00
Nikolai Kochetov	9b67cd9faf	Merge branch 'master' into refactor-pipes-3	2020-08-10 10:50:17 +03:00
Alexey Milovidov	edd89a8610	Fix half of typos	2020-08-08 03:47:03 +03:00
Anton Popov	e7d3154d38	fix queries with order by prefix of primary key and constant columns	2020-08-06 02:37:39 +03:00
Nikolai Kochetov	9385f3de0e	Refactor Pipe [part 4].	2020-08-04 16:06:59 +03:00
alexey-milovidov	91156bef54	Merge pull request #13075 from ClickHouse/fix-11327 ... Fix 11327	2020-07-31 14:53:07 +03:00
Nikolai Kochetov	3306a24273	Update ConvertingTransform.h	2020-07-31 14:11:03 +03:00
Nikolai Kochetov	fdc49cadb7	Ignore constants for remote query from local replica.	2020-07-29 15:51:59 +03:00
Alexander Kuzmenkov	f6f2812f73	Block structure mismatch is a program error	2020-07-28 21:35:18 +03:00
Nikolai Kochetov	cc7ebfac78	Fix Pipeline stuck for external sort.	2020-07-21 12:23:54 +03:00
Alexey Milovidov	ef930df484	Avoid overflow in LIMIT #10470 #11372	2020-07-12 08:18:01 +03:00
Anton Popov	1122d99ba8	fix order of columns in WITH FILL modifier	2020-07-09 02:56:44 +03:00
Alexey Milovidov	9c53a90e3d	Non-significant changes	2020-07-08 06:16:20 +03:00
Nikolai Kochetov	8587c2025d	Merge branch 'master' into initial-explain	2020-06-29 23:35:56 +03:00
Nikolai Kochetov	40b398c8c4	Merge branch 'master' into better-distinct-for-query-plan	2020-06-29 11:14:05 +03:00
Nikolai Kochetov	893a75bcf7	Merge branch 'master' into initial-explain	2020-06-27 12:45:40 +03:00
Nikolai Kochetov	ca01094f4b	More actions description.	2020-06-27 12:31:11 +03:00
Artem Zuikov	54fd9ce76b	fix totals	2020-06-26 03:23:11 +03:00
Artem Zuikov	2d7d389b77	better ExpressionAction::execute()	2020-06-25 23:28:41 +03:00
Artem Zuikov	bfe30a9723	remove a trick with expression continuation	2020-06-25 22:26:03 +03:00
Nikolai Kochetov	d7d334bf6f	Update query plan traits for DISTINCT. Add more comments.	2020-06-22 13:18:28 +03:00
alesapin	b9e74f4e82	Merge branch 'master' into atomic_metadata5	2020-06-22 12:03:53 +03:00
Nikolai Kochetov	4d70cc34c1	Merge branch 'master' into query-plan	2020-06-20 10:53:48 +03:00
alesapin	a462462610	Merge branch 'master' into atomic_metadata5	2020-06-19 18:58:42 +03:00
Nikolai Kochetov	690b88d331	Merge pull request #11291 from Provet/master ... Partial sorting optimization fix	2020-06-19 12:58:44 +03:00
Nikolai Kochetov	cda4de40d7	Merge branch 'master' into query-plan	2020-06-19 11:29:15 +03:00
Nikolai Kochetov	c111836ada	Update PartialSortingTransform.	2020-06-18 12:08:25 +03:00
alesapin	ebb36bec8a	Merge branch 'master' into atomic_metadata5	2020-06-18 11:57:16 +03:00
alexey-milovidov	c9924b8aa1	Merge pull request #11697 from CurtizJ/fix-with-fill ... Fix 'ORDER BY ... WITH FILL' over const columns.	2020-06-18 06:38:24 +03:00
Nikolai Kochetov	38bebfb20d	Merge remote-tracking branch 'origin' into provert-master	2020-06-17 22:05:45 +03:00
Nikolai Kochetov	c5d9379df0	Add TotalsHavingStep.	2020-06-17 19:54:51 +03:00
Nikolai Kochetov	ce7c8782e2	Update PartialSortingTransform.cpp	2020-06-17 19:13:44 +03:00
Nikolai Kochetov	1ad4f2c0fd	Add CreatingSets step.	2020-06-17 18:50:21 +03:00
Nikolai Kochetov	6c477d06ad	Review fixes.	2020-06-17 14:43:55 +03:00
alesapin	2fac3290f0	Merge branch 'master' into atomic_metadata5	2020-06-17 11:14:03 +03:00
Artem Zuikov	857d84bf7c	Buffer left blocks optimisation for MergeJoin (#10601)	2020-06-16 23:13:18 +03:00
Anton Popov	03058c3c25	fix 'ORDER BY WITH FILL' over const columns	2020-06-16 05:56:16 +03:00
Nikolai Kochetov	03e0a5ddbc	Merge branch 'master' into query-plan	2020-06-15 23:38:35 +03:00
alesapin	36ba0192df	Metadata in read and write methods of IStorage	2020-06-15 22:08:58 +03:00
Nikolai Kochetov	b725df6366	Added ReadFromStorageStep.	2020-06-15 18:17:44 +03:00
Dmitry	e5897bbfb6	size_t -> ssize_t	2020-06-12 18:59:11 +03:00
Anton Popov	5c42408add	Merge pull request #9113 from dimarub2000/group_by_in_order_optimization ... [WIP] Optimization of GROUP BY with respect to table sorting key.	2020-06-06 14:25:59 +03:00
Albert Kidrachev	60b86f524f	add perf-test and fix	2020-06-04 20:10:52 +03:00
Albert Kidrachev	ae7bad368b	run optimization for limit >= 1500 and hint for comparing ColumnString	2020-06-04 01:50:58 +03:00
Anton Popov	5348e5a746	Fix build	2020-06-04 00:58:51 +03:00
Alexander Kuzmenkov	8bf8b44510	Merge pull request #11366 from ClickHouse/fix-SortingTransform-bug ... Fix sorting transform bug	2020-06-03 12:11:57 +03:00
Dmitry	5391d26703	better logging	2020-06-02 23:38:10 +03:00
Nikolai Kochetov	46493b9878	Fix PartialSortingTransform.	2020-06-02 14:56:58 +03:00