366 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	6d5b23de67	something works	2020-12-15 03:36:03 +03:00
alexey-milovidov	bce02de691	Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio ... Add remerge_sort_lowered_memory_bytes_ratio setting	2020-12-13 04:38:50 +03:00
Alexander Kuzmenkov	6f991725c3	forgot new files	2020-12-11 01:16:58 +03:00
alesapin	57f40e4260	Merge pull request #17458 from ClickHouse/merge-expressions ... Merge expressions	2020-12-07 12:34:19 +03:00
Nikolai Kochetov	e57ad9cb7e	Update QueryPlan.cpp	2020-12-04 11:41:36 +03:00
Azat Khuzhin	ccd794a676	Add remerge_sort_lowered_memory_bytes_ratio setting ... Sometimes default ratio is not good enough (2), since it depends on lots of factors: - size of LIMIT - max_memory_usage - ... So add a separate setting for it. But note that it make sense to set remerge_sort_lowered_memory_bytes_ratio only in range (1, 2] Since <= 1 will just use more CPU, and > 2 will use more RAM and will unlikely be faster.	2020-11-29 21:16:42 +03:00
Nikolai Kochetov	a2c450d7e2	Do not merge functions with arrayJoin and stateful functions.	2020-11-27 12:50:56 +03:00
Nikolai Kochetov	c42cc8f1ff	Merge Expressions in QueryPlan.	2020-11-26 22:09:42 +03:00
Nikolai Kochetov	4378ca21ca	Properly check distinct columns.	2020-11-26 12:46:41 +03:00
Nikolai Kochetov	4c09880bc4	Properly check distinct columns.	2020-11-26 11:50:02 +03:00
lichengxiang	fdde2d1e8a	fix #17294: Distinct on subquery with group by may return duplicate result	2020-11-23 17:06:59 +08:00
Nikolai Kochetov	13eceff55c	Remove Converting transform and step.	2020-11-17 20:16:55 +03:00
Nikolai Kochetov	e8e6461fa7	Move ActionsDAG to separate file.	2020-11-16 17:57:56 +03:00
Nikolai Kochetov	9b13d0e0eb	Revert "Add ActionsDAG::updateHeader()" ... This reverts commit b78657656c.	2020-11-11 20:17:26 +03:00
Nikolai Kochetov	58c4a7b890	Some renames.	2020-11-11 19:52:27 +03:00
Nikolai Kochetov	4abcd1bcb3	Add more comments.	2020-11-11 17:26:18 +03:00
Nikolai Kochetov	b78657656c	Add ActionsDAG::updateHeader()	2020-11-11 16:50:29 +03:00
Nikolai Kochetov	1846bb3cac	Merge branch 'master' into actions-dag-f14	2020-11-11 13:08:57 +03:00
Nikolai Kochetov	c6575c9032	Update ExpressionActions constructur	2020-11-10 19:27:55 +03:00
Nikolai Kochetov	6717c7a0af	Merge branch 'master' into actions-dag-f14	2020-11-09 14:57:48 +03:00
Alexey Milovidov	5314185e25	Merge branch 'master' into azat-optimize_skip_unused_shards-optimization	2020-11-08 00:17:59 +03:00
Nikolai Kochetov	4ce88298d7	Fix build	2020-11-03 22:33:29 +03:00
Nikolai Kochetov	07a7c46b89	Refactor ExpressionActions [Part 3]	2020-11-03 14:28:28 +03:00
Nikolai Kochetov	c91b453630	Try fix tests.	2020-10-22 14:08:12 +03:00
Alexey Milovidov	269b6383f5	Check for #pragma once in headers	2020-10-10 21:37:02 +03:00
Nikolai Kochetov	d94d88a6c0	Fix style.	2020-10-07 15:04:15 +03:00
Nikolai Kochetov	7e02152b50	Merge branch 'master' into storage-read-query-plan	2020-10-07 14:27:21 +03:00
Nikolai Kochetov	c5cb05f5f3	Try fix tests.	2020-10-07 14:26:29 +03:00
Nikolai Kochetov	3564ba1c63	Remove moves.	2020-10-06 13:02:07 +03:00
Nikolai Kochetov	efd1f10a6d	Fix build.	2020-10-06 11:55:03 +03:00
Nikolai Kochetov	5bbae0953a	Fix order of resource destruction in SettingQuotaAndLimitsStep.	2020-10-06 09:53:51 +03:00
Nikolai Kochetov	28e12c559c	Ensure resource desrtuction order in ReadFromStorageStep.	2020-10-06 09:35:35 +03:00
Azat Khuzhin	b838214a35	Pass non-const SelectQueryInfo (and drop mutable qualifiers)	2020-10-02 22:42:35 +03:00
Nikolai Kochetov	11c0c2864f	Fix build.	2020-10-02 17:23:06 +03:00
Nikolai Kochetov	5134028140	Fix style.	2020-10-01 21:19:38 +03:00
Nikolai Kochetov	f02ad3dc8e	Use QueryPlan while reading from MergeTree.	2020-10-01 21:02:22 +03:00
Nikolai Kochetov	ec64def384	Use QueryPlan while reading from MergeTree.	2020-10-01 20:34:22 +03:00
Nikolai Kochetov	cb22152878	Fix build.	2020-09-30 18:54:16 +03:00
Nikolai Kochetov	2efde179e9	Merge branch 'master' into storage-read-query-plan	2020-09-30 15:23:46 +03:00
Nikolai Kochetov	5ac6bc071d	QueryPlan for StorageBuffer and StorageMaterializedView read.	2020-09-30 15:22:57 +03:00
Nikolai Kochetov	576ffadb17	Fix explain for ISourceStep.	2020-09-30 15:22:30 +03:00
Nikolai Kochetov	347080ff9a	Remove column from header descriotion for EXPLAIN PLAN and EXPLAIN PIPELINE	2020-09-28 20:37:11 +03:00
Nikolai Kochetov	dea90009e3	Fix build	2020-09-25 16:03:12 +03:00
Nikolai Kochetov	62ef40394a	Merge pull request #14856 from ClickHouse/query-plan-for-creating-sets ... Query plan for creating sets	2020-09-22 16:19:20 +03:00
Nikolai Kochetov	54c1f04b38	Review fixes.	2020-09-21 11:36:12 +03:00
Nikolai Kochetov	b26f11c00c	Support StorageDistributed::read for QueryPlan.	2020-09-18 17:16:53 +03:00
Nikolai Kochetov	50674a320f	Refactor IStorage::read with query plan.	2020-09-18 14:39:07 +03:00
Nikolai Kochetov	2491f0e1c5	Merge branch 'master' into storage-read-query-plan	2020-09-18 14:07:03 +03:00
Nikolai Kochetov	0bf4e8e6e9	Support reading with QueryPlan for StorageView.	2020-09-17 16:22:24 +03:00
Nikolai Kochetov	193b572a05	Add MaterializingStep.	2020-09-17 15:11:23 +03:00
roman	b41421cb1c	[settings]: introduce new query complexity settings for leaf-nodes ... The new setting should allow to control query complexity on leaf nodes excluding the final merging stage on the root-node. For example, distributed query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`, while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500` this limit won't be reached and query will succeed since every shard reads not more that ~1k rows.	2020-09-17 10:37:05 +01:00
Nikolai Kochetov	7384733144	Fix style.	2020-09-17 09:01:35 +03:00
Nikolai Kochetov	73ad505735	Fix tests.	2020-09-16 19:38:33 +03:00
Nikolai Kochetov	2f7ab2bca4	Fix tests.	2020-09-16 19:30:48 +03:00
Nikolai Kochetov	8a26251f94	Fix tests.	2020-09-16 19:11:16 +03:00
Nikolai Kochetov	8de76709fb	Fix tests.	2020-09-16 17:41:01 +03:00
Nikolai Kochetov	3cc89d467c	Merge branch 'master' into query-plan-for-creating-sets	2020-09-15 20:15:41 +03:00
Nikolai Kochetov	118a8a513e	Update mutations interpreter.	2020-09-15 20:13:13 +03:00
Nikolai Kochetov	4c783f19ee	Use QueryPlan for SubqueryForSet.	2020-09-15 16:25:14 +03:00
Nikolai Kochetov	6eac433c55	Review fixes.	2020-09-15 13:40:39 +03:00
Nikolai Kochetov	31660ddb4d	Fix build	2020-09-15 00:30:55 +03:00
Nikolai Kochetov	bcfc83022a	Return query plan from storage.	2020-09-14 17:13:58 +03:00
alexey-milovidov	f2e9a09b11	Merge pull request #14585 from ClickHouse/join-processor ... Remove Join from ExpressionActions	2020-09-08 23:56:09 +03:00
Nikolai Kochetov	39aad9979a	Remove Join from ExpressionActions.	2020-09-08 13:40:53 +03:00
Nikolai Kochetov	acfd35a908	Update QueryPipeline::addCreatingSetsTransform	2020-09-02 16:04:54 +03:00
Nikolai Kochetov	7c0fcb2039	Merge pull request #13611 from ClickHouse/array-join-processor ... Refactor ARRAY JOIN	2020-08-20 17:56:37 +03:00
Nikolai Kochetov	8e631a98ea	Refactor ActionsChain.	2020-08-14 21:24:58 +03:00
Nikolai Kochetov	6934974fc5	Lift up ARRAY JOIN step.	2020-08-14 21:24:31 +03:00
Nikolai Kochetov	85d0f1a480	Add ARRAY JOIN to ActionsChain	2020-08-14 21:24:19 +03:00
Nikolai Kochetov	95bbda3667	Specify columns after ARRAY JOIN and JOIN. ... Add ArrayJoinTransform and ArrayJoinStep.	2020-08-14 21:24:03 +03:00
Nikolai Kochetov	20e63d2271	Refactor Pipe [part 6]	2020-08-06 15:24:05 +03:00
Nikolai Kochetov	9385f3de0e	Refactor Pipe [part 4].	2020-08-04 16:06:59 +03:00
Nikolai Kochetov	09fbce1b1e	Merge branch 'master' into refactor-pipes-3	2020-08-04 11:32:34 +03:00
Nikolai Kochetov	d9ca3d8d40	Refactor Pipe [part 3].	2020-08-03 18:54:53 +03:00
alexey-milovidov	1f19d7e9bd	Merge pull request #13016 from ClickHouse/limit-push-down ... Limit push down	2020-08-02 01:23:06 +03:00
alexey-milovidov	b0b27e687f	Update ITransformingStep.h	2020-08-02 01:21:50 +03:00
alexey-milovidov	bb25cff7b9	Update ITransformingStep.h	2020-08-02 01:21:15 +03:00
Nikolai Kochetov	59d543ca1c	Ignore constants for remote query from local replica.	2020-07-29 17:30:03 +03:00
Nikolai Kochetov	be24184deb	Ignore constants for remote query from local replica.	2020-07-29 17:27:37 +03:00
Nikolai Kochetov	54c6785b36	Try fix tests.	2020-07-29 15:29:20 +03:00
Nikolai Kochetov	d9c78cde6b	Try fix tests.	2020-07-29 15:19:50 +03:00
Nikolai Kochetov	bf8f28a788	Try fix tests.	2020-07-29 14:06:00 +03:00
Nikolai Kochetov	2ea998c139	Try fix gcc build.	2020-07-28 19:50:29 +03:00
Nikolai Kochetov	0743922177	Add limit to explain for MergingSortedStep and PartialSortingStep.	2020-07-28 18:11:00 +03:00
Nikolai Kochetov	9c6627a7eb	Limit push down.	2020-07-28 17:13:31 +03:00
Nikolai Kochetov	e6508db4f0	Split traits of ITransformingStep to DataStreamTraits and TransformTraits.	2020-07-28 16:10:48 +03:00
Nikolai Kochetov	09b8cb0e5f	Add sort_description to QueryPlan DataStream.	2020-07-27 18:37:43 +03:00
Nikolai Kochetov	2f0f1aa5bc	Remove thread limiting.	2020-07-27 16:20:31 +03:00
Nikolai Kochetov	fb3a50024d	Added preserves_number_of_rows trait.	2020-07-27 15:48:33 +03:00
Nikolai Kochetov	b4852e4c69	Limit push down.	2020-07-23 13:20:38 +03:00
alexey-milovidov	0a935dd4e8	Merge branch 'master' into fix-12030	2020-07-09 04:27:40 +03:00
Nikolai Kochetov	fd7fcb28d4	Merge branch 'master' into initial-explain	2020-07-07 22:52:09 +03:00
Nikolai Kochetov	6ed2908e2a	Rename ident to indent.	2020-07-07 22:51:32 +03:00
Nikolai Kochetov	8349afa4ad	Try fix tests.	2020-07-03 16:38:35 +03:00
Nikolai Kochetov	5e8d5bc8c0	Fix overlimiting the nuber of threads for union.	2020-07-03 11:10:52 +03:00
Nikolai Kochetov	6527e04ec3	Fix limiting the number of threads for VIEW.	2020-07-02 15:35:51 +03:00
Nikolai Kochetov	8587c2025d	Merge branch 'master' into initial-explain	2020-06-29 23:35:56 +03:00
Nikolai Kochetov	b3a7a27779	Update arrows.	2020-06-29 23:23:34 +03:00
Nikita Mikhaylov	c057dd38c9	Update ITransformingStep.h	2020-06-29 22:04:10 +03:00
Nikolai Kochetov	40b398c8c4	Merge branch 'master' into better-distinct-for-query-plan	2020-06-29 11:14:05 +03:00
Alexey Milovidov	1462a66d1e	Fix typos	2020-06-27 22:05:00 +03:00
Nikolai Kochetov	5b1596cdb2	Refactor some code.	2020-06-27 17:02:24 +03:00
Nikolai Kochetov	893a75bcf7	Merge branch 'master' into initial-explain	2020-06-27 12:45:40 +03:00
Nikolai Kochetov	79bcc8309c	Header for pipeline.	2020-06-27 12:31:56 +03:00
Nikolai Kochetov	5a678d74c2	Add explain pipeline.	2020-06-27 12:31:31 +03:00
Nikolai Kochetov	ca01094f4b	More actions description.	2020-06-27 12:31:11 +03:00
Nikolai Kochetov	d88e19b69d	Added actions setting for Explain query.	2020-06-27 12:31:06 +03:00
Nikolai Kochetov	b282a1775f	Add description setting.	2020-06-27 12:30:37 +03:00
Nikolai Kochetov	47d9f4af9c	Header for explain.	2020-06-27 12:30:51 +03:00
Nikolai Kochetov	e1481ccfc2	Add initial explain.	2020-06-27 12:30:38 +03:00
Artem Zuikov	54fd9ce76b	fix totals	2020-06-26 03:23:11 +03:00
Artem Zuikov	2d7d389b77	better ExpressionAction::execute()	2020-06-25 23:28:41 +03:00
Nikolai Kochetov	d4d1a4d3f1	Fix style.	2020-06-22 21:17:23 +03:00
Nikolai Kochetov	f0c8ec1c0d	Fix tests.	2020-06-22 14:34:06 +03:00
Nikolai Kochetov	58b3b5c2f9	Rename step.	2020-06-22 13:21:13 +03:00
Nikolai Kochetov	d7d334bf6f	Update query plan traits for DISTINCT. Add more comments.	2020-06-22 13:18:28 +03:00
alesapin	f262c4f652	Better comments	2020-06-22 12:49:21 +03:00
alesapin	b1e8976df4	Merge with master	2020-06-22 12:04:27 +03:00
Nikolai Kochetov	a58b152140	Fix build.	2020-06-20 13:40:53 +03:00
Nikolai Kochetov	e75091ab6c	Fix distinct for FinishSortingStep.	2020-06-20 10:50:45 +03:00
Nikolai Kochetov	f6cd3f43bb	Fix Context leak in InterpreterSelectQuery	2020-06-19 17:42:01 +03:00
Nikolai Kochetov	ec892775a5	Fix Context leak in InterpreterSelectQuery	2020-06-19 16:34:40 +03:00
Nikolai Kochetov	b85b6a6cc2	Fix MergingAggregatedStep	2020-06-19 14:27:07 +03:00
Nikolai Kochetov	cac365689f	Fix mx_threads in query_plan.	2020-06-19 13:45:48 +03:00
Nikolai Kochetov	9ddd7b98cc	Fix tests.	2020-06-19 12:47:15 +03:00
Nikolai Kochetov	1f013208db	Fix style.	2020-06-18 23:11:42 +03:00
Nikolai Kochetov	26161aac8a	Fix ReadFromStorageStep	2020-06-18 22:17:21 +03:00
Nikolai Kochetov	6cbdb6da00	Fix build.	2020-06-18 22:03:21 +03:00
Nikolai Kochetov	0ba7ff85e1	Fix build.	2020-06-18 21:45:27 +03:00
Nikolai Kochetov	b7bed87a7f	Use QueryPlan in InterpreterSelectQuery [part 3].	2020-06-18 21:29:33 +03:00
Nikolai Kochetov	45adacf0bc	Use QueryPlan in InterpreterSelectQuery [part 2].	2020-06-18 20:45:00 +03:00
Nikolai Kochetov	e0841360db	Use QueryPlan in InterpreterSelectQuery [part 1].	2020-06-18 16:38:45 +03:00
Nikolai Kochetov	5bb2ddc6f9	Add DISTINCT trait for QueryPlanStep.	2020-06-18 16:00:16 +03:00
Nikolai Kochetov	21d9c7fcc8	Fix build.	2020-06-18 12:22:29 +03:00
Nikolai Kochetov	9ad00187e3	Update InterpreterSelectQuery..	2020-06-17 23:19:55 +03:00
Nikolai Kochetov	169ad5e805	Add FinishSortingStep.	2020-06-17 22:57:13 +03:00
Nikolai Kochetov	e8049d34c5	Add OffsetsStep.	2020-06-17 22:38:45 +03:00
Nikolai Kochetov	69ff3a8f7d	Add ExtremesStep.	2020-06-17 22:30:36 +03:00
Nikolai Kochetov	d795b2b037	Add FillingStep	2020-06-17 22:20:30 +03:00
Nikolai Kochetov	d41db3622f	Add RollupStep and CubeStep.	2020-06-17 20:15:24 +03:00
Nikolai Kochetov	c5d9379df0	Add TotalsHavingStep.	2020-06-17 19:54:51 +03:00
Nikolai Kochetov	1ad4f2c0fd	Add CreatingSets step.	2020-06-17 18:50:21 +03:00
Nikolai Kochetov	f279df6015	Added AggregatingStep.	2020-06-17 17:21:48 +03:00
Nikolai Kochetov	582ea24469	Added AddingDelayedStreamStep	2020-06-17 16:38:17 +03:00
Nikolai Kochetov	fdacc9f90e	Add MergingAggregatedStep.	2020-06-16 21:57:21 +03:00
Nikolai Kochetov	148257abb5	Add LimitStep.	2020-06-16 21:23:01 +03:00
Nikolai Kochetov	5bb1d5cc43	Add LimitByStep.	2020-06-16 19:49:49 +03:00
Nikolai Kochetov	603bcdde2d	Add DistinctStep.	2020-06-16 19:13:07 +03:00
Nikolai Kochetov	cfe87a77ea	Add MergingSortedStep.	2020-06-16 18:49:09 +03:00
Nikolai Kochetov	08e9ce8661	Add MergingSortedStep.	2020-06-16 18:47:40 +03:00
Nikolai Kochetov	a0a1445da9	Fix build.	2020-06-16 18:10:40 +03:00
Nikolai Kochetov	f563193967	Add MergeSortingStep.	2020-06-16 18:08:01 +03:00
Nikolai Kochetov	815ac03892	Add PartialSortingStep.	2020-06-16 17:45:52 +03:00
Nikolai Kochetov	ab452e9391	Added source steps.	2020-06-16 17:14:14 +03:00
Nikolai Kochetov	4407bd7daa	Added source steps.	2020-06-16 17:11:19 +03:00
Nikolai Kochetov	be8029e54f	Expression and Filter steps.	2020-06-16 15:02:10 +03:00
Nikolai Kochetov	e28552ec71	Fix build.	2020-06-16 12:53:59 +03:00
Nikolai Kochetov	1bb72205bd	Expression and Filter steps.	2020-06-16 12:42:25 +03:00
Nikolai Kochetov	61070a03cd	Fix build.	2020-06-16 10:56:22 +03:00
Nikolai Kochetov	da11190677	Fix tests.	2020-06-15 23:20:45 +03:00
Nikolai Kochetov	dbef88e073	Fix tests.	2020-06-15 22:33:24 +03:00
Nikolai Kochetov	012fb819db	Fix build.	2020-06-15 21:49:41 +03:00
Nikolai Kochetov	68f8372c12	Fix build.	2020-06-15 21:41:47 +03:00
Nikolai Kochetov	b725df6366	Added ReadFromStorageStep.	2020-06-15 18:17:44 +03:00
Nikolai Kochetov	4c179e454a	Add QueryPlan.	2020-06-08 12:14:58 +03:00
Nikolai Kochetov	108575c8ad	Added IQueryPlanStep.	2020-06-05 18:38:03 +03:00